00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2389 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3650 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.128 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.129 The recommended git tool is: git 00:00:00.129 using credential 00000000-0000-0000-0000-000000000002 00:00:00.131 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.178 Fetching changes from the remote Git repository 00:00:00.181 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.223 Using shallow fetch with depth 1 00:00:00.223 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.223 > git --version # timeout=10 00:00:00.258 > git --version # 'git version 2.39.2' 00:00:00.258 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.274 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.274 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.773 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.786 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.797 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.797 > git config core.sparsecheckout # timeout=10 00:00:06.808 > git read-tree -mu HEAD # timeout=10 00:00:06.825 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.847 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.848 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.937 [Pipeline] Start of Pipeline 00:00:07.002 [Pipeline] library 00:00:07.004 Loading library shm_lib@master 00:00:07.004 Library shm_lib@master is cached. Copying from home. 00:00:07.019 [Pipeline] node 00:00:07.029 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:07.031 [Pipeline] { 00:00:07.038 [Pipeline] catchError 00:00:07.039 [Pipeline] { 00:00:07.048 [Pipeline] wrap 00:00:07.054 [Pipeline] { 00:00:07.063 [Pipeline] stage 00:00:07.064 [Pipeline] { (Prologue) 00:00:07.266 [Pipeline] sh 00:00:07.550 + logger -p user.info -t JENKINS-CI 00:00:07.567 [Pipeline] echo 00:00:07.569 Node: GP11 00:00:07.575 [Pipeline] sh 00:00:07.867 [Pipeline] setCustomBuildProperty 00:00:07.878 [Pipeline] echo 00:00:07.879 Cleanup processes 00:00:07.883 [Pipeline] sh 00:00:08.156 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.156 2960636 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.165 [Pipeline] sh 00:00:08.437 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.437 ++ grep -v 'sudo pgrep' 00:00:08.437 ++ awk '{print $1}' 00:00:08.437 + sudo kill -9 00:00:08.437 + true 00:00:08.449 [Pipeline] cleanWs 00:00:08.458 [WS-CLEANUP] Deleting project workspace... 00:00:08.458 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.465 [WS-CLEANUP] done 00:00:08.468 [Pipeline] setCustomBuildProperty 00:00:08.478 [Pipeline] sh 00:00:08.753 + sudo git config --global --replace-all safe.directory '*' 00:00:08.837 [Pipeline] httpRequest 00:00:09.180 [Pipeline] echo 00:00:09.182 Sorcerer 10.211.164.20 is alive 00:00:09.191 [Pipeline] retry 00:00:09.193 [Pipeline] { 00:00:09.210 [Pipeline] httpRequest 00:00:09.215 HttpMethod: GET 00:00:09.215 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.216 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.230 Response Code: HTTP/1.1 200 OK 00:00:09.230 Success: Status code 200 is in the accepted range: 200,404 00:00:09.230 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.215 [Pipeline] } 00:00:13.231 [Pipeline] // retry 00:00:13.237 [Pipeline] sh 00:00:13.512 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.530 [Pipeline] httpRequest 00:00:13.888 [Pipeline] echo 00:00:13.890 Sorcerer 10.211.164.20 is alive 00:00:13.900 [Pipeline] retry 00:00:13.903 [Pipeline] { 00:00:13.917 [Pipeline] httpRequest 00:00:13.922 HttpMethod: GET 00:00:13.922 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:13.923 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:13.929 Response Code: HTTP/1.1 200 OK 00:00:13.929 Success: Status code 200 is in the accepted range: 200,404 00:00:13.930 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:14.526 [Pipeline] } 00:01:14.544 [Pipeline] // retry 00:01:14.552 [Pipeline] sh 00:01:14.864 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:17.408 [Pipeline] sh 00:01:17.693 + git -C spdk log --oneline -n5 00:01:17.693 c13c99a5e test: Various fixes for Fedora40 00:01:17.693 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:17.693 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:17.693 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:17.693 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:17.705 [Pipeline] } 00:01:17.722 [Pipeline] // stage 00:01:17.733 [Pipeline] stage 00:01:17.735 [Pipeline] { (Prepare) 00:01:17.755 [Pipeline] writeFile 00:01:17.775 [Pipeline] sh 00:01:18.055 + logger -p user.info -t JENKINS-CI 00:01:18.068 [Pipeline] sh 00:01:18.383 + logger -p user.info -t JENKINS-CI 00:01:18.393 [Pipeline] sh 00:01:18.670 + cat autorun-spdk.conf 00:01:18.670 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:18.670 SPDK_TEST_NVMF=1 00:01:18.670 SPDK_TEST_NVME_CLI=1 00:01:18.670 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:18.670 SPDK_TEST_NVMF_NICS=e810 00:01:18.670 SPDK_RUN_UBSAN=1 00:01:18.670 NET_TYPE=phy 00:01:18.675 RUN_NIGHTLY=1 00:01:18.680 [Pipeline] readFile 00:01:18.700 [Pipeline] withEnv 00:01:18.702 [Pipeline] { 00:01:18.714 [Pipeline] sh 00:01:18.991 + set -ex 00:01:18.991 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:18.991 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:18.991 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:18.991 ++ SPDK_TEST_NVMF=1 00:01:18.991 ++ SPDK_TEST_NVME_CLI=1 00:01:18.991 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:18.991 ++ SPDK_TEST_NVMF_NICS=e810 00:01:18.991 ++ SPDK_RUN_UBSAN=1 00:01:18.991 ++ NET_TYPE=phy 00:01:18.991 ++ RUN_NIGHTLY=1 00:01:18.991 + case $SPDK_TEST_NVMF_NICS in 00:01:18.991 + DRIVERS=ice 00:01:18.991 + [[ tcp == \r\d\m\a ]] 00:01:18.991 + [[ -n ice ]] 00:01:18.991 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:18.991 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:18.991 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:18.991 rmmod: ERROR: Module irdma is not currently loaded 00:01:18.991 rmmod: ERROR: Module i40iw is not currently loaded 00:01:18.991 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:18.991 + true 00:01:18.991 + for D in $DRIVERS 00:01:18.991 + sudo modprobe ice 00:01:18.991 + exit 0 00:01:19.000 [Pipeline] } 00:01:19.016 [Pipeline] // withEnv 00:01:19.021 [Pipeline] } 00:01:19.033 [Pipeline] // stage 00:01:19.042 [Pipeline] catchError 00:01:19.043 [Pipeline] { 00:01:19.054 [Pipeline] timeout 00:01:19.054 Timeout set to expire in 1 hr 0 min 00:01:19.056 [Pipeline] { 00:01:19.067 [Pipeline] stage 00:01:19.069 [Pipeline] { (Tests) 00:01:19.081 [Pipeline] sh 00:01:19.358 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:19.358 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:19.358 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:19.358 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:19.358 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:19.358 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:19.358 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:19.358 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:19.358 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:19.358 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:19.358 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:19.358 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:19.358 + source /etc/os-release 00:01:19.358 ++ NAME='Fedora Linux' 00:01:19.358 ++ VERSION='39 (Cloud Edition)' 00:01:19.358 ++ ID=fedora 00:01:19.358 ++ VERSION_ID=39 00:01:19.358 ++ VERSION_CODENAME= 00:01:19.358 ++ PLATFORM_ID=platform:f39 00:01:19.358 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:19.358 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:19.358 ++ LOGO=fedora-logo-icon 00:01:19.358 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:19.358 ++ HOME_URL=https://fedoraproject.org/ 00:01:19.358 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:19.358 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:19.358 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:19.358 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:19.358 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:19.358 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:19.358 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:19.358 ++ SUPPORT_END=2024-11-12 00:01:19.358 ++ VARIANT='Cloud Edition' 00:01:19.358 ++ VARIANT_ID=cloud 00:01:19.358 + uname -a 00:01:19.358 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:19.358 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:20.290 Hugepages 00:01:20.290 node hugesize free / total 00:01:20.290 node0 1048576kB 0 / 0 00:01:20.290 node0 2048kB 0 / 0 00:01:20.290 node1 1048576kB 0 / 0 00:01:20.290 node1 2048kB 0 / 0 00:01:20.290 00:01:20.290 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:20.290 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:20.290 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:20.290 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:20.290 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:20.290 + rm -f /tmp/spdk-ld-path 00:01:20.290 + source autorun-spdk.conf 00:01:20.290 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.290 ++ SPDK_TEST_NVMF=1 00:01:20.290 ++ SPDK_TEST_NVME_CLI=1 00:01:20.290 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.290 ++ SPDK_TEST_NVMF_NICS=e810 00:01:20.290 ++ SPDK_RUN_UBSAN=1 00:01:20.290 ++ NET_TYPE=phy 00:01:20.290 ++ RUN_NIGHTLY=1 00:01:20.290 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:20.290 + [[ -n '' ]] 00:01:20.290 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:20.547 + for M in /var/spdk/build-*-manifest.txt 00:01:20.547 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:20.547 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:20.547 + for M in /var/spdk/build-*-manifest.txt 00:01:20.547 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:20.547 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:20.547 + for M in /var/spdk/build-*-manifest.txt 00:01:20.547 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:20.547 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:20.547 ++ uname 00:01:20.547 + [[ Linux == \L\i\n\u\x ]] 00:01:20.547 + sudo dmesg -T 00:01:20.547 + sudo dmesg --clear 00:01:20.547 + dmesg_pid=2961304 00:01:20.547 + [[ Fedora Linux == FreeBSD ]] 00:01:20.547 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:20.547 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:20.547 + sudo dmesg -Tw 00:01:20.547 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:20.547 + [[ -x /usr/src/fio-static/fio ]] 00:01:20.547 + export FIO_BIN=/usr/src/fio-static/fio 00:01:20.547 + FIO_BIN=/usr/src/fio-static/fio 00:01:20.547 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:20.547 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:20.547 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:20.547 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:20.547 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:20.547 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:20.547 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:20.547 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:20.547 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:20.547 Test configuration: 00:01:20.547 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.547 SPDK_TEST_NVMF=1 00:01:20.547 SPDK_TEST_NVME_CLI=1 00:01:20.547 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.547 SPDK_TEST_NVMF_NICS=e810 00:01:20.547 SPDK_RUN_UBSAN=1 00:01:20.548 NET_TYPE=phy 00:01:20.548 RUN_NIGHTLY=1 20:02:25 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:20.548 20:02:25 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:20.548 20:02:25 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:20.548 20:02:25 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:20.548 20:02:25 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:20.548 20:02:25 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:20.548 20:02:25 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:20.548 20:02:25 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:20.548 20:02:25 -- paths/export.sh@5 -- $ export PATH 00:01:20.548 20:02:25 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:20.548 20:02:25 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:20.548 20:02:25 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:20.548 20:02:25 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732129345.XXXXXX 00:01:20.548 20:02:25 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732129345.0mEqmq 00:01:20.548 20:02:25 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:20.548 20:02:25 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:20.548 20:02:25 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:20.548 20:02:25 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:20.548 20:02:25 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:20.548 20:02:25 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:20.548 20:02:25 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:20.548 20:02:25 -- common/autotest_common.sh@10 -- $ set +x 00:01:20.548 20:02:25 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:20.548 20:02:25 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:20.548 20:02:25 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:20.548 20:02:25 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:20.548 20:02:25 -- spdk/autobuild.sh@16 -- $ date -u 00:01:20.548 Wed Nov 20 07:02:25 PM UTC 2024 00:01:20.548 20:02:25 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:20.548 LTS-67-gc13c99a5e 00:01:20.548 20:02:25 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:20.548 20:02:25 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:20.548 20:02:25 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:20.548 20:02:25 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:20.548 20:02:25 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:20.548 20:02:25 -- common/autotest_common.sh@10 -- $ set +x 00:01:20.548 ************************************ 00:01:20.548 START TEST ubsan 00:01:20.548 ************************************ 00:01:20.548 20:02:25 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:20.548 using ubsan 00:01:20.548 00:01:20.548 real 0m0.000s 00:01:20.548 user 0m0.000s 00:01:20.548 sys 0m0.000s 00:01:20.548 20:02:25 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:20.548 20:02:25 -- common/autotest_common.sh@10 -- $ set +x 00:01:20.548 ************************************ 00:01:20.548 END TEST ubsan 00:01:20.548 ************************************ 00:01:20.548 20:02:25 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:20.548 20:02:25 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:20.548 20:02:25 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:20.548 20:02:25 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:20.548 20:02:25 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:20.548 20:02:25 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:20.548 20:02:25 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:20.548 20:02:25 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:20.548 20:02:25 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:20.548 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:20.548 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:20.805 Using 'verbs' RDMA provider 00:01:31.352 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:41.330 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:41.330 Creating mk/config.mk...done. 00:01:41.330 Creating mk/cc.flags.mk...done. 00:01:41.330 Type 'make' to build. 00:01:41.330 20:02:45 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:41.330 20:02:45 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:41.330 20:02:45 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:41.330 20:02:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:41.330 ************************************ 00:01:41.330 START TEST make 00:01:41.330 ************************************ 00:01:41.330 20:02:45 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:41.330 make[1]: Nothing to be done for 'all'. 00:01:49.472 The Meson build system 00:01:49.472 Version: 1.5.0 00:01:49.472 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:49.472 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:49.472 Build type: native build 00:01:49.472 Program cat found: YES (/usr/bin/cat) 00:01:49.472 Project name: DPDK 00:01:49.472 Project version: 23.11.0 00:01:49.472 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:49.472 C linker for the host machine: cc ld.bfd 2.40-14 00:01:49.472 Host machine cpu family: x86_64 00:01:49.472 Host machine cpu: x86_64 00:01:49.472 Message: ## Building in Developer Mode ## 00:01:49.472 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:49.472 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:49.472 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:49.472 Program python3 found: YES (/usr/bin/python3) 00:01:49.472 Program cat found: YES (/usr/bin/cat) 00:01:49.472 Compiler for C supports arguments -march=native: YES 00:01:49.472 Checking for size of "void *" : 8 00:01:49.472 Checking for size of "void *" : 8 (cached) 00:01:49.472 Library m found: YES 00:01:49.472 Library numa found: YES 00:01:49.472 Has header "numaif.h" : YES 00:01:49.472 Library fdt found: NO 00:01:49.473 Library execinfo found: NO 00:01:49.473 Has header "execinfo.h" : YES 00:01:49.473 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:49.473 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:49.473 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:49.473 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:49.473 Run-time dependency openssl found: YES 3.1.1 00:01:49.473 Run-time dependency libpcap found: YES 1.10.4 00:01:49.473 Has header "pcap.h" with dependency libpcap: YES 00:01:49.473 Compiler for C supports arguments -Wcast-qual: YES 00:01:49.473 Compiler for C supports arguments -Wdeprecated: YES 00:01:49.473 Compiler for C supports arguments -Wformat: YES 00:01:49.473 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:49.473 Compiler for C supports arguments -Wformat-security: NO 00:01:49.473 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:49.473 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:49.473 Compiler for C supports arguments -Wnested-externs: YES 00:01:49.473 Compiler for C supports arguments -Wold-style-definition: YES 00:01:49.473 Compiler for C supports arguments -Wpointer-arith: YES 00:01:49.473 Compiler for C supports arguments -Wsign-compare: YES 00:01:49.473 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:49.473 Compiler for C supports arguments -Wundef: YES 00:01:49.473 Compiler for C supports arguments -Wwrite-strings: YES 00:01:49.473 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:49.473 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:49.473 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:49.473 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:49.473 Program objdump found: YES (/usr/bin/objdump) 00:01:49.473 Compiler for C supports arguments -mavx512f: YES 00:01:49.473 Checking if "AVX512 checking" compiles: YES 00:01:49.473 Fetching value of define "__SSE4_2__" : 1 00:01:49.473 Fetching value of define "__AES__" : 1 00:01:49.473 Fetching value of define "__AVX__" : 1 00:01:49.473 Fetching value of define "__AVX2__" : (undefined) 00:01:49.473 Fetching value of define "__AVX512BW__" : (undefined) 00:01:49.473 Fetching value of define "__AVX512CD__" : (undefined) 00:01:49.473 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:49.473 Fetching value of define "__AVX512F__" : (undefined) 00:01:49.473 Fetching value of define "__AVX512VL__" : (undefined) 00:01:49.473 Fetching value of define "__PCLMUL__" : 1 00:01:49.473 Fetching value of define "__RDRND__" : 1 00:01:49.473 Fetching value of define "__RDSEED__" : (undefined) 00:01:49.473 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:49.473 Fetching value of define "__znver1__" : (undefined) 00:01:49.473 Fetching value of define "__znver2__" : (undefined) 00:01:49.473 Fetching value of define "__znver3__" : (undefined) 00:01:49.473 Fetching value of define "__znver4__" : (undefined) 00:01:49.473 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:49.473 Message: lib/log: Defining dependency "log" 00:01:49.473 Message: lib/kvargs: Defining dependency "kvargs" 00:01:49.473 Message: lib/telemetry: Defining dependency "telemetry" 00:01:49.473 Checking for function "getentropy" : NO 00:01:49.473 Message: lib/eal: Defining dependency "eal" 00:01:49.473 Message: lib/ring: Defining dependency "ring" 00:01:49.473 Message: lib/rcu: Defining dependency "rcu" 00:01:49.473 Message: lib/mempool: Defining dependency "mempool" 00:01:49.473 Message: lib/mbuf: Defining dependency "mbuf" 00:01:49.473 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:49.473 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:49.473 Compiler for C supports arguments -mpclmul: YES 00:01:49.473 Compiler for C supports arguments -maes: YES 00:01:49.473 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:49.473 Compiler for C supports arguments -mavx512bw: YES 00:01:49.473 Compiler for C supports arguments -mavx512dq: YES 00:01:49.473 Compiler for C supports arguments -mavx512vl: YES 00:01:49.473 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:49.473 Compiler for C supports arguments -mavx2: YES 00:01:49.473 Compiler for C supports arguments -mavx: YES 00:01:49.473 Message: lib/net: Defining dependency "net" 00:01:49.473 Message: lib/meter: Defining dependency "meter" 00:01:49.473 Message: lib/ethdev: Defining dependency "ethdev" 00:01:49.473 Message: lib/pci: Defining dependency "pci" 00:01:49.473 Message: lib/cmdline: Defining dependency "cmdline" 00:01:49.473 Message: lib/hash: Defining dependency "hash" 00:01:49.473 Message: lib/timer: Defining dependency "timer" 00:01:49.473 Message: lib/compressdev: Defining dependency "compressdev" 00:01:49.473 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:49.473 Message: lib/dmadev: Defining dependency "dmadev" 00:01:49.473 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:49.473 Message: lib/power: Defining dependency "power" 00:01:49.473 Message: lib/reorder: Defining dependency "reorder" 00:01:49.473 Message: lib/security: Defining dependency "security" 00:01:49.473 Has header "linux/userfaultfd.h" : YES 00:01:49.473 Has header "linux/vduse.h" : YES 00:01:49.473 Message: lib/vhost: Defining dependency "vhost" 00:01:49.473 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:49.473 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:49.473 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:49.473 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:49.473 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:49.473 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:49.473 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:49.473 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:49.473 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:49.473 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:49.473 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:49.473 Configuring doxy-api-html.conf using configuration 00:01:49.473 Configuring doxy-api-man.conf using configuration 00:01:49.473 Program mandb found: YES (/usr/bin/mandb) 00:01:49.473 Program sphinx-build found: NO 00:01:49.473 Configuring rte_build_config.h using configuration 00:01:49.473 Message: 00:01:49.473 ================= 00:01:49.473 Applications Enabled 00:01:49.473 ================= 00:01:49.473 00:01:49.473 apps: 00:01:49.473 00:01:49.473 00:01:49.473 Message: 00:01:49.473 ================= 00:01:49.473 Libraries Enabled 00:01:49.473 ================= 00:01:49.473 00:01:49.473 libs: 00:01:49.473 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:49.473 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:49.473 cryptodev, dmadev, power, reorder, security, vhost, 00:01:49.473 00:01:49.473 Message: 00:01:49.473 =============== 00:01:49.473 Drivers Enabled 00:01:49.473 =============== 00:01:49.473 00:01:49.473 common: 00:01:49.473 00:01:49.473 bus: 00:01:49.473 pci, vdev, 00:01:49.473 mempool: 00:01:49.473 ring, 00:01:49.473 dma: 00:01:49.473 00:01:49.473 net: 00:01:49.473 00:01:49.473 crypto: 00:01:49.473 00:01:49.473 compress: 00:01:49.473 00:01:49.473 vdpa: 00:01:49.473 00:01:49.473 00:01:49.473 Message: 00:01:49.473 ================= 00:01:49.473 Content Skipped 00:01:49.473 ================= 00:01:49.473 00:01:49.473 apps: 00:01:49.473 dumpcap: explicitly disabled via build config 00:01:49.473 graph: explicitly disabled via build config 00:01:49.473 pdump: explicitly disabled via build config 00:01:49.473 proc-info: explicitly disabled via build config 00:01:49.473 test-acl: explicitly disabled via build config 00:01:49.473 test-bbdev: explicitly disabled via build config 00:01:49.473 test-cmdline: explicitly disabled via build config 00:01:49.473 test-compress-perf: explicitly disabled via build config 00:01:49.473 test-crypto-perf: explicitly disabled via build config 00:01:49.473 test-dma-perf: explicitly disabled via build config 00:01:49.473 test-eventdev: explicitly disabled via build config 00:01:49.473 test-fib: explicitly disabled via build config 00:01:49.473 test-flow-perf: explicitly disabled via build config 00:01:49.473 test-gpudev: explicitly disabled via build config 00:01:49.473 test-mldev: explicitly disabled via build config 00:01:49.473 test-pipeline: explicitly disabled via build config 00:01:49.473 test-pmd: explicitly disabled via build config 00:01:49.473 test-regex: explicitly disabled via build config 00:01:49.473 test-sad: explicitly disabled via build config 00:01:49.473 test-security-perf: explicitly disabled via build config 00:01:49.473 00:01:49.473 libs: 00:01:49.473 metrics: explicitly disabled via build config 00:01:49.473 acl: explicitly disabled via build config 00:01:49.473 bbdev: explicitly disabled via build config 00:01:49.473 bitratestats: explicitly disabled via build config 00:01:49.473 bpf: explicitly disabled via build config 00:01:49.473 cfgfile: explicitly disabled via build config 00:01:49.473 distributor: explicitly disabled via build config 00:01:49.473 efd: explicitly disabled via build config 00:01:49.473 eventdev: explicitly disabled via build config 00:01:49.473 dispatcher: explicitly disabled via build config 00:01:49.473 gpudev: explicitly disabled via build config 00:01:49.473 gro: explicitly disabled via build config 00:01:49.473 gso: explicitly disabled via build config 00:01:49.473 ip_frag: explicitly disabled via build config 00:01:49.473 jobstats: explicitly disabled via build config 00:01:49.473 latencystats: explicitly disabled via build config 00:01:49.473 lpm: explicitly disabled via build config 00:01:49.473 member: explicitly disabled via build config 00:01:49.473 pcapng: explicitly disabled via build config 00:01:49.473 rawdev: explicitly disabled via build config 00:01:49.473 regexdev: explicitly disabled via build config 00:01:49.473 mldev: explicitly disabled via build config 00:01:49.473 rib: explicitly disabled via build config 00:01:49.473 sched: explicitly disabled via build config 00:01:49.474 stack: explicitly disabled via build config 00:01:49.474 ipsec: explicitly disabled via build config 00:01:49.474 pdcp: explicitly disabled via build config 00:01:49.474 fib: explicitly disabled via build config 00:01:49.474 port: explicitly disabled via build config 00:01:49.474 pdump: explicitly disabled via build config 00:01:49.474 table: explicitly disabled via build config 00:01:49.474 pipeline: explicitly disabled via build config 00:01:49.474 graph: explicitly disabled via build config 00:01:49.474 node: explicitly disabled via build config 00:01:49.474 00:01:49.474 drivers: 00:01:49.474 common/cpt: not in enabled drivers build config 00:01:49.474 common/dpaax: not in enabled drivers build config 00:01:49.474 common/iavf: not in enabled drivers build config 00:01:49.474 common/idpf: not in enabled drivers build config 00:01:49.474 common/mvep: not in enabled drivers build config 00:01:49.474 common/octeontx: not in enabled drivers build config 00:01:49.474 bus/auxiliary: not in enabled drivers build config 00:01:49.474 bus/cdx: not in enabled drivers build config 00:01:49.474 bus/dpaa: not in enabled drivers build config 00:01:49.474 bus/fslmc: not in enabled drivers build config 00:01:49.474 bus/ifpga: not in enabled drivers build config 00:01:49.474 bus/platform: not in enabled drivers build config 00:01:49.474 bus/vmbus: not in enabled drivers build config 00:01:49.474 common/cnxk: not in enabled drivers build config 00:01:49.474 common/mlx5: not in enabled drivers build config 00:01:49.474 common/nfp: not in enabled drivers build config 00:01:49.474 common/qat: not in enabled drivers build config 00:01:49.474 common/sfc_efx: not in enabled drivers build config 00:01:49.474 mempool/bucket: not in enabled drivers build config 00:01:49.474 mempool/cnxk: not in enabled drivers build config 00:01:49.474 mempool/dpaa: not in enabled drivers build config 00:01:49.474 mempool/dpaa2: not in enabled drivers build config 00:01:49.474 mempool/octeontx: not in enabled drivers build config 00:01:49.474 mempool/stack: not in enabled drivers build config 00:01:49.474 dma/cnxk: not in enabled drivers build config 00:01:49.474 dma/dpaa: not in enabled drivers build config 00:01:49.474 dma/dpaa2: not in enabled drivers build config 00:01:49.474 dma/hisilicon: not in enabled drivers build config 00:01:49.474 dma/idxd: not in enabled drivers build config 00:01:49.474 dma/ioat: not in enabled drivers build config 00:01:49.474 dma/skeleton: not in enabled drivers build config 00:01:49.474 net/af_packet: not in enabled drivers build config 00:01:49.474 net/af_xdp: not in enabled drivers build config 00:01:49.474 net/ark: not in enabled drivers build config 00:01:49.474 net/atlantic: not in enabled drivers build config 00:01:49.474 net/avp: not in enabled drivers build config 00:01:49.474 net/axgbe: not in enabled drivers build config 00:01:49.474 net/bnx2x: not in enabled drivers build config 00:01:49.474 net/bnxt: not in enabled drivers build config 00:01:49.474 net/bonding: not in enabled drivers build config 00:01:49.474 net/cnxk: not in enabled drivers build config 00:01:49.474 net/cpfl: not in enabled drivers build config 00:01:49.474 net/cxgbe: not in enabled drivers build config 00:01:49.474 net/dpaa: not in enabled drivers build config 00:01:49.474 net/dpaa2: not in enabled drivers build config 00:01:49.474 net/e1000: not in enabled drivers build config 00:01:49.474 net/ena: not in enabled drivers build config 00:01:49.474 net/enetc: not in enabled drivers build config 00:01:49.474 net/enetfec: not in enabled drivers build config 00:01:49.474 net/enic: not in enabled drivers build config 00:01:49.474 net/failsafe: not in enabled drivers build config 00:01:49.474 net/fm10k: not in enabled drivers build config 00:01:49.474 net/gve: not in enabled drivers build config 00:01:49.474 net/hinic: not in enabled drivers build config 00:01:49.474 net/hns3: not in enabled drivers build config 00:01:49.474 net/i40e: not in enabled drivers build config 00:01:49.474 net/iavf: not in enabled drivers build config 00:01:49.474 net/ice: not in enabled drivers build config 00:01:49.474 net/idpf: not in enabled drivers build config 00:01:49.474 net/igc: not in enabled drivers build config 00:01:49.474 net/ionic: not in enabled drivers build config 00:01:49.474 net/ipn3ke: not in enabled drivers build config 00:01:49.474 net/ixgbe: not in enabled drivers build config 00:01:49.474 net/mana: not in enabled drivers build config 00:01:49.474 net/memif: not in enabled drivers build config 00:01:49.474 net/mlx4: not in enabled drivers build config 00:01:49.474 net/mlx5: not in enabled drivers build config 00:01:49.474 net/mvneta: not in enabled drivers build config 00:01:49.474 net/mvpp2: not in enabled drivers build config 00:01:49.474 net/netvsc: not in enabled drivers build config 00:01:49.474 net/nfb: not in enabled drivers build config 00:01:49.474 net/nfp: not in enabled drivers build config 00:01:49.474 net/ngbe: not in enabled drivers build config 00:01:49.474 net/null: not in enabled drivers build config 00:01:49.474 net/octeontx: not in enabled drivers build config 00:01:49.474 net/octeon_ep: not in enabled drivers build config 00:01:49.474 net/pcap: not in enabled drivers build config 00:01:49.474 net/pfe: not in enabled drivers build config 00:01:49.474 net/qede: not in enabled drivers build config 00:01:49.474 net/ring: not in enabled drivers build config 00:01:49.474 net/sfc: not in enabled drivers build config 00:01:49.474 net/softnic: not in enabled drivers build config 00:01:49.474 net/tap: not in enabled drivers build config 00:01:49.474 net/thunderx: not in enabled drivers build config 00:01:49.474 net/txgbe: not in enabled drivers build config 00:01:49.474 net/vdev_netvsc: not in enabled drivers build config 00:01:49.474 net/vhost: not in enabled drivers build config 00:01:49.474 net/virtio: not in enabled drivers build config 00:01:49.474 net/vmxnet3: not in enabled drivers build config 00:01:49.474 raw/*: missing internal dependency, "rawdev" 00:01:49.474 crypto/armv8: not in enabled drivers build config 00:01:49.474 crypto/bcmfs: not in enabled drivers build config 00:01:49.474 crypto/caam_jr: not in enabled drivers build config 00:01:49.474 crypto/ccp: not in enabled drivers build config 00:01:49.474 crypto/cnxk: not in enabled drivers build config 00:01:49.474 crypto/dpaa_sec: not in enabled drivers build config 00:01:49.474 crypto/dpaa2_sec: not in enabled drivers build config 00:01:49.474 crypto/ipsec_mb: not in enabled drivers build config 00:01:49.474 crypto/mlx5: not in enabled drivers build config 00:01:49.474 crypto/mvsam: not in enabled drivers build config 00:01:49.474 crypto/nitrox: not in enabled drivers build config 00:01:49.474 crypto/null: not in enabled drivers build config 00:01:49.474 crypto/octeontx: not in enabled drivers build config 00:01:49.474 crypto/openssl: not in enabled drivers build config 00:01:49.474 crypto/scheduler: not in enabled drivers build config 00:01:49.474 crypto/uadk: not in enabled drivers build config 00:01:49.474 crypto/virtio: not in enabled drivers build config 00:01:49.474 compress/isal: not in enabled drivers build config 00:01:49.474 compress/mlx5: not in enabled drivers build config 00:01:49.474 compress/octeontx: not in enabled drivers build config 00:01:49.474 compress/zlib: not in enabled drivers build config 00:01:49.474 regex/*: missing internal dependency, "regexdev" 00:01:49.474 ml/*: missing internal dependency, "mldev" 00:01:49.474 vdpa/ifc: not in enabled drivers build config 00:01:49.474 vdpa/mlx5: not in enabled drivers build config 00:01:49.474 vdpa/nfp: not in enabled drivers build config 00:01:49.474 vdpa/sfc: not in enabled drivers build config 00:01:49.474 event/*: missing internal dependency, "eventdev" 00:01:49.474 baseband/*: missing internal dependency, "bbdev" 00:01:49.474 gpu/*: missing internal dependency, "gpudev" 00:01:49.474 00:01:49.474 00:01:49.793 Build targets in project: 85 00:01:49.793 00:01:49.793 DPDK 23.11.0 00:01:49.793 00:01:49.793 User defined options 00:01:49.793 buildtype : debug 00:01:49.793 default_library : shared 00:01:49.793 libdir : lib 00:01:49.793 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:49.793 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:49.793 c_link_args : 00:01:49.793 cpu_instruction_set: native 00:01:49.793 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:49.793 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:49.793 enable_docs : false 00:01:49.793 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:49.793 enable_kmods : false 00:01:49.793 tests : false 00:01:49.793 00:01:49.793 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:50.367 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:50.367 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:50.367 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:50.367 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:50.367 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:50.367 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:50.367 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:50.367 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:50.367 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:50.367 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:50.367 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:50.367 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:50.367 [12/265] Linking static target lib/librte_kvargs.a 00:01:50.367 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:50.367 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:50.367 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:50.367 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:50.367 [17/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:50.629 [18/265] Linking static target lib/librte_log.a 00:01:50.629 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:50.629 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:50.887 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:51.149 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.149 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:51.149 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:51.149 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:51.149 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:51.149 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:51.149 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:51.149 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:51.149 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:51.149 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:51.415 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:51.415 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:51.415 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:51.415 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:51.415 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:51.415 [37/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:51.415 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:51.415 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:51.415 [40/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:51.415 [41/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:51.415 [42/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:51.415 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:51.415 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:51.415 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:51.415 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:51.415 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:51.415 [48/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:51.415 [49/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:51.415 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:51.415 [51/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:51.415 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:51.415 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:51.415 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:51.415 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:51.415 [56/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:51.415 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:51.415 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:51.415 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:51.415 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:51.415 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:51.415 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:51.415 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:51.415 [64/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:51.415 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:51.675 [66/265] Linking static target lib/librte_telemetry.a 00:01:51.676 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:51.676 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:51.676 [69/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:51.676 [70/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:51.676 [71/265] Linking static target lib/librte_pci.a 00:01:51.676 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:51.676 [73/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:51.676 [74/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.676 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:51.676 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:51.676 [77/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:51.937 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:51.937 [79/265] Linking target lib/librte_log.so.24.0 00:01:51.937 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:51.937 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:51.937 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:51.937 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:51.937 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:51.937 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:51.937 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:51.937 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:52.198 [88/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:52.198 [89/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.198 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:52.198 [91/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:52.198 [92/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:52.198 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:52.198 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:52.198 [95/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:52.198 [96/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:52.198 [97/265] Linking static target lib/librte_ring.a 00:01:52.198 [98/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:52.198 [99/265] Linking target lib/librte_kvargs.so.24.0 00:01:52.198 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:52.461 [101/265] Linking static target lib/librte_meter.a 00:01:52.461 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:52.461 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:52.461 [104/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:52.461 [105/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:52.461 [106/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:52.461 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:52.461 [108/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:52.461 [109/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:52.461 [110/265] Linking static target lib/librte_eal.a 00:01:52.461 [111/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:52.461 [112/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:52.461 [113/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:52.461 [114/265] Linking static target lib/librte_rcu.a 00:01:52.461 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:52.461 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:52.461 [117/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.461 [118/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:52.461 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:52.461 [120/265] Linking static target lib/librte_mempool.a 00:01:52.461 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:52.461 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:52.461 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:52.724 [124/265] Linking target lib/librte_telemetry.so.24.0 00:01:52.724 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:52.724 [126/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:52.724 [127/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:52.724 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:52.724 [129/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:52.724 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:52.724 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:52.724 [132/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:52.724 [133/265] Linking static target lib/librte_cmdline.a 00:01:52.724 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:52.724 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:52.724 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:52.724 [137/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:52.987 [138/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:52.987 [139/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.987 [140/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.987 [141/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:52.987 [142/265] Linking static target lib/librte_timer.a 00:01:52.987 [143/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:52.987 [144/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.987 [145/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:52.987 [146/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:52.987 [147/265] Linking static target lib/librte_net.a 00:01:52.987 [148/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:52.987 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:52.987 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:53.248 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:53.248 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:53.248 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:53.248 [154/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:53.248 [155/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:53.248 [156/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:53.507 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:53.507 [158/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:53.507 [159/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.507 [160/265] Linking static target lib/librte_dmadev.a 00:01:53.507 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.507 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.507 [163/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:53.507 [164/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:53.507 [165/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:53.507 [166/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:53.507 [167/265] Linking static target lib/librte_hash.a 00:01:53.507 [168/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:53.507 [169/265] Linking static target lib/librte_compressdev.a 00:01:53.507 [170/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:53.766 [171/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:53.766 [172/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:53.766 [173/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:53.766 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:53.766 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:53.766 [176/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:53.766 [177/265] Linking static target lib/librte_power.a 00:01:53.766 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:53.766 [179/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:53.766 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:53.766 [181/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:53.766 [182/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:53.766 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:53.766 [184/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.766 [185/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.766 [186/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:53.766 [187/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:53.766 [188/265] Linking static target lib/librte_reorder.a 00:01:54.025 [189/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:54.025 [190/265] Linking static target lib/librte_mbuf.a 00:01:54.025 [191/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:54.025 [192/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:54.025 [193/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:54.025 [194/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:54.025 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:54.025 [196/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:54.025 [197/265] Linking static target drivers/librte_bus_vdev.a 00:01:54.025 [198/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:54.025 [199/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.025 [200/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.283 [201/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:54.283 [202/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.283 [203/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:54.283 [204/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:54.283 [205/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:54.283 [206/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:54.283 [207/265] Linking static target drivers/librte_bus_pci.a 00:01:54.283 [208/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:54.283 [209/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:54.283 [210/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.283 [211/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.283 [212/265] Linking static target lib/librte_security.a 00:01:54.283 [213/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.283 [214/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:54.283 [215/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:54.283 [216/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:54.283 [217/265] Linking static target drivers/librte_mempool_ring.a 00:01:54.283 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:54.283 [219/265] Linking static target lib/librte_ethdev.a 00:01:54.540 [220/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.540 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:54.540 [222/265] Linking static target lib/librte_cryptodev.a 00:01:54.540 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.917 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.853 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:58.301 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.559 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.559 [228/265] Linking target lib/librte_eal.so.24.0 00:01:58.817 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:58.818 [230/265] Linking target lib/librte_ring.so.24.0 00:01:58.818 [231/265] Linking target lib/librte_dmadev.so.24.0 00:01:58.818 [232/265] Linking target lib/librte_pci.so.24.0 00:01:58.818 [233/265] Linking target lib/librte_meter.so.24.0 00:01:58.818 [234/265] Linking target lib/librte_timer.so.24.0 00:01:58.818 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:58.818 [236/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:58.818 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:58.818 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:58.818 [239/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:58.818 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:59.076 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:59.076 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:59.076 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:59.076 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:59.076 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:59.076 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:59.076 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:59.334 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:59.334 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:59.334 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:59.334 [251/265] Linking target lib/librte_net.so.24.0 00:01:59.334 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:59.334 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:59.334 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:59.334 [255/265] Linking target lib/librte_security.so.24.0 00:01:59.334 [256/265] Linking target lib/librte_hash.so.24.0 00:01:59.334 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:59.592 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:59.592 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:59.592 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:59.592 [261/265] Linking target lib/librte_power.so.24.0 00:02:02.881 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:02.881 [263/265] Linking static target lib/librte_vhost.a 00:02:03.449 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.707 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:03.707 INFO: autodetecting backend as ninja 00:02:03.707 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:04.640 CC lib/ut/ut.o 00:02:04.640 CC lib/ut_mock/mock.o 00:02:04.640 CC lib/log/log.o 00:02:04.640 CC lib/log/log_flags.o 00:02:04.640 CC lib/log/log_deprecated.o 00:02:04.640 LIB libspdk_ut_mock.a 00:02:04.640 SO libspdk_ut_mock.so.5.0 00:02:04.640 LIB libspdk_ut.a 00:02:04.640 LIB libspdk_log.a 00:02:04.640 SO libspdk_ut.so.1.0 00:02:04.640 SO libspdk_log.so.6.1 00:02:04.640 SYMLINK libspdk_ut_mock.so 00:02:04.640 SYMLINK libspdk_ut.so 00:02:04.640 SYMLINK libspdk_log.so 00:02:04.898 CXX lib/trace_parser/trace.o 00:02:04.898 CC lib/ioat/ioat.o 00:02:04.898 CC lib/dma/dma.o 00:02:04.898 CC lib/util/base64.o 00:02:04.898 CC lib/util/bit_array.o 00:02:04.898 CC lib/util/cpuset.o 00:02:04.898 CC lib/util/crc16.o 00:02:04.898 CC lib/util/crc32.o 00:02:04.898 CC lib/util/crc32c.o 00:02:04.898 CC lib/util/crc32_ieee.o 00:02:04.898 CC lib/util/crc64.o 00:02:04.898 CC lib/util/dif.o 00:02:04.898 CC lib/util/fd.o 00:02:04.898 CC lib/util/file.o 00:02:04.898 CC lib/util/hexlify.o 00:02:04.898 CC lib/util/iov.o 00:02:04.898 CC lib/util/math.o 00:02:04.898 CC lib/util/pipe.o 00:02:04.898 CC lib/util/strerror_tls.o 00:02:04.898 CC lib/util/string.o 00:02:04.898 CC lib/util/uuid.o 00:02:04.898 CC lib/util/fd_group.o 00:02:04.898 CC lib/util/xor.o 00:02:04.899 CC lib/util/zipf.o 00:02:04.899 CC lib/vfio_user/host/vfio_user_pci.o 00:02:04.899 CC lib/vfio_user/host/vfio_user.o 00:02:05.156 LIB libspdk_dma.a 00:02:05.157 SO libspdk_dma.so.3.0 00:02:05.157 SYMLINK libspdk_dma.so 00:02:05.157 LIB libspdk_ioat.a 00:02:05.157 SO libspdk_ioat.so.6.0 00:02:05.157 SYMLINK libspdk_ioat.so 00:02:05.157 LIB libspdk_vfio_user.a 00:02:05.415 SO libspdk_vfio_user.so.4.0 00:02:05.415 SYMLINK libspdk_vfio_user.so 00:02:05.415 LIB libspdk_util.a 00:02:05.415 SO libspdk_util.so.8.0 00:02:05.675 SYMLINK libspdk_util.so 00:02:05.675 CC lib/vmd/vmd.o 00:02:05.675 CC lib/conf/conf.o 00:02:05.675 CC lib/json/json_parse.o 00:02:05.675 CC lib/idxd/idxd.o 00:02:05.675 CC lib/vmd/led.o 00:02:05.675 CC lib/rdma/common.o 00:02:05.675 CC lib/env_dpdk/env.o 00:02:05.675 CC lib/json/json_util.o 00:02:05.675 CC lib/rdma/rdma_verbs.o 00:02:05.675 CC lib/idxd/idxd_user.o 00:02:05.675 CC lib/env_dpdk/memory.o 00:02:05.675 CC lib/json/json_write.o 00:02:05.675 CC lib/env_dpdk/pci.o 00:02:05.675 CC lib/idxd/idxd_kernel.o 00:02:05.675 CC lib/env_dpdk/init.o 00:02:05.675 CC lib/env_dpdk/threads.o 00:02:05.675 CC lib/env_dpdk/pci_ioat.o 00:02:05.675 CC lib/env_dpdk/pci_virtio.o 00:02:05.675 CC lib/env_dpdk/pci_vmd.o 00:02:05.675 CC lib/env_dpdk/pci_idxd.o 00:02:05.675 CC lib/env_dpdk/pci_event.o 00:02:05.675 CC lib/env_dpdk/sigbus_handler.o 00:02:05.675 CC lib/env_dpdk/pci_dpdk.o 00:02:05.675 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:05.675 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:05.934 LIB libspdk_trace_parser.a 00:02:05.934 SO libspdk_trace_parser.so.4.0 00:02:05.934 SYMLINK libspdk_trace_parser.so 00:02:05.934 LIB libspdk_rdma.a 00:02:06.192 LIB libspdk_conf.a 00:02:06.192 LIB libspdk_json.a 00:02:06.192 SO libspdk_rdma.so.5.0 00:02:06.192 SO libspdk_conf.so.5.0 00:02:06.192 SO libspdk_json.so.5.1 00:02:06.192 SYMLINK libspdk_rdma.so 00:02:06.192 SYMLINK libspdk_conf.so 00:02:06.192 SYMLINK libspdk_json.so 00:02:06.192 CC lib/jsonrpc/jsonrpc_server.o 00:02:06.192 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:06.192 CC lib/jsonrpc/jsonrpc_client.o 00:02:06.192 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:06.192 LIB libspdk_idxd.a 00:02:06.450 SO libspdk_idxd.so.11.0 00:02:06.450 SYMLINK libspdk_idxd.so 00:02:06.450 LIB libspdk_vmd.a 00:02:06.450 SO libspdk_vmd.so.5.0 00:02:06.450 SYMLINK libspdk_vmd.so 00:02:06.450 LIB libspdk_jsonrpc.a 00:02:06.450 SO libspdk_jsonrpc.so.5.1 00:02:06.708 SYMLINK libspdk_jsonrpc.so 00:02:06.708 CC lib/rpc/rpc.o 00:02:06.965 LIB libspdk_rpc.a 00:02:06.965 SO libspdk_rpc.so.5.0 00:02:06.965 SYMLINK libspdk_rpc.so 00:02:06.965 CC lib/trace/trace.o 00:02:06.965 CC lib/trace/trace_flags.o 00:02:06.965 CC lib/trace/trace_rpc.o 00:02:07.224 CC lib/sock/sock.o 00:02:07.224 CC lib/sock/sock_rpc.o 00:02:07.224 CC lib/notify/notify.o 00:02:07.224 CC lib/notify/notify_rpc.o 00:02:07.224 LIB libspdk_notify.a 00:02:07.224 SO libspdk_notify.so.5.0 00:02:07.224 SYMLINK libspdk_notify.so 00:02:07.224 LIB libspdk_trace.a 00:02:07.224 SO libspdk_trace.so.9.0 00:02:07.482 SYMLINK libspdk_trace.so 00:02:07.482 LIB libspdk_sock.a 00:02:07.482 SO libspdk_sock.so.8.0 00:02:07.482 CC lib/thread/thread.o 00:02:07.482 CC lib/thread/iobuf.o 00:02:07.482 SYMLINK libspdk_sock.so 00:02:07.740 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:07.740 CC lib/nvme/nvme_ctrlr.o 00:02:07.740 CC lib/nvme/nvme_fabric.o 00:02:07.740 CC lib/nvme/nvme_ns_cmd.o 00:02:07.740 CC lib/nvme/nvme_ns.o 00:02:07.740 CC lib/nvme/nvme_pcie_common.o 00:02:07.740 CC lib/nvme/nvme_pcie.o 00:02:07.740 CC lib/nvme/nvme_qpair.o 00:02:07.740 CC lib/nvme/nvme.o 00:02:07.740 CC lib/nvme/nvme_quirks.o 00:02:07.740 CC lib/nvme/nvme_transport.o 00:02:07.740 CC lib/nvme/nvme_discovery.o 00:02:07.740 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:07.740 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:07.740 CC lib/nvme/nvme_tcp.o 00:02:07.740 CC lib/nvme/nvme_opal.o 00:02:07.740 CC lib/nvme/nvme_io_msg.o 00:02:07.740 CC lib/nvme/nvme_poll_group.o 00:02:07.740 CC lib/nvme/nvme_zns.o 00:02:07.740 CC lib/nvme/nvme_cuse.o 00:02:07.740 CC lib/nvme/nvme_vfio_user.o 00:02:07.740 CC lib/nvme/nvme_rdma.o 00:02:07.740 LIB libspdk_env_dpdk.a 00:02:07.999 SO libspdk_env_dpdk.so.13.0 00:02:07.999 SYMLINK libspdk_env_dpdk.so 00:02:09.375 LIB libspdk_thread.a 00:02:09.375 SO libspdk_thread.so.9.0 00:02:09.375 SYMLINK libspdk_thread.so 00:02:09.375 CC lib/blob/blobstore.o 00:02:09.375 CC lib/accel/accel.o 00:02:09.375 CC lib/blob/request.o 00:02:09.375 CC lib/accel/accel_rpc.o 00:02:09.375 CC lib/virtio/virtio.o 00:02:09.375 CC lib/blob/zeroes.o 00:02:09.375 CC lib/accel/accel_sw.o 00:02:09.375 CC lib/init/json_config.o 00:02:09.375 CC lib/virtio/virtio_vhost_user.o 00:02:09.375 CC lib/blob/blob_bs_dev.o 00:02:09.375 CC lib/virtio/virtio_vfio_user.o 00:02:09.375 CC lib/init/subsystem.o 00:02:09.375 CC lib/virtio/virtio_pci.o 00:02:09.375 CC lib/init/subsystem_rpc.o 00:02:09.375 CC lib/init/rpc.o 00:02:09.633 LIB libspdk_init.a 00:02:09.633 SO libspdk_init.so.4.0 00:02:09.633 SYMLINK libspdk_init.so 00:02:09.633 LIB libspdk_virtio.a 00:02:09.633 SO libspdk_virtio.so.6.0 00:02:09.891 SYMLINK libspdk_virtio.so 00:02:09.891 CC lib/event/app.o 00:02:09.891 CC lib/event/reactor.o 00:02:09.891 CC lib/event/log_rpc.o 00:02:09.891 CC lib/event/app_rpc.o 00:02:09.891 CC lib/event/scheduler_static.o 00:02:09.891 LIB libspdk_nvme.a 00:02:10.150 SO libspdk_nvme.so.12.0 00:02:10.150 LIB libspdk_event.a 00:02:10.150 SO libspdk_event.so.12.0 00:02:10.150 SYMLINK libspdk_nvme.so 00:02:10.408 SYMLINK libspdk_event.so 00:02:10.408 LIB libspdk_accel.a 00:02:10.408 SO libspdk_accel.so.14.0 00:02:10.408 SYMLINK libspdk_accel.so 00:02:10.666 CC lib/bdev/bdev.o 00:02:10.666 CC lib/bdev/bdev_rpc.o 00:02:10.666 CC lib/bdev/bdev_zone.o 00:02:10.666 CC lib/bdev/part.o 00:02:10.666 CC lib/bdev/scsi_nvme.o 00:02:12.043 LIB libspdk_blob.a 00:02:12.043 SO libspdk_blob.so.10.1 00:02:12.301 SYMLINK libspdk_blob.so 00:02:12.301 CC lib/lvol/lvol.o 00:02:12.301 CC lib/blobfs/blobfs.o 00:02:12.301 CC lib/blobfs/tree.o 00:02:13.235 LIB libspdk_blobfs.a 00:02:13.236 LIB libspdk_lvol.a 00:02:13.236 SO libspdk_blobfs.so.9.0 00:02:13.236 LIB libspdk_bdev.a 00:02:13.236 SO libspdk_lvol.so.9.1 00:02:13.236 SO libspdk_bdev.so.14.0 00:02:13.236 SYMLINK libspdk_blobfs.so 00:02:13.236 SYMLINK libspdk_lvol.so 00:02:13.236 SYMLINK libspdk_bdev.so 00:02:13.236 CC lib/scsi/dev.o 00:02:13.236 CC lib/nvmf/ctrlr.o 00:02:13.236 CC lib/scsi/lun.o 00:02:13.236 CC lib/nbd/nbd.o 00:02:13.236 CC lib/ublk/ublk.o 00:02:13.236 CC lib/scsi/port.o 00:02:13.236 CC lib/nvmf/ctrlr_discovery.o 00:02:13.236 CC lib/nbd/nbd_rpc.o 00:02:13.236 CC lib/ftl/ftl_core.o 00:02:13.236 CC lib/ublk/ublk_rpc.o 00:02:13.236 CC lib/nvmf/ctrlr_bdev.o 00:02:13.236 CC lib/scsi/scsi.o 00:02:13.236 CC lib/ftl/ftl_init.o 00:02:13.503 CC lib/scsi/scsi_bdev.o 00:02:13.503 CC lib/nvmf/subsystem.o 00:02:13.503 CC lib/ftl/ftl_layout.o 00:02:13.503 CC lib/scsi/scsi_pr.o 00:02:13.503 CC lib/nvmf/nvmf.o 00:02:13.503 CC lib/ftl/ftl_debug.o 00:02:13.503 CC lib/scsi/scsi_rpc.o 00:02:13.503 CC lib/ftl/ftl_io.o 00:02:13.503 CC lib/nvmf/transport.o 00:02:13.503 CC lib/nvmf/nvmf_rpc.o 00:02:13.503 CC lib/ftl/ftl_sb.o 00:02:13.503 CC lib/scsi/task.o 00:02:13.503 CC lib/nvmf/tcp.o 00:02:13.503 CC lib/ftl/ftl_l2p.o 00:02:13.503 CC lib/nvmf/rdma.o 00:02:13.503 CC lib/ftl/ftl_l2p_flat.o 00:02:13.503 CC lib/ftl/ftl_band.o 00:02:13.503 CC lib/ftl/ftl_nv_cache.o 00:02:13.503 CC lib/ftl/ftl_band_ops.o 00:02:13.503 CC lib/ftl/ftl_writer.o 00:02:13.503 CC lib/ftl/ftl_reloc.o 00:02:13.503 CC lib/ftl/ftl_rq.o 00:02:13.503 CC lib/ftl/ftl_l2p_cache.o 00:02:13.503 CC lib/ftl/ftl_p2l.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:13.503 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:13.765 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:13.766 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:13.766 CC lib/ftl/utils/ftl_conf.o 00:02:13.766 CC lib/ftl/utils/ftl_md.o 00:02:13.766 CC lib/ftl/utils/ftl_mempool.o 00:02:13.766 CC lib/ftl/utils/ftl_bitmap.o 00:02:13.766 CC lib/ftl/utils/ftl_property.o 00:02:13.766 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:13.766 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:13.766 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:13.766 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:13.766 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:13.766 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:13.766 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:13.766 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:13.766 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:13.766 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:13.766 CC lib/ftl/base/ftl_base_dev.o 00:02:13.766 CC lib/ftl/base/ftl_base_bdev.o 00:02:13.766 CC lib/ftl/ftl_trace.o 00:02:14.024 LIB libspdk_nbd.a 00:02:14.024 SO libspdk_nbd.so.6.0 00:02:14.291 LIB libspdk_scsi.a 00:02:14.291 SYMLINK libspdk_nbd.so 00:02:14.291 SO libspdk_scsi.so.8.0 00:02:14.291 LIB libspdk_ublk.a 00:02:14.291 SYMLINK libspdk_scsi.so 00:02:14.291 SO libspdk_ublk.so.2.0 00:02:14.291 SYMLINK libspdk_ublk.so 00:02:14.291 CC lib/vhost/vhost.o 00:02:14.291 CC lib/vhost/vhost_rpc.o 00:02:14.291 CC lib/iscsi/conn.o 00:02:14.291 CC lib/iscsi/init_grp.o 00:02:14.291 CC lib/vhost/vhost_scsi.o 00:02:14.291 CC lib/iscsi/iscsi.o 00:02:14.291 CC lib/vhost/vhost_blk.o 00:02:14.291 CC lib/iscsi/md5.o 00:02:14.291 CC lib/vhost/rte_vhost_user.o 00:02:14.291 CC lib/iscsi/param.o 00:02:14.291 CC lib/iscsi/portal_grp.o 00:02:14.291 CC lib/iscsi/tgt_node.o 00:02:14.291 CC lib/iscsi/iscsi_subsystem.o 00:02:14.291 CC lib/iscsi/iscsi_rpc.o 00:02:14.291 CC lib/iscsi/task.o 00:02:14.866 LIB libspdk_ftl.a 00:02:14.866 SO libspdk_ftl.so.8.0 00:02:15.123 SYMLINK libspdk_ftl.so 00:02:15.690 LIB libspdk_vhost.a 00:02:15.690 SO libspdk_vhost.so.7.1 00:02:15.690 SYMLINK libspdk_vhost.so 00:02:15.690 LIB libspdk_nvmf.a 00:02:15.948 SO libspdk_nvmf.so.17.0 00:02:15.948 LIB libspdk_iscsi.a 00:02:15.948 SO libspdk_iscsi.so.7.0 00:02:15.948 SYMLINK libspdk_nvmf.so 00:02:15.948 SYMLINK libspdk_iscsi.so 00:02:16.206 CC module/env_dpdk/env_dpdk_rpc.o 00:02:16.206 CC module/sock/posix/posix.o 00:02:16.206 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:16.206 CC module/accel/ioat/accel_ioat.o 00:02:16.206 CC module/accel/iaa/accel_iaa.o 00:02:16.206 CC module/blob/bdev/blob_bdev.o 00:02:16.206 CC module/accel/iaa/accel_iaa_rpc.o 00:02:16.206 CC module/accel/dsa/accel_dsa.o 00:02:16.206 CC module/accel/ioat/accel_ioat_rpc.o 00:02:16.206 CC module/accel/dsa/accel_dsa_rpc.o 00:02:16.206 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:16.206 CC module/scheduler/gscheduler/gscheduler.o 00:02:16.206 CC module/accel/error/accel_error.o 00:02:16.206 CC module/accel/error/accel_error_rpc.o 00:02:16.465 LIB libspdk_env_dpdk_rpc.a 00:02:16.465 SO libspdk_env_dpdk_rpc.so.5.0 00:02:16.465 LIB libspdk_scheduler_gscheduler.a 00:02:16.465 SYMLINK libspdk_env_dpdk_rpc.so 00:02:16.465 LIB libspdk_scheduler_dpdk_governor.a 00:02:16.465 SO libspdk_scheduler_gscheduler.so.3.0 00:02:16.465 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:16.465 LIB libspdk_accel_error.a 00:02:16.465 LIB libspdk_accel_ioat.a 00:02:16.465 LIB libspdk_scheduler_dynamic.a 00:02:16.465 LIB libspdk_accel_iaa.a 00:02:16.465 SO libspdk_accel_error.so.1.0 00:02:16.465 SO libspdk_accel_ioat.so.5.0 00:02:16.465 SYMLINK libspdk_scheduler_gscheduler.so 00:02:16.465 SO libspdk_scheduler_dynamic.so.3.0 00:02:16.465 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:16.465 SO libspdk_accel_iaa.so.2.0 00:02:16.465 LIB libspdk_accel_dsa.a 00:02:16.465 SYMLINK libspdk_accel_error.so 00:02:16.465 SYMLINK libspdk_scheduler_dynamic.so 00:02:16.465 SYMLINK libspdk_accel_ioat.so 00:02:16.465 SO libspdk_accel_dsa.so.4.0 00:02:16.465 LIB libspdk_blob_bdev.a 00:02:16.465 SYMLINK libspdk_accel_iaa.so 00:02:16.725 SO libspdk_blob_bdev.so.10.1 00:02:16.725 SYMLINK libspdk_accel_dsa.so 00:02:16.725 SYMLINK libspdk_blob_bdev.so 00:02:16.725 CC module/bdev/delay/vbdev_delay.o 00:02:16.725 CC module/blobfs/bdev/blobfs_bdev.o 00:02:16.725 CC module/bdev/error/vbdev_error.o 00:02:16.725 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:16.725 CC module/bdev/malloc/bdev_malloc.o 00:02:16.725 CC module/bdev/error/vbdev_error_rpc.o 00:02:16.725 CC module/bdev/ftl/bdev_ftl.o 00:02:16.725 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:16.725 CC module/bdev/iscsi/bdev_iscsi.o 00:02:16.725 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:16.725 CC module/bdev/gpt/gpt.o 00:02:16.725 CC module/bdev/aio/bdev_aio.o 00:02:16.725 CC module/bdev/passthru/vbdev_passthru.o 00:02:16.725 CC module/bdev/split/vbdev_split.o 00:02:16.725 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:16.725 CC module/bdev/gpt/vbdev_gpt.o 00:02:16.725 CC module/bdev/aio/bdev_aio_rpc.o 00:02:16.725 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:16.725 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:16.725 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:16.725 CC module/bdev/split/vbdev_split_rpc.o 00:02:16.725 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:16.725 CC module/bdev/nvme/bdev_nvme.o 00:02:16.725 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:16.725 CC module/bdev/lvol/vbdev_lvol.o 00:02:16.725 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:16.725 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:16.725 CC module/bdev/nvme/nvme_rpc.o 00:02:16.725 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:16.725 CC module/bdev/null/bdev_null.o 00:02:16.725 CC module/bdev/nvme/bdev_mdns_client.o 00:02:16.725 CC module/bdev/null/bdev_null_rpc.o 00:02:16.725 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:16.725 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:16.725 CC module/bdev/nvme/vbdev_opal.o 00:02:16.725 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:16.725 CC module/bdev/raid/bdev_raid.o 00:02:16.725 CC module/bdev/raid/bdev_raid_rpc.o 00:02:16.725 CC module/bdev/raid/bdev_raid_sb.o 00:02:16.725 CC module/bdev/raid/raid0.o 00:02:16.725 CC module/bdev/raid/raid1.o 00:02:16.725 CC module/bdev/raid/concat.o 00:02:17.292 LIB libspdk_blobfs_bdev.a 00:02:17.292 LIB libspdk_bdev_aio.a 00:02:17.292 SO libspdk_blobfs_bdev.so.5.0 00:02:17.292 LIB libspdk_sock_posix.a 00:02:17.292 LIB libspdk_bdev_split.a 00:02:17.292 SO libspdk_bdev_aio.so.5.0 00:02:17.292 SO libspdk_sock_posix.so.5.0 00:02:17.292 SO libspdk_bdev_split.so.5.0 00:02:17.292 LIB libspdk_bdev_passthru.a 00:02:17.292 SYMLINK libspdk_blobfs_bdev.so 00:02:17.292 LIB libspdk_bdev_null.a 00:02:17.292 LIB libspdk_bdev_zone_block.a 00:02:17.292 SYMLINK libspdk_bdev_aio.so 00:02:17.292 SO libspdk_bdev_passthru.so.5.0 00:02:17.292 LIB libspdk_bdev_error.a 00:02:17.292 LIB libspdk_bdev_ftl.a 00:02:17.292 SO libspdk_bdev_null.so.5.0 00:02:17.292 SYMLINK libspdk_bdev_split.so 00:02:17.292 SO libspdk_bdev_zone_block.so.5.0 00:02:17.292 SYMLINK libspdk_sock_posix.so 00:02:17.292 SO libspdk_bdev_error.so.5.0 00:02:17.292 SO libspdk_bdev_ftl.so.5.0 00:02:17.292 LIB libspdk_bdev_gpt.a 00:02:17.292 SYMLINK libspdk_bdev_passthru.so 00:02:17.292 SO libspdk_bdev_gpt.so.5.0 00:02:17.292 SYMLINK libspdk_bdev_zone_block.so 00:02:17.292 SYMLINK libspdk_bdev_null.so 00:02:17.292 SYMLINK libspdk_bdev_error.so 00:02:17.292 SYMLINK libspdk_bdev_ftl.so 00:02:17.292 LIB libspdk_bdev_malloc.a 00:02:17.292 SYMLINK libspdk_bdev_gpt.so 00:02:17.292 LIB libspdk_bdev_iscsi.a 00:02:17.292 SO libspdk_bdev_malloc.so.5.0 00:02:17.550 LIB libspdk_bdev_delay.a 00:02:17.550 SO libspdk_bdev_iscsi.so.5.0 00:02:17.550 SO libspdk_bdev_delay.so.5.0 00:02:17.550 SYMLINK libspdk_bdev_malloc.so 00:02:17.550 SYMLINK libspdk_bdev_iscsi.so 00:02:17.550 SYMLINK libspdk_bdev_delay.so 00:02:17.550 LIB libspdk_bdev_virtio.a 00:02:17.550 LIB libspdk_bdev_lvol.a 00:02:17.550 SO libspdk_bdev_lvol.so.5.0 00:02:17.550 SO libspdk_bdev_virtio.so.5.0 00:02:17.550 SYMLINK libspdk_bdev_lvol.so 00:02:17.550 SYMLINK libspdk_bdev_virtio.so 00:02:17.808 LIB libspdk_bdev_raid.a 00:02:17.808 SO libspdk_bdev_raid.so.5.0 00:02:18.066 SYMLINK libspdk_bdev_raid.so 00:02:19.000 LIB libspdk_bdev_nvme.a 00:02:19.000 SO libspdk_bdev_nvme.so.6.0 00:02:19.258 SYMLINK libspdk_bdev_nvme.so 00:02:19.517 CC module/event/subsystems/iobuf/iobuf.o 00:02:19.517 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:19.517 CC module/event/subsystems/scheduler/scheduler.o 00:02:19.517 CC module/event/subsystems/vmd/vmd.o 00:02:19.517 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:19.517 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:19.517 CC module/event/subsystems/sock/sock.o 00:02:19.517 LIB libspdk_event_vhost_blk.a 00:02:19.517 LIB libspdk_event_sock.a 00:02:19.517 LIB libspdk_event_scheduler.a 00:02:19.517 LIB libspdk_event_vmd.a 00:02:19.517 SO libspdk_event_sock.so.4.0 00:02:19.517 SO libspdk_event_vhost_blk.so.2.0 00:02:19.517 SO libspdk_event_scheduler.so.3.0 00:02:19.517 LIB libspdk_event_iobuf.a 00:02:19.517 SO libspdk_event_vmd.so.5.0 00:02:19.517 SO libspdk_event_iobuf.so.2.0 00:02:19.517 SYMLINK libspdk_event_vhost_blk.so 00:02:19.517 SYMLINK libspdk_event_scheduler.so 00:02:19.517 SYMLINK libspdk_event_sock.so 00:02:19.776 SYMLINK libspdk_event_vmd.so 00:02:19.776 SYMLINK libspdk_event_iobuf.so 00:02:19.776 CC module/event/subsystems/accel/accel.o 00:02:20.035 LIB libspdk_event_accel.a 00:02:20.035 SO libspdk_event_accel.so.5.0 00:02:20.035 SYMLINK libspdk_event_accel.so 00:02:20.035 CC module/event/subsystems/bdev/bdev.o 00:02:20.294 LIB libspdk_event_bdev.a 00:02:20.294 SO libspdk_event_bdev.so.5.0 00:02:20.294 SYMLINK libspdk_event_bdev.so 00:02:20.553 CC module/event/subsystems/nbd/nbd.o 00:02:20.553 CC module/event/subsystems/ublk/ublk.o 00:02:20.553 CC module/event/subsystems/scsi/scsi.o 00:02:20.553 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:20.553 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:20.553 LIB libspdk_event_nbd.a 00:02:20.553 LIB libspdk_event_ublk.a 00:02:20.553 LIB libspdk_event_scsi.a 00:02:20.553 SO libspdk_event_ublk.so.2.0 00:02:20.553 SO libspdk_event_nbd.so.5.0 00:02:20.553 SO libspdk_event_scsi.so.5.0 00:02:20.553 SYMLINK libspdk_event_nbd.so 00:02:20.553 SYMLINK libspdk_event_ublk.so 00:02:20.813 SYMLINK libspdk_event_scsi.so 00:02:20.813 LIB libspdk_event_nvmf.a 00:02:20.813 SO libspdk_event_nvmf.so.5.0 00:02:20.813 SYMLINK libspdk_event_nvmf.so 00:02:20.813 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:20.813 CC module/event/subsystems/iscsi/iscsi.o 00:02:20.813 LIB libspdk_event_vhost_scsi.a 00:02:21.071 SO libspdk_event_vhost_scsi.so.2.0 00:02:21.071 LIB libspdk_event_iscsi.a 00:02:21.071 SO libspdk_event_iscsi.so.5.0 00:02:21.071 SYMLINK libspdk_event_vhost_scsi.so 00:02:21.071 SYMLINK libspdk_event_iscsi.so 00:02:21.071 SO libspdk.so.5.0 00:02:21.071 SYMLINK libspdk.so 00:02:21.337 CC app/spdk_nvme_identify/identify.o 00:02:21.337 CC app/trace_record/trace_record.o 00:02:21.337 CC app/spdk_nvme_discover/discovery_aer.o 00:02:21.337 CXX app/trace/trace.o 00:02:21.337 CC app/spdk_lspci/spdk_lspci.o 00:02:21.337 CC test/rpc_client/rpc_client_test.o 00:02:21.337 CC app/spdk_nvme_perf/perf.o 00:02:21.337 TEST_HEADER include/spdk/accel.h 00:02:21.337 CC app/spdk_top/spdk_top.o 00:02:21.337 TEST_HEADER include/spdk/accel_module.h 00:02:21.337 TEST_HEADER include/spdk/assert.h 00:02:21.337 TEST_HEADER include/spdk/barrier.h 00:02:21.337 TEST_HEADER include/spdk/base64.h 00:02:21.337 TEST_HEADER include/spdk/bdev.h 00:02:21.337 TEST_HEADER include/spdk/bdev_module.h 00:02:21.337 TEST_HEADER include/spdk/bdev_zone.h 00:02:21.337 TEST_HEADER include/spdk/bit_array.h 00:02:21.337 TEST_HEADER include/spdk/bit_pool.h 00:02:21.337 TEST_HEADER include/spdk/blob_bdev.h 00:02:21.337 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:21.337 TEST_HEADER include/spdk/blobfs.h 00:02:21.337 TEST_HEADER include/spdk/blob.h 00:02:21.337 TEST_HEADER include/spdk/conf.h 00:02:21.337 TEST_HEADER include/spdk/config.h 00:02:21.337 TEST_HEADER include/spdk/cpuset.h 00:02:21.337 TEST_HEADER include/spdk/crc16.h 00:02:21.337 TEST_HEADER include/spdk/crc32.h 00:02:21.337 TEST_HEADER include/spdk/crc64.h 00:02:21.337 TEST_HEADER include/spdk/dif.h 00:02:21.337 TEST_HEADER include/spdk/dma.h 00:02:21.337 CC app/spdk_dd/spdk_dd.o 00:02:21.337 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:21.337 TEST_HEADER include/spdk/endian.h 00:02:21.337 CC app/iscsi_tgt/iscsi_tgt.o 00:02:21.337 CC app/nvmf_tgt/nvmf_main.o 00:02:21.337 TEST_HEADER include/spdk/env_dpdk.h 00:02:21.337 TEST_HEADER include/spdk/env.h 00:02:21.337 TEST_HEADER include/spdk/event.h 00:02:21.337 CC examples/vmd/lsvmd/lsvmd.o 00:02:21.337 TEST_HEADER include/spdk/fd_group.h 00:02:21.337 CC test/env/vtophys/vtophys.o 00:02:21.337 CC examples/vmd/led/led.o 00:02:21.337 CC test/env/pci/pci_ut.o 00:02:21.337 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:21.337 TEST_HEADER include/spdk/fd.h 00:02:21.337 CC examples/sock/hello_world/hello_sock.o 00:02:21.337 CC test/env/memory/memory_ut.o 00:02:21.337 CC examples/nvme/hello_world/hello_world.o 00:02:21.337 CC app/vhost/vhost.o 00:02:21.337 CC examples/ioat/perf/perf.o 00:02:21.337 CC app/fio/nvme/fio_plugin.o 00:02:21.337 CC test/app/jsoncat/jsoncat.o 00:02:21.337 TEST_HEADER include/spdk/file.h 00:02:21.337 TEST_HEADER include/spdk/ftl.h 00:02:21.337 CC examples/accel/perf/accel_perf.o 00:02:21.337 CC test/app/histogram_perf/histogram_perf.o 00:02:21.337 CC test/app/stub/stub.o 00:02:21.337 CC examples/idxd/perf/perf.o 00:02:21.337 TEST_HEADER include/spdk/gpt_spec.h 00:02:21.337 TEST_HEADER include/spdk/hexlify.h 00:02:21.337 CC test/event/event_perf/event_perf.o 00:02:21.337 TEST_HEADER include/spdk/histogram_data.h 00:02:21.337 CC examples/util/zipf/zipf.o 00:02:21.337 CC test/nvme/aer/aer.o 00:02:21.337 TEST_HEADER include/spdk/idxd.h 00:02:21.337 CC test/thread/poller_perf/poller_perf.o 00:02:21.337 TEST_HEADER include/spdk/idxd_spec.h 00:02:21.337 CC app/spdk_tgt/spdk_tgt.o 00:02:21.337 TEST_HEADER include/spdk/init.h 00:02:21.337 TEST_HEADER include/spdk/ioat.h 00:02:21.337 TEST_HEADER include/spdk/ioat_spec.h 00:02:21.337 TEST_HEADER include/spdk/iscsi_spec.h 00:02:21.337 TEST_HEADER include/spdk/json.h 00:02:21.337 TEST_HEADER include/spdk/jsonrpc.h 00:02:21.337 TEST_HEADER include/spdk/likely.h 00:02:21.337 CC examples/blob/cli/blobcli.o 00:02:21.337 TEST_HEADER include/spdk/log.h 00:02:21.337 CC examples/thread/thread/thread_ex.o 00:02:21.337 TEST_HEADER include/spdk/lvol.h 00:02:21.337 CC test/accel/dif/dif.o 00:02:21.337 CC test/blobfs/mkfs/mkfs.o 00:02:21.337 TEST_HEADER include/spdk/memory.h 00:02:21.337 CC examples/bdev/hello_world/hello_bdev.o 00:02:21.337 CC test/app/bdev_svc/bdev_svc.o 00:02:21.337 CC examples/nvmf/nvmf/nvmf.o 00:02:21.337 CC examples/bdev/bdevperf/bdevperf.o 00:02:21.337 TEST_HEADER include/spdk/mmio.h 00:02:21.337 TEST_HEADER include/spdk/nbd.h 00:02:21.337 CC examples/blob/hello_world/hello_blob.o 00:02:21.337 CC test/bdev/bdevio/bdevio.o 00:02:21.337 TEST_HEADER include/spdk/notify.h 00:02:21.337 CC test/dma/test_dma/test_dma.o 00:02:21.338 TEST_HEADER include/spdk/nvme.h 00:02:21.338 TEST_HEADER include/spdk/nvme_intel.h 00:02:21.338 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:21.338 CC test/env/mem_callbacks/mem_callbacks.o 00:02:21.338 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:21.338 TEST_HEADER include/spdk/nvme_spec.h 00:02:21.338 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:21.338 TEST_HEADER include/spdk/nvme_zns.h 00:02:21.338 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:21.338 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:21.338 TEST_HEADER include/spdk/nvmf.h 00:02:21.338 TEST_HEADER include/spdk/nvmf_spec.h 00:02:21.338 TEST_HEADER include/spdk/nvmf_transport.h 00:02:21.626 TEST_HEADER include/spdk/opal.h 00:02:21.626 TEST_HEADER include/spdk/opal_spec.h 00:02:21.626 CC test/lvol/esnap/esnap.o 00:02:21.626 TEST_HEADER include/spdk/pci_ids.h 00:02:21.626 TEST_HEADER include/spdk/pipe.h 00:02:21.626 TEST_HEADER include/spdk/queue.h 00:02:21.626 TEST_HEADER include/spdk/reduce.h 00:02:21.626 TEST_HEADER include/spdk/rpc.h 00:02:21.626 TEST_HEADER include/spdk/scheduler.h 00:02:21.626 TEST_HEADER include/spdk/scsi.h 00:02:21.626 TEST_HEADER include/spdk/scsi_spec.h 00:02:21.626 TEST_HEADER include/spdk/sock.h 00:02:21.626 TEST_HEADER include/spdk/stdinc.h 00:02:21.626 LINK spdk_lspci 00:02:21.626 TEST_HEADER include/spdk/string.h 00:02:21.626 TEST_HEADER include/spdk/thread.h 00:02:21.626 TEST_HEADER include/spdk/trace.h 00:02:21.626 TEST_HEADER include/spdk/trace_parser.h 00:02:21.626 TEST_HEADER include/spdk/tree.h 00:02:21.626 TEST_HEADER include/spdk/ublk.h 00:02:21.626 TEST_HEADER include/spdk/util.h 00:02:21.626 TEST_HEADER include/spdk/uuid.h 00:02:21.626 TEST_HEADER include/spdk/version.h 00:02:21.626 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:21.626 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:21.626 TEST_HEADER include/spdk/vhost.h 00:02:21.626 TEST_HEADER include/spdk/vmd.h 00:02:21.626 TEST_HEADER include/spdk/xor.h 00:02:21.626 TEST_HEADER include/spdk/zipf.h 00:02:21.626 CXX test/cpp_headers/accel.o 00:02:21.626 LINK lsvmd 00:02:21.626 LINK rpc_client_test 00:02:21.626 LINK jsoncat 00:02:21.626 LINK spdk_nvme_discover 00:02:21.626 LINK led 00:02:21.626 LINK vtophys 00:02:21.626 LINK histogram_perf 00:02:21.626 LINK event_perf 00:02:21.626 LINK env_dpdk_post_init 00:02:21.626 LINK poller_perf 00:02:21.626 LINK zipf 00:02:21.626 LINK nvmf_tgt 00:02:21.626 LINK interrupt_tgt 00:02:21.626 LINK vhost 00:02:21.626 LINK spdk_trace_record 00:02:21.626 LINK stub 00:02:21.892 LINK iscsi_tgt 00:02:21.892 LINK bdev_svc 00:02:21.892 LINK ioat_perf 00:02:21.892 LINK hello_world 00:02:21.892 LINK spdk_tgt 00:02:21.892 LINK mkfs 00:02:21.892 LINK hello_sock 00:02:21.892 LINK hello_bdev 00:02:21.892 LINK thread 00:02:21.892 LINK hello_blob 00:02:21.892 LINK aer 00:02:21.892 CXX test/cpp_headers/accel_module.o 00:02:21.892 CXX test/cpp_headers/assert.o 00:02:21.892 CC app/fio/bdev/fio_plugin.o 00:02:21.892 LINK nvmf 00:02:21.892 LINK idxd_perf 00:02:21.892 LINK spdk_dd 00:02:22.156 CC examples/nvme/reconnect/reconnect.o 00:02:22.156 CC test/event/reactor/reactor.o 00:02:22.156 CXX test/cpp_headers/barrier.o 00:02:22.156 CC test/nvme/reset/reset.o 00:02:22.156 CC examples/ioat/verify/verify.o 00:02:22.156 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:22.156 CC test/nvme/sgl/sgl.o 00:02:22.156 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:22.156 LINK spdk_trace 00:02:22.156 CC examples/nvme/arbitration/arbitration.o 00:02:22.156 LINK pci_ut 00:02:22.156 CXX test/cpp_headers/base64.o 00:02:22.156 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:22.156 CC test/event/reactor_perf/reactor_perf.o 00:02:22.156 LINK dif 00:02:22.156 CXX test/cpp_headers/bdev.o 00:02:22.156 CC examples/nvme/hotplug/hotplug.o 00:02:22.156 LINK bdevio 00:02:22.156 LINK test_dma 00:02:22.156 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:22.156 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:22.156 CC examples/nvme/abort/abort.o 00:02:22.156 LINK accel_perf 00:02:22.156 CC test/event/app_repeat/app_repeat.o 00:02:22.156 CC test/nvme/e2edp/nvme_dp.o 00:02:22.156 CXX test/cpp_headers/bdev_module.o 00:02:22.156 CXX test/cpp_headers/bdev_zone.o 00:02:22.156 LINK nvme_fuzz 00:02:22.418 CXX test/cpp_headers/bit_array.o 00:02:22.418 CC test/event/scheduler/scheduler.o 00:02:22.418 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:22.418 CXX test/cpp_headers/bit_pool.o 00:02:22.418 CC test/nvme/overhead/overhead.o 00:02:22.418 LINK reactor 00:02:22.418 LINK blobcli 00:02:22.418 LINK reactor_perf 00:02:22.418 CC test/nvme/err_injection/err_injection.o 00:02:22.418 CXX test/cpp_headers/blob_bdev.o 00:02:22.418 LINK spdk_nvme 00:02:22.418 CC test/nvme/startup/startup.o 00:02:22.418 CC test/nvme/reserve/reserve.o 00:02:22.418 CC test/nvme/simple_copy/simple_copy.o 00:02:22.418 CC test/nvme/connect_stress/connect_stress.o 00:02:22.418 CXX test/cpp_headers/blobfs_bdev.o 00:02:22.418 CC test/nvme/boot_partition/boot_partition.o 00:02:22.418 LINK verify 00:02:22.418 LINK cmb_copy 00:02:22.418 CC test/nvme/compliance/nvme_compliance.o 00:02:22.418 CXX test/cpp_headers/blobfs.o 00:02:22.418 LINK app_repeat 00:02:22.718 LINK reset 00:02:22.718 CXX test/cpp_headers/blob.o 00:02:22.718 CC test/nvme/fused_ordering/fused_ordering.o 00:02:22.718 CXX test/cpp_headers/conf.o 00:02:22.718 CXX test/cpp_headers/config.o 00:02:22.718 LINK hotplug 00:02:22.718 LINK sgl 00:02:22.718 CXX test/cpp_headers/cpuset.o 00:02:22.718 CXX test/cpp_headers/crc16.o 00:02:22.718 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:22.718 CXX test/cpp_headers/crc32.o 00:02:22.718 CC test/nvme/cuse/cuse.o 00:02:22.718 CC test/nvme/fdp/fdp.o 00:02:22.718 CXX test/cpp_headers/crc64.o 00:02:22.718 LINK mem_callbacks 00:02:22.718 CXX test/cpp_headers/dif.o 00:02:22.718 LINK pmr_persistence 00:02:22.718 LINK reconnect 00:02:22.718 CXX test/cpp_headers/dma.o 00:02:22.718 CXX test/cpp_headers/endian.o 00:02:22.718 CXX test/cpp_headers/env_dpdk.o 00:02:22.718 LINK scheduler 00:02:22.718 LINK arbitration 00:02:22.718 LINK err_injection 00:02:22.718 LINK startup 00:02:22.718 CXX test/cpp_headers/env.o 00:02:22.718 LINK nvme_dp 00:02:22.718 LINK spdk_nvme_perf 00:02:22.718 CXX test/cpp_headers/event.o 00:02:22.718 LINK boot_partition 00:02:22.997 CXX test/cpp_headers/fd_group.o 00:02:22.997 LINK reserve 00:02:22.997 LINK spdk_nvme_identify 00:02:22.997 LINK bdevperf 00:02:22.997 LINK connect_stress 00:02:22.997 LINK overhead 00:02:22.997 CXX test/cpp_headers/fd.o 00:02:22.997 LINK abort 00:02:22.997 CXX test/cpp_headers/file.o 00:02:22.997 CXX test/cpp_headers/ftl.o 00:02:22.997 CXX test/cpp_headers/gpt_spec.o 00:02:22.997 CXX test/cpp_headers/hexlify.o 00:02:22.997 CXX test/cpp_headers/histogram_data.o 00:02:22.997 CXX test/cpp_headers/idxd.o 00:02:22.997 CXX test/cpp_headers/idxd_spec.o 00:02:22.997 LINK simple_copy 00:02:22.997 CXX test/cpp_headers/init.o 00:02:22.997 LINK spdk_top 00:02:22.997 LINK spdk_bdev 00:02:22.997 LINK vhost_fuzz 00:02:22.997 CXX test/cpp_headers/ioat.o 00:02:22.997 LINK fused_ordering 00:02:22.997 CXX test/cpp_headers/iscsi_spec.o 00:02:22.997 CXX test/cpp_headers/ioat_spec.o 00:02:22.997 CXX test/cpp_headers/json.o 00:02:22.997 LINK doorbell_aers 00:02:22.997 CXX test/cpp_headers/jsonrpc.o 00:02:22.997 CXX test/cpp_headers/likely.o 00:02:22.997 LINK nvme_manage 00:02:22.997 CXX test/cpp_headers/log.o 00:02:22.997 CXX test/cpp_headers/lvol.o 00:02:22.997 CXX test/cpp_headers/memory.o 00:02:22.997 CXX test/cpp_headers/mmio.o 00:02:22.997 CXX test/cpp_headers/nbd.o 00:02:22.997 CXX test/cpp_headers/notify.o 00:02:22.997 CXX test/cpp_headers/nvme.o 00:02:22.997 LINK memory_ut 00:02:22.997 CXX test/cpp_headers/nvme_intel.o 00:02:22.997 CXX test/cpp_headers/nvme_ocssd.o 00:02:22.997 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:23.258 CXX test/cpp_headers/nvme_spec.o 00:02:23.258 CXX test/cpp_headers/nvme_zns.o 00:02:23.258 CXX test/cpp_headers/nvmf_cmd.o 00:02:23.258 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:23.258 LINK nvme_compliance 00:02:23.258 CXX test/cpp_headers/nvmf.o 00:02:23.258 CXX test/cpp_headers/nvmf_spec.o 00:02:23.258 CXX test/cpp_headers/nvmf_transport.o 00:02:23.258 CXX test/cpp_headers/opal.o 00:02:23.258 CXX test/cpp_headers/opal_spec.o 00:02:23.258 CXX test/cpp_headers/pci_ids.o 00:02:23.258 CXX test/cpp_headers/pipe.o 00:02:23.258 CXX test/cpp_headers/queue.o 00:02:23.258 CXX test/cpp_headers/reduce.o 00:02:23.258 CXX test/cpp_headers/rpc.o 00:02:23.258 CXX test/cpp_headers/scheduler.o 00:02:23.258 CXX test/cpp_headers/scsi.o 00:02:23.258 LINK fdp 00:02:23.258 CXX test/cpp_headers/scsi_spec.o 00:02:23.258 CXX test/cpp_headers/sock.o 00:02:23.258 CXX test/cpp_headers/stdinc.o 00:02:23.258 CXX test/cpp_headers/string.o 00:02:23.258 CXX test/cpp_headers/thread.o 00:02:23.258 CXX test/cpp_headers/trace.o 00:02:23.258 CXX test/cpp_headers/trace_parser.o 00:02:23.258 CXX test/cpp_headers/tree.o 00:02:23.258 CXX test/cpp_headers/ublk.o 00:02:23.258 CXX test/cpp_headers/util.o 00:02:23.258 CXX test/cpp_headers/uuid.o 00:02:23.258 CXX test/cpp_headers/version.o 00:02:23.258 CXX test/cpp_headers/vfio_user_pci.o 00:02:23.258 CXX test/cpp_headers/vfio_user_spec.o 00:02:23.258 CXX test/cpp_headers/vhost.o 00:02:23.258 CXX test/cpp_headers/vmd.o 00:02:23.258 CXX test/cpp_headers/xor.o 00:02:23.258 CXX test/cpp_headers/zipf.o 00:02:24.193 LINK cuse 00:02:24.451 LINK iscsi_fuzz 00:02:26.984 LINK esnap 00:02:27.242 00:02:27.242 real 0m46.460s 00:02:27.242 user 9m40.137s 00:02:27.242 sys 2m9.613s 00:02:27.242 20:03:32 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:27.242 20:03:32 -- common/autotest_common.sh@10 -- $ set +x 00:02:27.242 ************************************ 00:02:27.242 END TEST make 00:02:27.242 ************************************ 00:02:27.242 20:03:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:27.242 20:03:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:27.242 20:03:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:27.242 20:03:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:27.242 20:03:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:27.242 20:03:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:27.242 20:03:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:27.242 20:03:32 -- scripts/common.sh@335 -- # IFS=.-: 00:02:27.242 20:03:32 -- scripts/common.sh@335 -- # read -ra ver1 00:02:27.242 20:03:32 -- scripts/common.sh@336 -- # IFS=.-: 00:02:27.242 20:03:32 -- scripts/common.sh@336 -- # read -ra ver2 00:02:27.242 20:03:32 -- scripts/common.sh@337 -- # local 'op=<' 00:02:27.242 20:03:32 -- scripts/common.sh@339 -- # ver1_l=2 00:02:27.242 20:03:32 -- scripts/common.sh@340 -- # ver2_l=1 00:02:27.242 20:03:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:27.242 20:03:32 -- scripts/common.sh@343 -- # case "$op" in 00:02:27.242 20:03:32 -- scripts/common.sh@344 -- # : 1 00:02:27.242 20:03:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:27.242 20:03:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:27.242 20:03:32 -- scripts/common.sh@364 -- # decimal 1 00:02:27.242 20:03:32 -- scripts/common.sh@352 -- # local d=1 00:02:27.242 20:03:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:27.242 20:03:32 -- scripts/common.sh@354 -- # echo 1 00:02:27.242 20:03:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:27.242 20:03:32 -- scripts/common.sh@365 -- # decimal 2 00:02:27.242 20:03:32 -- scripts/common.sh@352 -- # local d=2 00:02:27.242 20:03:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:27.242 20:03:32 -- scripts/common.sh@354 -- # echo 2 00:02:27.242 20:03:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:27.242 20:03:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:27.242 20:03:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:27.242 20:03:32 -- scripts/common.sh@367 -- # return 0 00:02:27.242 20:03:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:27.242 20:03:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:27.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.243 --rc genhtml_branch_coverage=1 00:02:27.243 --rc genhtml_function_coverage=1 00:02:27.243 --rc genhtml_legend=1 00:02:27.243 --rc geninfo_all_blocks=1 00:02:27.243 --rc geninfo_unexecuted_blocks=1 00:02:27.243 00:02:27.243 ' 00:02:27.243 20:03:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:27.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.243 --rc genhtml_branch_coverage=1 00:02:27.243 --rc genhtml_function_coverage=1 00:02:27.243 --rc genhtml_legend=1 00:02:27.243 --rc geninfo_all_blocks=1 00:02:27.243 --rc geninfo_unexecuted_blocks=1 00:02:27.243 00:02:27.243 ' 00:02:27.243 20:03:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:27.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.243 --rc genhtml_branch_coverage=1 00:02:27.243 --rc genhtml_function_coverage=1 00:02:27.243 --rc genhtml_legend=1 00:02:27.243 --rc geninfo_all_blocks=1 00:02:27.243 --rc geninfo_unexecuted_blocks=1 00:02:27.243 00:02:27.243 ' 00:02:27.243 20:03:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:27.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.243 --rc genhtml_branch_coverage=1 00:02:27.243 --rc genhtml_function_coverage=1 00:02:27.243 --rc genhtml_legend=1 00:02:27.243 --rc geninfo_all_blocks=1 00:02:27.243 --rc geninfo_unexecuted_blocks=1 00:02:27.243 00:02:27.243 ' 00:02:27.243 20:03:32 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:27.243 20:03:32 -- nvmf/common.sh@7 -- # uname -s 00:02:27.243 20:03:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:27.243 20:03:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:27.243 20:03:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:27.243 20:03:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:27.243 20:03:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:27.243 20:03:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:27.243 20:03:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:27.243 20:03:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:27.243 20:03:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:27.243 20:03:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:27.502 20:03:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:27.502 20:03:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:27.502 20:03:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:27.502 20:03:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:27.502 20:03:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:27.502 20:03:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:27.502 20:03:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:27.502 20:03:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:27.502 20:03:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:27.502 20:03:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.502 20:03:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.502 20:03:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.502 20:03:32 -- paths/export.sh@5 -- # export PATH 00:02:27.502 20:03:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.502 20:03:32 -- nvmf/common.sh@46 -- # : 0 00:02:27.502 20:03:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:27.502 20:03:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:27.502 20:03:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:27.502 20:03:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:27.502 20:03:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:27.502 20:03:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:27.502 20:03:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:27.502 20:03:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:27.502 20:03:32 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:27.502 20:03:32 -- spdk/autotest.sh@32 -- # uname -s 00:02:27.502 20:03:32 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:27.502 20:03:32 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:27.502 20:03:32 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:27.502 20:03:32 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:27.502 20:03:32 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:27.502 20:03:32 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:27.502 20:03:32 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:27.502 20:03:32 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:27.502 20:03:32 -- spdk/autotest.sh@48 -- # udevadm_pid=3004226 00:02:27.502 20:03:32 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.502 20:03:32 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:27.502 20:03:32 -- spdk/autotest.sh@54 -- # echo 3004228 00:02:27.502 20:03:32 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.502 20:03:32 -- spdk/autotest.sh@56 -- # echo 3004229 00:02:27.502 20:03:32 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.502 20:03:32 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:27.502 20:03:32 -- spdk/autotest.sh@60 -- # echo 3004230 00:02:27.502 20:03:32 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:27.502 20:03:32 -- spdk/autotest.sh@62 -- # echo 3004231 00:02:27.502 20:03:32 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:27.502 20:03:32 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:27.502 20:03:32 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:27.502 20:03:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:27.502 20:03:32 -- common/autotest_common.sh@10 -- # set +x 00:02:27.502 20:03:32 -- spdk/autotest.sh@70 -- # create_test_list 00:02:27.502 20:03:32 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:27.502 20:03:32 -- common/autotest_common.sh@10 -- # set +x 00:02:27.502 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:27.502 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:27.502 20:03:32 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:27.502 20:03:32 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.502 20:03:32 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.502 20:03:32 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:27.502 20:03:32 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.502 20:03:32 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:27.502 20:03:32 -- common/autotest_common.sh@1450 -- # uname 00:02:27.502 20:03:32 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:27.502 20:03:32 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:27.502 20:03:32 -- common/autotest_common.sh@1470 -- # uname 00:02:27.502 20:03:32 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:27.502 20:03:32 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:27.502 20:03:32 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:27.502 lcov: LCOV version 1.15 00:02:27.502 20:03:32 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:30.785 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:30.785 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:30.785 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:30.785 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:31.043 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:31.043 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:03.119 20:04:04 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:03.119 20:04:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:03.119 20:04:04 -- common/autotest_common.sh@10 -- # set +x 00:03:03.119 20:04:04 -- spdk/autotest.sh@89 -- # rm -f 00:03:03.119 20:04:04 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.119 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:03.119 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:03.119 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:03.119 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:03.119 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:03.119 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:03.119 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:03.119 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:03.119 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:03.119 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:03.119 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:03.119 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:03.119 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:03.119 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:03.119 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:03.119 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:03.119 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:03.119 20:04:06 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:03.119 20:04:06 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:03.119 20:04:06 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:03.119 20:04:06 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:03.119 20:04:06 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:03.119 20:04:06 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:03.119 20:04:06 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:03.119 20:04:06 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:03.119 20:04:06 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:03.119 20:04:06 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:03.119 20:04:06 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:03.119 20:04:06 -- spdk/autotest.sh@108 -- # grep -v p 00:03:03.119 20:04:06 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:03.119 20:04:06 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:03.119 20:04:06 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:03.119 20:04:06 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:03.119 20:04:06 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:03.119 No valid GPT data, bailing 00:03:03.119 20:04:06 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:03.119 20:04:06 -- scripts/common.sh@393 -- # pt= 00:03:03.119 20:04:06 -- scripts/common.sh@394 -- # return 1 00:03:03.119 20:04:06 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:03.119 1+0 records in 00:03:03.119 1+0 records out 00:03:03.119 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0021876 s, 479 MB/s 00:03:03.119 20:04:06 -- spdk/autotest.sh@116 -- # sync 00:03:03.119 20:04:06 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:03.119 20:04:06 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:03.119 20:04:06 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:03.377 20:04:08 -- spdk/autotest.sh@122 -- # uname -s 00:03:03.377 20:04:08 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:03.377 20:04:08 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:03.377 20:04:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.377 20:04:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.377 20:04:08 -- common/autotest_common.sh@10 -- # set +x 00:03:03.377 ************************************ 00:03:03.377 START TEST setup.sh 00:03:03.377 ************************************ 00:03:03.377 20:04:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:03.377 * Looking for test storage... 00:03:03.377 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:03.377 20:04:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:03.377 20:04:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:03.377 20:04:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:03.635 20:04:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:03.635 20:04:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:03.635 20:04:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:03.635 20:04:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:03.635 20:04:08 -- scripts/common.sh@335 -- # IFS=.-: 00:03:03.635 20:04:08 -- scripts/common.sh@335 -- # read -ra ver1 00:03:03.635 20:04:08 -- scripts/common.sh@336 -- # IFS=.-: 00:03:03.635 20:04:08 -- scripts/common.sh@336 -- # read -ra ver2 00:03:03.635 20:04:08 -- scripts/common.sh@337 -- # local 'op=<' 00:03:03.635 20:04:08 -- scripts/common.sh@339 -- # ver1_l=2 00:03:03.635 20:04:08 -- scripts/common.sh@340 -- # ver2_l=1 00:03:03.635 20:04:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:03.635 20:04:08 -- scripts/common.sh@343 -- # case "$op" in 00:03:03.635 20:04:08 -- scripts/common.sh@344 -- # : 1 00:03:03.635 20:04:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:03.635 20:04:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:03.635 20:04:08 -- scripts/common.sh@364 -- # decimal 1 00:03:03.635 20:04:08 -- scripts/common.sh@352 -- # local d=1 00:03:03.635 20:04:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:03.635 20:04:08 -- scripts/common.sh@354 -- # echo 1 00:03:03.635 20:04:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:03.635 20:04:08 -- scripts/common.sh@365 -- # decimal 2 00:03:03.635 20:04:08 -- scripts/common.sh@352 -- # local d=2 00:03:03.635 20:04:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:03.635 20:04:08 -- scripts/common.sh@354 -- # echo 2 00:03:03.635 20:04:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:03.635 20:04:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:03.635 20:04:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:03.635 20:04:08 -- scripts/common.sh@367 -- # return 0 00:03:03.635 20:04:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:03.635 20:04:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:03.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.635 --rc genhtml_branch_coverage=1 00:03:03.635 --rc genhtml_function_coverage=1 00:03:03.635 --rc genhtml_legend=1 00:03:03.635 --rc geninfo_all_blocks=1 00:03:03.635 --rc geninfo_unexecuted_blocks=1 00:03:03.635 00:03:03.635 ' 00:03:03.635 20:04:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:03.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.635 --rc genhtml_branch_coverage=1 00:03:03.635 --rc genhtml_function_coverage=1 00:03:03.635 --rc genhtml_legend=1 00:03:03.635 --rc geninfo_all_blocks=1 00:03:03.635 --rc geninfo_unexecuted_blocks=1 00:03:03.635 00:03:03.635 ' 00:03:03.635 20:04:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:03.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.635 --rc genhtml_branch_coverage=1 00:03:03.635 --rc genhtml_function_coverage=1 00:03:03.635 --rc genhtml_legend=1 00:03:03.635 --rc geninfo_all_blocks=1 00:03:03.635 --rc geninfo_unexecuted_blocks=1 00:03:03.635 00:03:03.635 ' 00:03:03.635 20:04:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:03.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.635 --rc genhtml_branch_coverage=1 00:03:03.636 --rc genhtml_function_coverage=1 00:03:03.636 --rc genhtml_legend=1 00:03:03.636 --rc geninfo_all_blocks=1 00:03:03.636 --rc geninfo_unexecuted_blocks=1 00:03:03.636 00:03:03.636 ' 00:03:03.636 20:04:08 -- setup/test-setup.sh@10 -- # uname -s 00:03:03.636 20:04:08 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:03.636 20:04:08 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:03.636 20:04:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.636 20:04:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.636 20:04:08 -- common/autotest_common.sh@10 -- # set +x 00:03:03.636 ************************************ 00:03:03.636 START TEST acl 00:03:03.636 ************************************ 00:03:03.636 20:04:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:03.636 * Looking for test storage... 00:03:03.636 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:03.636 20:04:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:03.636 20:04:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:03.636 20:04:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:03.636 20:04:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:03.636 20:04:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:03.636 20:04:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:03.636 20:04:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:03.636 20:04:08 -- scripts/common.sh@335 -- # IFS=.-: 00:03:03.636 20:04:08 -- scripts/common.sh@335 -- # read -ra ver1 00:03:03.636 20:04:08 -- scripts/common.sh@336 -- # IFS=.-: 00:03:03.636 20:04:08 -- scripts/common.sh@336 -- # read -ra ver2 00:03:03.636 20:04:08 -- scripts/common.sh@337 -- # local 'op=<' 00:03:03.636 20:04:08 -- scripts/common.sh@339 -- # ver1_l=2 00:03:03.636 20:04:08 -- scripts/common.sh@340 -- # ver2_l=1 00:03:03.636 20:04:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:03.636 20:04:08 -- scripts/common.sh@343 -- # case "$op" in 00:03:03.636 20:04:08 -- scripts/common.sh@344 -- # : 1 00:03:03.636 20:04:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:03.636 20:04:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:03.636 20:04:08 -- scripts/common.sh@364 -- # decimal 1 00:03:03.636 20:04:08 -- scripts/common.sh@352 -- # local d=1 00:03:03.636 20:04:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:03.636 20:04:08 -- scripts/common.sh@354 -- # echo 1 00:03:03.636 20:04:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:03.636 20:04:08 -- scripts/common.sh@365 -- # decimal 2 00:03:03.636 20:04:08 -- scripts/common.sh@352 -- # local d=2 00:03:03.636 20:04:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:03.636 20:04:08 -- scripts/common.sh@354 -- # echo 2 00:03:03.636 20:04:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:03.636 20:04:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:03.636 20:04:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:03.636 20:04:08 -- scripts/common.sh@367 -- # return 0 00:03:03.636 20:04:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:03.636 20:04:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:03.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.636 --rc genhtml_branch_coverage=1 00:03:03.636 --rc genhtml_function_coverage=1 00:03:03.636 --rc genhtml_legend=1 00:03:03.636 --rc geninfo_all_blocks=1 00:03:03.636 --rc geninfo_unexecuted_blocks=1 00:03:03.636 00:03:03.636 ' 00:03:03.636 20:04:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:03.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.636 --rc genhtml_branch_coverage=1 00:03:03.636 --rc genhtml_function_coverage=1 00:03:03.636 --rc genhtml_legend=1 00:03:03.636 --rc geninfo_all_blocks=1 00:03:03.636 --rc geninfo_unexecuted_blocks=1 00:03:03.636 00:03:03.636 ' 00:03:03.636 20:04:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:03.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.636 --rc genhtml_branch_coverage=1 00:03:03.636 --rc genhtml_function_coverage=1 00:03:03.636 --rc genhtml_legend=1 00:03:03.636 --rc geninfo_all_blocks=1 00:03:03.636 --rc geninfo_unexecuted_blocks=1 00:03:03.636 00:03:03.636 ' 00:03:03.636 20:04:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:03.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.636 --rc genhtml_branch_coverage=1 00:03:03.636 --rc genhtml_function_coverage=1 00:03:03.636 --rc genhtml_legend=1 00:03:03.636 --rc geninfo_all_blocks=1 00:03:03.636 --rc geninfo_unexecuted_blocks=1 00:03:03.636 00:03:03.636 ' 00:03:03.636 20:04:08 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:03.636 20:04:08 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:03.636 20:04:08 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:03.636 20:04:08 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:03.636 20:04:08 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:03.636 20:04:08 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:03.636 20:04:08 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:03.636 20:04:08 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:03.636 20:04:08 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:03.636 20:04:08 -- setup/acl.sh@12 -- # devs=() 00:03:03.636 20:04:08 -- setup/acl.sh@12 -- # declare -a devs 00:03:03.636 20:04:08 -- setup/acl.sh@13 -- # drivers=() 00:03:03.636 20:04:08 -- setup/acl.sh@13 -- # declare -A drivers 00:03:03.636 20:04:08 -- setup/acl.sh@51 -- # setup reset 00:03:03.636 20:04:08 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:03.636 20:04:08 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:05.011 20:04:10 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:05.011 20:04:10 -- setup/acl.sh@16 -- # local dev driver 00:03:05.011 20:04:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.011 20:04:10 -- setup/acl.sh@15 -- # setup output status 00:03:05.011 20:04:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:05.011 20:04:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:06.387 Hugepages 00:03:06.387 node hugesize free / total 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 00:03:06.387 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.387 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.387 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.387 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # continue 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:06.388 20:04:11 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:06.388 20:04:11 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:06.388 20:04:11 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:06.388 20:04:11 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.388 20:04:11 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:06.388 20:04:11 -- setup/acl.sh@54 -- # run_test denied denied 00:03:06.388 20:04:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:06.388 20:04:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:06.388 20:04:11 -- common/autotest_common.sh@10 -- # set +x 00:03:06.388 ************************************ 00:03:06.388 START TEST denied 00:03:06.388 ************************************ 00:03:06.388 20:04:11 -- common/autotest_common.sh@1114 -- # denied 00:03:06.388 20:04:11 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:06.388 20:04:11 -- setup/acl.sh@38 -- # setup output config 00:03:06.388 20:04:11 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:06.388 20:04:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:06.388 20:04:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:07.763 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:07.763 20:04:12 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:07.763 20:04:12 -- setup/acl.sh@28 -- # local dev driver 00:03:07.763 20:04:12 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:07.763 20:04:12 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:07.763 20:04:12 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:07.763 20:04:12 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:07.763 20:04:12 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:07.763 20:04:12 -- setup/acl.sh@41 -- # setup reset 00:03:07.763 20:04:12 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:07.763 20:04:12 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.298 00:03:10.298 real 0m3.905s 00:03:10.298 user 0m1.177s 00:03:10.298 sys 0m1.836s 00:03:10.298 20:04:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:10.298 20:04:15 -- common/autotest_common.sh@10 -- # set +x 00:03:10.298 ************************************ 00:03:10.298 END TEST denied 00:03:10.298 ************************************ 00:03:10.298 20:04:15 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:10.298 20:04:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.298 20:04:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.298 20:04:15 -- common/autotest_common.sh@10 -- # set +x 00:03:10.298 ************************************ 00:03:10.298 START TEST allowed 00:03:10.298 ************************************ 00:03:10.298 20:04:15 -- common/autotest_common.sh@1114 -- # allowed 00:03:10.298 20:04:15 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:10.298 20:04:15 -- setup/acl.sh@45 -- # setup output config 00:03:10.298 20:04:15 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:10.298 20:04:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.298 20:04:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:12.832 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:12.832 20:04:17 -- setup/acl.sh@47 -- # verify 00:03:12.832 20:04:17 -- setup/acl.sh@28 -- # local dev driver 00:03:12.832 20:04:17 -- setup/acl.sh@48 -- # setup reset 00:03:12.832 20:04:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:12.832 20:04:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.209 00:03:14.209 real 0m3.835s 00:03:14.209 user 0m0.973s 00:03:14.209 sys 0m1.738s 00:03:14.209 20:04:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.209 20:04:18 -- common/autotest_common.sh@10 -- # set +x 00:03:14.209 ************************************ 00:03:14.209 END TEST allowed 00:03:14.209 ************************************ 00:03:14.209 00:03:14.209 real 0m10.484s 00:03:14.209 user 0m3.220s 00:03:14.209 sys 0m5.340s 00:03:14.209 20:04:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.209 20:04:18 -- common/autotest_common.sh@10 -- # set +x 00:03:14.209 ************************************ 00:03:14.209 END TEST acl 00:03:14.209 ************************************ 00:03:14.209 20:04:18 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:14.209 20:04:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:14.209 20:04:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:14.209 20:04:18 -- common/autotest_common.sh@10 -- # set +x 00:03:14.209 ************************************ 00:03:14.209 START TEST hugepages 00:03:14.209 ************************************ 00:03:14.209 20:04:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:14.209 * Looking for test storage... 00:03:14.209 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:14.209 20:04:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:14.209 20:04:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:14.209 20:04:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:14.209 20:04:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:14.209 20:04:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:14.209 20:04:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:14.209 20:04:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:14.209 20:04:19 -- scripts/common.sh@335 -- # IFS=.-: 00:03:14.209 20:04:19 -- scripts/common.sh@335 -- # read -ra ver1 00:03:14.209 20:04:19 -- scripts/common.sh@336 -- # IFS=.-: 00:03:14.209 20:04:19 -- scripts/common.sh@336 -- # read -ra ver2 00:03:14.209 20:04:19 -- scripts/common.sh@337 -- # local 'op=<' 00:03:14.209 20:04:19 -- scripts/common.sh@339 -- # ver1_l=2 00:03:14.209 20:04:19 -- scripts/common.sh@340 -- # ver2_l=1 00:03:14.209 20:04:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:14.209 20:04:19 -- scripts/common.sh@343 -- # case "$op" in 00:03:14.209 20:04:19 -- scripts/common.sh@344 -- # : 1 00:03:14.209 20:04:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:14.209 20:04:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:14.209 20:04:19 -- scripts/common.sh@364 -- # decimal 1 00:03:14.209 20:04:19 -- scripts/common.sh@352 -- # local d=1 00:03:14.209 20:04:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:14.209 20:04:19 -- scripts/common.sh@354 -- # echo 1 00:03:14.209 20:04:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:14.209 20:04:19 -- scripts/common.sh@365 -- # decimal 2 00:03:14.209 20:04:19 -- scripts/common.sh@352 -- # local d=2 00:03:14.209 20:04:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:14.209 20:04:19 -- scripts/common.sh@354 -- # echo 2 00:03:14.209 20:04:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:14.209 20:04:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:14.209 20:04:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:14.209 20:04:19 -- scripts/common.sh@367 -- # return 0 00:03:14.210 20:04:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:14.210 20:04:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:14.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.210 --rc genhtml_branch_coverage=1 00:03:14.210 --rc genhtml_function_coverage=1 00:03:14.210 --rc genhtml_legend=1 00:03:14.210 --rc geninfo_all_blocks=1 00:03:14.210 --rc geninfo_unexecuted_blocks=1 00:03:14.210 00:03:14.210 ' 00:03:14.210 20:04:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:14.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.210 --rc genhtml_branch_coverage=1 00:03:14.210 --rc genhtml_function_coverage=1 00:03:14.210 --rc genhtml_legend=1 00:03:14.210 --rc geninfo_all_blocks=1 00:03:14.210 --rc geninfo_unexecuted_blocks=1 00:03:14.210 00:03:14.210 ' 00:03:14.210 20:04:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:14.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.210 --rc genhtml_branch_coverage=1 00:03:14.210 --rc genhtml_function_coverage=1 00:03:14.210 --rc genhtml_legend=1 00:03:14.210 --rc geninfo_all_blocks=1 00:03:14.210 --rc geninfo_unexecuted_blocks=1 00:03:14.210 00:03:14.210 ' 00:03:14.210 20:04:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:14.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.210 --rc genhtml_branch_coverage=1 00:03:14.210 --rc genhtml_function_coverage=1 00:03:14.210 --rc genhtml_legend=1 00:03:14.210 --rc geninfo_all_blocks=1 00:03:14.210 --rc geninfo_unexecuted_blocks=1 00:03:14.210 00:03:14.210 ' 00:03:14.210 20:04:19 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:14.210 20:04:19 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:14.210 20:04:19 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:14.210 20:04:19 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:14.210 20:04:19 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:14.210 20:04:19 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:14.210 20:04:19 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:14.210 20:04:19 -- setup/common.sh@18 -- # local node= 00:03:14.210 20:04:19 -- setup/common.sh@19 -- # local var val 00:03:14.210 20:04:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.210 20:04:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.210 20:04:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.210 20:04:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.210 20:04:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.210 20:04:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42404584 kB' 'MemAvailable: 46719584 kB' 'Buffers: 2708 kB' 'Cached: 11035200 kB' 'SwapCached: 0 kB' 'Active: 7441836 kB' 'Inactive: 4089812 kB' 'Active(anon): 7040716 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 497304 kB' 'Mapped: 202232 kB' 'Shmem: 6546976 kB' 'KReclaimable: 468700 kB' 'Slab: 1052316 kB' 'SReclaimable: 468700 kB' 'SUnreclaim: 583616 kB' 'KernelStack: 12864 kB' 'PageTables: 8308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 8125264 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199748 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.210 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.210 20:04:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # continue 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.211 20:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.211 20:04:19 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.211 20:04:19 -- setup/common.sh@33 -- # echo 2048 00:03:14.211 20:04:19 -- setup/common.sh@33 -- # return 0 00:03:14.211 20:04:19 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:14.211 20:04:19 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:14.211 20:04:19 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:14.211 20:04:19 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:14.211 20:04:19 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:14.211 20:04:19 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:14.211 20:04:19 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:14.211 20:04:19 -- setup/hugepages.sh@207 -- # get_nodes 00:03:14.211 20:04:19 -- setup/hugepages.sh@27 -- # local node 00:03:14.211 20:04:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.211 20:04:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:14.211 20:04:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.211 20:04:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:14.211 20:04:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.211 20:04:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.211 20:04:19 -- setup/hugepages.sh@208 -- # clear_hp 00:03:14.211 20:04:19 -- setup/hugepages.sh@37 -- # local node hp 00:03:14.211 20:04:19 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:14.211 20:04:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:14.211 20:04:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:14.211 20:04:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:14.211 20:04:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:14.211 20:04:19 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:14.211 20:04:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:14.211 20:04:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:14.211 20:04:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:14.211 20:04:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:14.211 20:04:19 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:14.211 20:04:19 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:14.211 20:04:19 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:14.211 20:04:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:14.211 20:04:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:14.211 20:04:19 -- common/autotest_common.sh@10 -- # set +x 00:03:14.211 ************************************ 00:03:14.211 START TEST default_setup 00:03:14.211 ************************************ 00:03:14.211 20:04:19 -- common/autotest_common.sh@1114 -- # default_setup 00:03:14.211 20:04:19 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:14.211 20:04:19 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:14.211 20:04:19 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:14.211 20:04:19 -- setup/hugepages.sh@51 -- # shift 00:03:14.211 20:04:19 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:14.211 20:04:19 -- setup/hugepages.sh@52 -- # local node_ids 00:03:14.211 20:04:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.211 20:04:19 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:14.211 20:04:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:14.212 20:04:19 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:14.212 20:04:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.212 20:04:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.212 20:04:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.212 20:04:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.212 20:04:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.212 20:04:19 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:14.212 20:04:19 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:14.212 20:04:19 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:14.212 20:04:19 -- setup/hugepages.sh@73 -- # return 0 00:03:14.212 20:04:19 -- setup/hugepages.sh@137 -- # setup output 00:03:14.212 20:04:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.212 20:04:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:15.587 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:15.587 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:15.587 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:16.524 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:16.524 20:04:21 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:16.524 20:04:21 -- setup/hugepages.sh@89 -- # local node 00:03:16.524 20:04:21 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.524 20:04:21 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.524 20:04:21 -- setup/hugepages.sh@92 -- # local surp 00:03:16.524 20:04:21 -- setup/hugepages.sh@93 -- # local resv 00:03:16.524 20:04:21 -- setup/hugepages.sh@94 -- # local anon 00:03:16.524 20:04:21 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.524 20:04:21 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.524 20:04:21 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.524 20:04:21 -- setup/common.sh@18 -- # local node= 00:03:16.524 20:04:21 -- setup/common.sh@19 -- # local var val 00:03:16.524 20:04:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.524 20:04:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.524 20:04:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.524 20:04:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.524 20:04:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.524 20:04:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.524 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.524 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.524 20:04:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44549376 kB' 'MemAvailable: 48864344 kB' 'Buffers: 2708 kB' 'Cached: 11035292 kB' 'SwapCached: 0 kB' 'Active: 7436812 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035692 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491424 kB' 'Mapped: 201012 kB' 'Shmem: 6547068 kB' 'KReclaimable: 468668 kB' 'Slab: 1052000 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583332 kB' 'KernelStack: 12816 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200000 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:16.524 20:04:21 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.524 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.524 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.524 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.524 20:04:21 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.524 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.524 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.524 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.524 20:04:21 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.524 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.525 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.525 20:04:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.525 20:04:21 -- setup/common.sh@33 -- # echo 0 00:03:16.525 20:04:21 -- setup/common.sh@33 -- # return 0 00:03:16.525 20:04:21 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.525 20:04:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.525 20:04:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.525 20:04:21 -- setup/common.sh@18 -- # local node= 00:03:16.525 20:04:21 -- setup/common.sh@19 -- # local var val 00:03:16.525 20:04:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.525 20:04:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.525 20:04:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.525 20:04:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.525 20:04:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.526 20:04:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44550688 kB' 'MemAvailable: 48865656 kB' 'Buffers: 2708 kB' 'Cached: 11035296 kB' 'SwapCached: 0 kB' 'Active: 7437812 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036692 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492560 kB' 'Mapped: 201088 kB' 'Shmem: 6547072 kB' 'KReclaimable: 468668 kB' 'Slab: 1052108 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583440 kB' 'KernelStack: 12880 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8130752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199952 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.526 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.526 20:04:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.527 20:04:21 -- setup/common.sh@33 -- # echo 0 00:03:16.527 20:04:21 -- setup/common.sh@33 -- # return 0 00:03:16.527 20:04:21 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.527 20:04:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.527 20:04:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.527 20:04:21 -- setup/common.sh@18 -- # local node= 00:03:16.527 20:04:21 -- setup/common.sh@19 -- # local var val 00:03:16.527 20:04:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.527 20:04:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.527 20:04:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.527 20:04:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.527 20:04:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.527 20:04:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44551304 kB' 'MemAvailable: 48866272 kB' 'Buffers: 2708 kB' 'Cached: 11035308 kB' 'SwapCached: 0 kB' 'Active: 7437272 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036152 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491964 kB' 'Mapped: 201012 kB' 'Shmem: 6547084 kB' 'KReclaimable: 468668 kB' 'Slab: 1052108 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583440 kB' 'KernelStack: 12816 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8124900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199888 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.527 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.527 20:04:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.528 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.528 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.529 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.529 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.529 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.529 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.529 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.529 20:04:21 -- setup/common.sh@33 -- # echo 0 00:03:16.529 20:04:21 -- setup/common.sh@33 -- # return 0 00:03:16.529 20:04:21 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.529 20:04:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:16.529 nr_hugepages=1024 00:03:16.529 20:04:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.529 resv_hugepages=0 00:03:16.529 20:04:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.529 surplus_hugepages=0 00:03:16.529 20:04:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.529 anon_hugepages=0 00:03:16.529 20:04:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.529 20:04:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:16.529 20:04:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.529 20:04:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.529 20:04:21 -- setup/common.sh@18 -- # local node= 00:03:16.529 20:04:21 -- setup/common.sh@19 -- # local var val 00:03:16.529 20:04:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.788 20:04:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.788 20:04:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.788 20:04:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.788 20:04:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.788 20:04:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.788 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44552952 kB' 'MemAvailable: 48867920 kB' 'Buffers: 2708 kB' 'Cached: 11035324 kB' 'SwapCached: 0 kB' 'Active: 7436648 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035528 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491628 kB' 'Mapped: 200996 kB' 'Shmem: 6547100 kB' 'KReclaimable: 468668 kB' 'Slab: 1052108 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583440 kB' 'KernelStack: 12832 kB' 'PageTables: 8132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8124920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199888 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.789 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.789 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.790 20:04:21 -- setup/common.sh@33 -- # echo 1024 00:03:16.790 20:04:21 -- setup/common.sh@33 -- # return 0 00:03:16.790 20:04:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.790 20:04:21 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.790 20:04:21 -- setup/hugepages.sh@27 -- # local node 00:03:16.790 20:04:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.790 20:04:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:16.790 20:04:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.790 20:04:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:16.790 20:04:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.790 20:04:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.790 20:04:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.790 20:04:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.790 20:04:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.790 20:04:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.790 20:04:21 -- setup/common.sh@18 -- # local node=0 00:03:16.790 20:04:21 -- setup/common.sh@19 -- # local var val 00:03:16.790 20:04:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.790 20:04:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.790 20:04:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.790 20:04:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.790 20:04:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.790 20:04:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19903928 kB' 'MemUsed: 12970996 kB' 'SwapCached: 0 kB' 'Active: 5929768 kB' 'Inactive: 3554096 kB' 'Active(anon): 5722260 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254104 kB' 'Mapped: 104056 kB' 'AnonPages: 232908 kB' 'Shmem: 5492500 kB' 'KernelStack: 7080 kB' 'PageTables: 5068 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685016 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 367992 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.790 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.790 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # continue 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.791 20:04:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.791 20:04:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.791 20:04:21 -- setup/common.sh@33 -- # echo 0 00:03:16.791 20:04:21 -- setup/common.sh@33 -- # return 0 00:03:16.791 20:04:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.791 20:04:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.791 20:04:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.791 20:04:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.791 20:04:21 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:16.791 node0=1024 expecting 1024 00:03:16.791 20:04:21 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:16.791 00:03:16.791 real 0m2.453s 00:03:16.791 user 0m0.661s 00:03:16.791 sys 0m0.915s 00:03:16.791 20:04:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.791 20:04:21 -- common/autotest_common.sh@10 -- # set +x 00:03:16.791 ************************************ 00:03:16.791 END TEST default_setup 00:03:16.791 ************************************ 00:03:16.791 20:04:21 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:16.791 20:04:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.791 20:04:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.791 20:04:21 -- common/autotest_common.sh@10 -- # set +x 00:03:16.791 ************************************ 00:03:16.791 START TEST per_node_1G_alloc 00:03:16.791 ************************************ 00:03:16.791 20:04:21 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:16.791 20:04:21 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:16.791 20:04:21 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:16.791 20:04:21 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:16.791 20:04:21 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:16.791 20:04:21 -- setup/hugepages.sh@51 -- # shift 00:03:16.791 20:04:21 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:16.791 20:04:21 -- setup/hugepages.sh@52 -- # local node_ids 00:03:16.791 20:04:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.791 20:04:21 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:16.791 20:04:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:16.791 20:04:21 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:16.791 20:04:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.791 20:04:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:16.791 20:04:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.791 20:04:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.791 20:04:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.791 20:04:21 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:16.791 20:04:21 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.791 20:04:21 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:16.791 20:04:21 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.791 20:04:21 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:16.791 20:04:21 -- setup/hugepages.sh@73 -- # return 0 00:03:16.791 20:04:21 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:16.791 20:04:21 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:16.791 20:04:21 -- setup/hugepages.sh@146 -- # setup output 00:03:16.791 20:04:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.791 20:04:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.171 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.171 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.171 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.171 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.171 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.171 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.171 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.171 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.171 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.171 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.171 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.171 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.171 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.171 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.171 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.171 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.171 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.171 20:04:22 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:18.171 20:04:22 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:18.171 20:04:22 -- setup/hugepages.sh@89 -- # local node 00:03:18.171 20:04:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.171 20:04:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.171 20:04:22 -- setup/hugepages.sh@92 -- # local surp 00:03:18.171 20:04:22 -- setup/hugepages.sh@93 -- # local resv 00:03:18.171 20:04:22 -- setup/hugepages.sh@94 -- # local anon 00:03:18.171 20:04:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.171 20:04:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.171 20:04:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.171 20:04:22 -- setup/common.sh@18 -- # local node= 00:03:18.171 20:04:22 -- setup/common.sh@19 -- # local var val 00:03:18.171 20:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.171 20:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.171 20:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.171 20:04:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.171 20:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.171 20:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44551112 kB' 'MemAvailable: 48866080 kB' 'Buffers: 2708 kB' 'Cached: 11035384 kB' 'SwapCached: 0 kB' 'Active: 7436748 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035628 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491676 kB' 'Mapped: 201096 kB' 'Shmem: 6547160 kB' 'KReclaimable: 468668 kB' 'Slab: 1052408 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583740 kB' 'KernelStack: 12832 kB' 'PageTables: 8100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200000 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.172 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.172 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.173 20:04:22 -- setup/common.sh@33 -- # echo 0 00:03:18.173 20:04:22 -- setup/common.sh@33 -- # return 0 00:03:18.173 20:04:22 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.173 20:04:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.173 20:04:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.173 20:04:22 -- setup/common.sh@18 -- # local node= 00:03:18.173 20:04:22 -- setup/common.sh@19 -- # local var val 00:03:18.173 20:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.173 20:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.173 20:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.173 20:04:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.173 20:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.173 20:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44554096 kB' 'MemAvailable: 48869064 kB' 'Buffers: 2708 kB' 'Cached: 11035384 kB' 'SwapCached: 0 kB' 'Active: 7437912 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036792 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492264 kB' 'Mapped: 201080 kB' 'Shmem: 6547160 kB' 'KReclaimable: 468668 kB' 'Slab: 1052376 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583708 kB' 'KernelStack: 12864 kB' 'PageTables: 8168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125476 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199952 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:22 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.173 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.173 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.173 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.173 20:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.174 20:04:23 -- setup/common.sh@33 -- # echo 0 00:03:18.174 20:04:23 -- setup/common.sh@33 -- # return 0 00:03:18.174 20:04:23 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.174 20:04:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.174 20:04:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.174 20:04:23 -- setup/common.sh@18 -- # local node= 00:03:18.174 20:04:23 -- setup/common.sh@19 -- # local var val 00:03:18.174 20:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.174 20:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.174 20:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.174 20:04:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.174 20:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.174 20:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44554264 kB' 'MemAvailable: 48869232 kB' 'Buffers: 2708 kB' 'Cached: 11035396 kB' 'SwapCached: 0 kB' 'Active: 7437008 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035888 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491900 kB' 'Mapped: 201000 kB' 'Shmem: 6547172 kB' 'KReclaimable: 468668 kB' 'Slab: 1052380 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583712 kB' 'KernelStack: 12896 kB' 'PageTables: 8176 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125488 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.174 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.174 20:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.175 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.175 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.176 20:04:23 -- setup/common.sh@33 -- # echo 0 00:03:18.176 20:04:23 -- setup/common.sh@33 -- # return 0 00:03:18.176 20:04:23 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.176 20:04:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:18.176 nr_hugepages=1024 00:03:18.176 20:04:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.176 resv_hugepages=0 00:03:18.176 20:04:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.176 surplus_hugepages=0 00:03:18.176 20:04:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.176 anon_hugepages=0 00:03:18.176 20:04:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.176 20:04:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:18.176 20:04:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.176 20:04:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.176 20:04:23 -- setup/common.sh@18 -- # local node= 00:03:18.176 20:04:23 -- setup/common.sh@19 -- # local var val 00:03:18.176 20:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.176 20:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.176 20:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.176 20:04:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.176 20:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.176 20:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44554888 kB' 'MemAvailable: 48869856 kB' 'Buffers: 2708 kB' 'Cached: 11035412 kB' 'SwapCached: 0 kB' 'Active: 7437008 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035888 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491900 kB' 'Mapped: 201000 kB' 'Shmem: 6547188 kB' 'KReclaimable: 468668 kB' 'Slab: 1052380 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583712 kB' 'KernelStack: 12896 kB' 'PageTables: 8176 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125504 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.176 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.176 20:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.177 20:04:23 -- setup/common.sh@33 -- # echo 1024 00:03:18.177 20:04:23 -- setup/common.sh@33 -- # return 0 00:03:18.177 20:04:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.177 20:04:23 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.177 20:04:23 -- setup/hugepages.sh@27 -- # local node 00:03:18.177 20:04:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.177 20:04:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.177 20:04:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.177 20:04:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.177 20:04:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.177 20:04:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.177 20:04:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.177 20:04:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.177 20:04:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.177 20:04:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.177 20:04:23 -- setup/common.sh@18 -- # local node=0 00:03:18.177 20:04:23 -- setup/common.sh@19 -- # local var val 00:03:18.177 20:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.177 20:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.177 20:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.177 20:04:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.177 20:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.177 20:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20959516 kB' 'MemUsed: 11915408 kB' 'SwapCached: 0 kB' 'Active: 5929808 kB' 'Inactive: 3554096 kB' 'Active(anon): 5722300 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254192 kB' 'Mapped: 104056 kB' 'AnonPages: 232832 kB' 'Shmem: 5492588 kB' 'KernelStack: 7128 kB' 'PageTables: 4960 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685068 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 368044 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.177 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.177 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.178 20:04:23 -- setup/common.sh@33 -- # echo 0 00:03:18.178 20:04:23 -- setup/common.sh@33 -- # return 0 00:03:18.178 20:04:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.178 20:04:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.178 20:04:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.178 20:04:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.178 20:04:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.178 20:04:23 -- setup/common.sh@18 -- # local node=1 00:03:18.178 20:04:23 -- setup/common.sh@19 -- # local var val 00:03:18.178 20:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.178 20:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.178 20:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.178 20:04:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.178 20:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.178 20:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.178 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.178 20:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23594616 kB' 'MemUsed: 4066132 kB' 'SwapCached: 0 kB' 'Active: 1507204 kB' 'Inactive: 535716 kB' 'Active(anon): 1313592 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1783944 kB' 'Mapped: 96944 kB' 'AnonPages: 259032 kB' 'Shmem: 1054616 kB' 'KernelStack: 5752 kB' 'PageTables: 3160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 151644 kB' 'Slab: 367312 kB' 'SReclaimable: 151644 kB' 'SUnreclaim: 215668 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # continue 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.179 20:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.179 20:04:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.179 20:04:23 -- setup/common.sh@33 -- # echo 0 00:03:18.179 20:04:23 -- setup/common.sh@33 -- # return 0 00:03:18.179 20:04:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.179 20:04:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.179 20:04:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.179 20:04:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.179 20:04:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:18.179 node0=512 expecting 512 00:03:18.179 20:04:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.179 20:04:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.179 20:04:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.179 20:04:23 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:18.179 node1=512 expecting 512 00:03:18.179 20:04:23 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:18.179 00:03:18.179 real 0m1.479s 00:03:18.179 user 0m0.618s 00:03:18.179 sys 0m0.826s 00:03:18.179 20:04:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:18.179 20:04:23 -- common/autotest_common.sh@10 -- # set +x 00:03:18.180 ************************************ 00:03:18.180 END TEST per_node_1G_alloc 00:03:18.180 ************************************ 00:03:18.180 20:04:23 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:18.180 20:04:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.180 20:04:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.180 20:04:23 -- common/autotest_common.sh@10 -- # set +x 00:03:18.180 ************************************ 00:03:18.180 START TEST even_2G_alloc 00:03:18.180 ************************************ 00:03:18.180 20:04:23 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:18.180 20:04:23 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:18.180 20:04:23 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:18.180 20:04:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:18.180 20:04:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:18.180 20:04:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.180 20:04:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.180 20:04:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.180 20:04:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.180 20:04:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.180 20:04:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.180 20:04:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:18.180 20:04:23 -- setup/hugepages.sh@83 -- # : 512 00:03:18.180 20:04:23 -- setup/hugepages.sh@84 -- # : 1 00:03:18.180 20:04:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:18.180 20:04:23 -- setup/hugepages.sh@83 -- # : 0 00:03:18.180 20:04:23 -- setup/hugepages.sh@84 -- # : 0 00:03:18.180 20:04:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.180 20:04:23 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:18.180 20:04:23 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:18.180 20:04:23 -- setup/hugepages.sh@153 -- # setup output 00:03:18.180 20:04:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.180 20:04:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:19.558 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.558 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.558 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.558 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.558 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.558 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.558 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.558 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.558 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.558 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.558 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.558 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.558 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.558 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.558 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.558 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.558 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.558 20:04:24 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:19.558 20:04:24 -- setup/hugepages.sh@89 -- # local node 00:03:19.558 20:04:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.558 20:04:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.558 20:04:24 -- setup/hugepages.sh@92 -- # local surp 00:03:19.558 20:04:24 -- setup/hugepages.sh@93 -- # local resv 00:03:19.558 20:04:24 -- setup/hugepages.sh@94 -- # local anon 00:03:19.558 20:04:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.558 20:04:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.558 20:04:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.558 20:04:24 -- setup/common.sh@18 -- # local node= 00:03:19.558 20:04:24 -- setup/common.sh@19 -- # local var val 00:03:19.558 20:04:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.558 20:04:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.558 20:04:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.558 20:04:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.558 20:04:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.558 20:04:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44538792 kB' 'MemAvailable: 48853760 kB' 'Buffers: 2708 kB' 'Cached: 11035472 kB' 'SwapCached: 0 kB' 'Active: 7438116 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036996 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492580 kB' 'Mapped: 201140 kB' 'Shmem: 6547248 kB' 'KReclaimable: 468668 kB' 'Slab: 1052300 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583632 kB' 'KernelStack: 12928 kB' 'PageTables: 8284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200000 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.558 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.558 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.559 20:04:24 -- setup/common.sh@33 -- # echo 0 00:03:19.559 20:04:24 -- setup/common.sh@33 -- # return 0 00:03:19.559 20:04:24 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.559 20:04:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.559 20:04:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.559 20:04:24 -- setup/common.sh@18 -- # local node= 00:03:19.559 20:04:24 -- setup/common.sh@19 -- # local var val 00:03:19.559 20:04:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.559 20:04:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.559 20:04:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.559 20:04:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.559 20:04:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.559 20:04:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44547428 kB' 'MemAvailable: 48862396 kB' 'Buffers: 2708 kB' 'Cached: 11035476 kB' 'SwapCached: 0 kB' 'Active: 7437364 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036244 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492344 kB' 'Mapped: 201088 kB' 'Shmem: 6547252 kB' 'KReclaimable: 468668 kB' 'Slab: 1052312 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583644 kB' 'KernelStack: 12928 kB' 'PageTables: 8256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.559 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.559 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.560 20:04:24 -- setup/common.sh@33 -- # echo 0 00:03:19.560 20:04:24 -- setup/common.sh@33 -- # return 0 00:03:19.560 20:04:24 -- setup/hugepages.sh@99 -- # surp=0 00:03:19.560 20:04:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:19.560 20:04:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:19.560 20:04:24 -- setup/common.sh@18 -- # local node= 00:03:19.560 20:04:24 -- setup/common.sh@19 -- # local var val 00:03:19.560 20:04:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.560 20:04:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.560 20:04:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.560 20:04:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.560 20:04:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.560 20:04:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44547924 kB' 'MemAvailable: 48862892 kB' 'Buffers: 2708 kB' 'Cached: 11035484 kB' 'SwapCached: 0 kB' 'Active: 7437108 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035988 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491984 kB' 'Mapped: 201008 kB' 'Shmem: 6547260 kB' 'KReclaimable: 468668 kB' 'Slab: 1052284 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583616 kB' 'KernelStack: 12928 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125580 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199984 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.560 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.561 20:04:24 -- setup/common.sh@33 -- # echo 0 00:03:19.561 20:04:24 -- setup/common.sh@33 -- # return 0 00:03:19.561 20:04:24 -- setup/hugepages.sh@100 -- # resv=0 00:03:19.561 20:04:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:19.561 nr_hugepages=1024 00:03:19.561 20:04:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:19.561 resv_hugepages=0 00:03:19.561 20:04:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:19.561 surplus_hugepages=0 00:03:19.561 20:04:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:19.561 anon_hugepages=0 00:03:19.561 20:04:24 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.561 20:04:24 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:19.561 20:04:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:19.561 20:04:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:19.561 20:04:24 -- setup/common.sh@18 -- # local node= 00:03:19.561 20:04:24 -- setup/common.sh@19 -- # local var val 00:03:19.561 20:04:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.561 20:04:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.561 20:04:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.561 20:04:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.561 20:04:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.561 20:04:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44549828 kB' 'MemAvailable: 48864796 kB' 'Buffers: 2708 kB' 'Cached: 11035500 kB' 'SwapCached: 0 kB' 'Active: 7437084 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035964 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491980 kB' 'Mapped: 201008 kB' 'Shmem: 6547276 kB' 'KReclaimable: 468668 kB' 'Slab: 1052284 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583616 kB' 'KernelStack: 12928 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8125592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199984 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:04:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.562 20:04:24 -- setup/common.sh@33 -- # echo 1024 00:03:19.562 20:04:24 -- setup/common.sh@33 -- # return 0 00:03:19.562 20:04:24 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.562 20:04:24 -- setup/hugepages.sh@112 -- # get_nodes 00:03:19.562 20:04:24 -- setup/hugepages.sh@27 -- # local node 00:03:19.562 20:04:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.562 20:04:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:19.562 20:04:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.562 20:04:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:19.562 20:04:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.562 20:04:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.562 20:04:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.562 20:04:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.562 20:04:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.562 20:04:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.562 20:04:24 -- setup/common.sh@18 -- # local node=0 00:03:19.562 20:04:24 -- setup/common.sh@19 -- # local var val 00:03:19.562 20:04:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.562 20:04:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.563 20:04:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.563 20:04:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.563 20:04:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.563 20:04:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20966276 kB' 'MemUsed: 11908648 kB' 'SwapCached: 0 kB' 'Active: 5929884 kB' 'Inactive: 3554096 kB' 'Active(anon): 5722376 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254280 kB' 'Mapped: 104056 kB' 'AnonPages: 232840 kB' 'Shmem: 5492676 kB' 'KernelStack: 7144 kB' 'PageTables: 5016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685208 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 368184 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.563 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.563 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.563 20:04:24 -- setup/common.sh@33 -- # echo 0 00:03:19.563 20:04:24 -- setup/common.sh@33 -- # return 0 00:03:19.845 20:04:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.845 20:04:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.845 20:04:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.845 20:04:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:19.845 20:04:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.845 20:04:24 -- setup/common.sh@18 -- # local node=1 00:03:19.845 20:04:24 -- setup/common.sh@19 -- # local var val 00:03:19.845 20:04:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.845 20:04:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.845 20:04:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:19.845 20:04:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:19.845 20:04:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.845 20:04:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23583552 kB' 'MemUsed: 4077196 kB' 'SwapCached: 0 kB' 'Active: 1507268 kB' 'Inactive: 535716 kB' 'Active(anon): 1313656 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1783944 kB' 'Mapped: 96952 kB' 'AnonPages: 259140 kB' 'Shmem: 1054616 kB' 'KernelStack: 5784 kB' 'PageTables: 3164 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 151644 kB' 'Slab: 367080 kB' 'SReclaimable: 151644 kB' 'SUnreclaim: 215436 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.845 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.845 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # continue 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.846 20:04:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.846 20:04:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.846 20:04:24 -- setup/common.sh@33 -- # echo 0 00:03:19.846 20:04:24 -- setup/common.sh@33 -- # return 0 00:03:19.846 20:04:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.846 20:04:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.846 20:04:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.846 20:04:24 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:19.846 node0=512 expecting 512 00:03:19.846 20:04:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.846 20:04:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.846 20:04:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.846 20:04:24 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:19.846 node1=512 expecting 512 00:03:19.846 20:04:24 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:19.846 00:03:19.846 real 0m1.478s 00:03:19.846 user 0m0.598s 00:03:19.846 sys 0m0.846s 00:03:19.846 20:04:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.846 20:04:24 -- common/autotest_common.sh@10 -- # set +x 00:03:19.846 ************************************ 00:03:19.846 END TEST even_2G_alloc 00:03:19.846 ************************************ 00:03:19.846 20:04:24 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:19.846 20:04:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.846 20:04:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.846 20:04:24 -- common/autotest_common.sh@10 -- # set +x 00:03:19.846 ************************************ 00:03:19.846 START TEST odd_alloc 00:03:19.846 ************************************ 00:03:19.846 20:04:24 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:19.846 20:04:24 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:19.846 20:04:24 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:19.846 20:04:24 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:19.846 20:04:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.846 20:04:24 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.846 20:04:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.846 20:04:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:19.846 20:04:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.846 20:04:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.846 20:04:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.846 20:04:24 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:19.846 20:04:24 -- setup/hugepages.sh@83 -- # : 513 00:03:19.846 20:04:24 -- setup/hugepages.sh@84 -- # : 1 00:03:19.846 20:04:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:19.846 20:04:24 -- setup/hugepages.sh@83 -- # : 0 00:03:19.846 20:04:24 -- setup/hugepages.sh@84 -- # : 0 00:03:19.846 20:04:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.846 20:04:24 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:19.846 20:04:24 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:19.846 20:04:24 -- setup/hugepages.sh@160 -- # setup output 00:03:19.846 20:04:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.846 20:04:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.799 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:20.799 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.799 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.799 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.799 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.799 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.799 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.799 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.799 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.799 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.799 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.799 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.799 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.799 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.799 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.799 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.799 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.064 20:04:25 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:21.064 20:04:25 -- setup/hugepages.sh@89 -- # local node 00:03:21.064 20:04:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.064 20:04:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.064 20:04:25 -- setup/hugepages.sh@92 -- # local surp 00:03:21.064 20:04:25 -- setup/hugepages.sh@93 -- # local resv 00:03:21.064 20:04:25 -- setup/hugepages.sh@94 -- # local anon 00:03:21.064 20:04:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.064 20:04:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.064 20:04:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.064 20:04:25 -- setup/common.sh@18 -- # local node= 00:03:21.064 20:04:25 -- setup/common.sh@19 -- # local var val 00:03:21.064 20:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.064 20:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.064 20:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.064 20:04:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.064 20:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.064 20:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.064 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.064 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.064 20:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44555656 kB' 'MemAvailable: 48870624 kB' 'Buffers: 2708 kB' 'Cached: 11035572 kB' 'SwapCached: 0 kB' 'Active: 7440712 kB' 'Inactive: 4089812 kB' 'Active(anon): 7039592 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495628 kB' 'Mapped: 200608 kB' 'Shmem: 6547348 kB' 'KReclaimable: 468668 kB' 'Slab: 1051928 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583260 kB' 'KernelStack: 12976 kB' 'PageTables: 7920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8118032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199940 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:21.064 20:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.064 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.064 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.064 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.064 20:04:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.064 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.064 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.064 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.065 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.065 20:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.065 20:04:25 -- setup/common.sh@33 -- # echo 0 00:03:21.065 20:04:25 -- setup/common.sh@33 -- # return 0 00:03:21.065 20:04:25 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.065 20:04:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.065 20:04:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.065 20:04:25 -- setup/common.sh@18 -- # local node= 00:03:21.065 20:04:25 -- setup/common.sh@19 -- # local var val 00:03:21.065 20:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.065 20:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.065 20:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.066 20:04:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.066 20:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.066 20:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44555808 kB' 'MemAvailable: 48870776 kB' 'Buffers: 2708 kB' 'Cached: 11035572 kB' 'SwapCached: 0 kB' 'Active: 7440572 kB' 'Inactive: 4089812 kB' 'Active(anon): 7039452 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495500 kB' 'Mapped: 200952 kB' 'Shmem: 6547348 kB' 'KReclaimable: 468668 kB' 'Slab: 1051920 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583252 kB' 'KernelStack: 12928 kB' 'PageTables: 7760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8117108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199904 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.066 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.066 20:04:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:25 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.067 20:04:26 -- setup/common.sh@33 -- # echo 0 00:03:21.067 20:04:26 -- setup/common.sh@33 -- # return 0 00:03:21.067 20:04:26 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.067 20:04:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.067 20:04:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.067 20:04:26 -- setup/common.sh@18 -- # local node= 00:03:21.067 20:04:26 -- setup/common.sh@19 -- # local var val 00:03:21.067 20:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.067 20:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.067 20:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.067 20:04:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.067 20:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.067 20:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44555808 kB' 'MemAvailable: 48870776 kB' 'Buffers: 2708 kB' 'Cached: 11035572 kB' 'SwapCached: 0 kB' 'Active: 7437860 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036740 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492748 kB' 'Mapped: 200488 kB' 'Shmem: 6547348 kB' 'KReclaimable: 468668 kB' 'Slab: 1051996 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583328 kB' 'KernelStack: 12912 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8115540 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199872 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.067 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.067 20:04:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.068 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.068 20:04:26 -- setup/common.sh@33 -- # echo 0 00:03:21.068 20:04:26 -- setup/common.sh@33 -- # return 0 00:03:21.068 20:04:26 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.068 20:04:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:21.068 nr_hugepages=1025 00:03:21.068 20:04:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.068 resv_hugepages=0 00:03:21.068 20:04:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.068 surplus_hugepages=0 00:03:21.068 20:04:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.068 anon_hugepages=0 00:03:21.068 20:04:26 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:21.068 20:04:26 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:21.068 20:04:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.068 20:04:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.068 20:04:26 -- setup/common.sh@18 -- # local node= 00:03:21.068 20:04:26 -- setup/common.sh@19 -- # local var val 00:03:21.068 20:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.068 20:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.068 20:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.068 20:04:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.068 20:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.068 20:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.068 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44556244 kB' 'MemAvailable: 48871212 kB' 'Buffers: 2708 kB' 'Cached: 11035600 kB' 'SwapCached: 0 kB' 'Active: 7441020 kB' 'Inactive: 4089812 kB' 'Active(anon): 7039900 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495916 kB' 'Mapped: 200856 kB' 'Shmem: 6547376 kB' 'KReclaimable: 468668 kB' 'Slab: 1051980 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583312 kB' 'KernelStack: 12880 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8118072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199876 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.069 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.069 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.070 20:04:26 -- setup/common.sh@33 -- # echo 1025 00:03:21.070 20:04:26 -- setup/common.sh@33 -- # return 0 00:03:21.070 20:04:26 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:21.070 20:04:26 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.070 20:04:26 -- setup/hugepages.sh@27 -- # local node 00:03:21.070 20:04:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.070 20:04:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:21.070 20:04:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.070 20:04:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:21.070 20:04:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.070 20:04:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.070 20:04:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.070 20:04:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.070 20:04:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.070 20:04:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.070 20:04:26 -- setup/common.sh@18 -- # local node=0 00:03:21.070 20:04:26 -- setup/common.sh@19 -- # local var val 00:03:21.070 20:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.070 20:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.070 20:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.070 20:04:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.070 20:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.070 20:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20963156 kB' 'MemUsed: 11911768 kB' 'SwapCached: 0 kB' 'Active: 5928232 kB' 'Inactive: 3554096 kB' 'Active(anon): 5720724 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254312 kB' 'Mapped: 103324 kB' 'AnonPages: 231284 kB' 'Shmem: 5492708 kB' 'KernelStack: 7096 kB' 'PageTables: 4676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685128 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 368104 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.070 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.070 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@33 -- # echo 0 00:03:21.071 20:04:26 -- setup/common.sh@33 -- # return 0 00:03:21.071 20:04:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.071 20:04:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.071 20:04:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.071 20:04:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:21.071 20:04:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.071 20:04:26 -- setup/common.sh@18 -- # local node=1 00:03:21.071 20:04:26 -- setup/common.sh@19 -- # local var val 00:03:21.071 20:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.071 20:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.071 20:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:21.071 20:04:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:21.071 20:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.071 20:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23593572 kB' 'MemUsed: 4067176 kB' 'SwapCached: 0 kB' 'Active: 1507132 kB' 'Inactive: 535716 kB' 'Active(anon): 1313520 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1784012 kB' 'Mapped: 96724 kB' 'AnonPages: 259032 kB' 'Shmem: 1054684 kB' 'KernelStack: 5720 kB' 'PageTables: 3028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 151644 kB' 'Slab: 366844 kB' 'SReclaimable: 151644 kB' 'SUnreclaim: 215200 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.071 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.071 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.072 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.072 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # continue 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.332 20:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.332 20:04:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.332 20:04:26 -- setup/common.sh@33 -- # echo 0 00:03:21.332 20:04:26 -- setup/common.sh@33 -- # return 0 00:03:21.332 20:04:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.332 20:04:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.332 20:04:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.332 20:04:26 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:21.332 node0=512 expecting 513 00:03:21.332 20:04:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.332 20:04:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.332 20:04:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.332 20:04:26 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:21.332 node1=513 expecting 512 00:03:21.332 20:04:26 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:21.332 00:03:21.332 real 0m1.462s 00:03:21.332 user 0m0.616s 00:03:21.332 sys 0m0.813s 00:03:21.332 20:04:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.332 20:04:26 -- common/autotest_common.sh@10 -- # set +x 00:03:21.332 ************************************ 00:03:21.332 END TEST odd_alloc 00:03:21.332 ************************************ 00:03:21.332 20:04:26 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:21.332 20:04:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.332 20:04:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.332 20:04:26 -- common/autotest_common.sh@10 -- # set +x 00:03:21.332 ************************************ 00:03:21.332 START TEST custom_alloc 00:03:21.332 ************************************ 00:03:21.332 20:04:26 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:21.332 20:04:26 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:21.332 20:04:26 -- setup/hugepages.sh@169 -- # local node 00:03:21.332 20:04:26 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:21.332 20:04:26 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:21.332 20:04:26 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:21.332 20:04:26 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:21.332 20:04:26 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:21.332 20:04:26 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:21.332 20:04:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:21.332 20:04:26 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:21.332 20:04:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.332 20:04:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:21.332 20:04:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.332 20:04:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.332 20:04:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.332 20:04:26 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:21.332 20:04:26 -- setup/hugepages.sh@83 -- # : 256 00:03:21.332 20:04:26 -- setup/hugepages.sh@84 -- # : 1 00:03:21.332 20:04:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:21.332 20:04:26 -- setup/hugepages.sh@83 -- # : 0 00:03:21.332 20:04:26 -- setup/hugepages.sh@84 -- # : 0 00:03:21.332 20:04:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:21.332 20:04:26 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:21.332 20:04:26 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:21.332 20:04:26 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:21.332 20:04:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:21.332 20:04:26 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:21.332 20:04:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.332 20:04:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.332 20:04:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.332 20:04:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.332 20:04:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.332 20:04:26 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:21.332 20:04:26 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:21.332 20:04:26 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:21.332 20:04:26 -- setup/hugepages.sh@78 -- # return 0 00:03:21.332 20:04:26 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:21.332 20:04:26 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:21.332 20:04:26 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:21.332 20:04:26 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:21.333 20:04:26 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:21.333 20:04:26 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:21.333 20:04:26 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:21.333 20:04:26 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:21.333 20:04:26 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:21.333 20:04:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.333 20:04:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.333 20:04:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.333 20:04:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.333 20:04:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.333 20:04:26 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:21.333 20:04:26 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:21.333 20:04:26 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:21.333 20:04:26 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:21.333 20:04:26 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:21.333 20:04:26 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:21.333 20:04:26 -- setup/hugepages.sh@78 -- # return 0 00:03:21.333 20:04:26 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:21.333 20:04:26 -- setup/hugepages.sh@187 -- # setup output 00:03:21.333 20:04:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.333 20:04:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.265 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.265 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:22.265 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.265 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.265 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.265 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.265 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.265 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.265 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.265 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.265 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.526 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.526 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.526 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.526 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.526 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.526 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.526 20:04:27 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:22.526 20:04:27 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:22.526 20:04:27 -- setup/hugepages.sh@89 -- # local node 00:03:22.526 20:04:27 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.526 20:04:27 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.526 20:04:27 -- setup/hugepages.sh@92 -- # local surp 00:03:22.526 20:04:27 -- setup/hugepages.sh@93 -- # local resv 00:03:22.526 20:04:27 -- setup/hugepages.sh@94 -- # local anon 00:03:22.526 20:04:27 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.526 20:04:27 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.526 20:04:27 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.526 20:04:27 -- setup/common.sh@18 -- # local node= 00:03:22.526 20:04:27 -- setup/common.sh@19 -- # local var val 00:03:22.526 20:04:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.526 20:04:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.526 20:04:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.526 20:04:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.526 20:04:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.526 20:04:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.526 20:04:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43502100 kB' 'MemAvailable: 47817068 kB' 'Buffers: 2708 kB' 'Cached: 11035664 kB' 'SwapCached: 0 kB' 'Active: 7435976 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034856 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490676 kB' 'Mapped: 200204 kB' 'Shmem: 6547440 kB' 'KReclaimable: 468668 kB' 'Slab: 1051788 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583120 kB' 'KernelStack: 12928 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8111828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.526 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.526 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.527 20:04:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.527 20:04:27 -- setup/common.sh@33 -- # echo 0 00:03:22.527 20:04:27 -- setup/common.sh@33 -- # return 0 00:03:22.527 20:04:27 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.527 20:04:27 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.527 20:04:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.527 20:04:27 -- setup/common.sh@18 -- # local node= 00:03:22.527 20:04:27 -- setup/common.sh@19 -- # local var val 00:03:22.527 20:04:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.527 20:04:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.527 20:04:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.527 20:04:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.527 20:04:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.527 20:04:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.527 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43512228 kB' 'MemAvailable: 47827196 kB' 'Buffers: 2708 kB' 'Cached: 11035664 kB' 'SwapCached: 0 kB' 'Active: 7436708 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035588 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491448 kB' 'Mapped: 200104 kB' 'Shmem: 6547440 kB' 'KReclaimable: 468668 kB' 'Slab: 1051772 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583104 kB' 'KernelStack: 12912 kB' 'PageTables: 7916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8111840 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.528 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.528 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.529 20:04:27 -- setup/common.sh@33 -- # echo 0 00:03:22.529 20:04:27 -- setup/common.sh@33 -- # return 0 00:03:22.529 20:04:27 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.529 20:04:27 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.529 20:04:27 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.529 20:04:27 -- setup/common.sh@18 -- # local node= 00:03:22.529 20:04:27 -- setup/common.sh@19 -- # local var val 00:03:22.529 20:04:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.529 20:04:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.529 20:04:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.529 20:04:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.529 20:04:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.529 20:04:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43511976 kB' 'MemAvailable: 47826944 kB' 'Buffers: 2708 kB' 'Cached: 11035672 kB' 'SwapCached: 0 kB' 'Active: 7436048 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034928 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490816 kB' 'Mapped: 200088 kB' 'Shmem: 6547448 kB' 'KReclaimable: 468668 kB' 'Slab: 1051780 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583112 kB' 'KernelStack: 12912 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8111856 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.529 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.529 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.530 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.530 20:04:27 -- setup/common.sh@33 -- # echo 0 00:03:22.530 20:04:27 -- setup/common.sh@33 -- # return 0 00:03:22.530 20:04:27 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.530 20:04:27 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:22.530 nr_hugepages=1536 00:03:22.530 20:04:27 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.530 resv_hugepages=0 00:03:22.530 20:04:27 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.530 surplus_hugepages=0 00:03:22.530 20:04:27 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.530 anon_hugepages=0 00:03:22.530 20:04:27 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:22.530 20:04:27 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:22.530 20:04:27 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.530 20:04:27 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.530 20:04:27 -- setup/common.sh@18 -- # local node= 00:03:22.530 20:04:27 -- setup/common.sh@19 -- # local var val 00:03:22.530 20:04:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.530 20:04:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.530 20:04:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.530 20:04:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.530 20:04:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.530 20:04:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.530 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43511844 kB' 'MemAvailable: 47826812 kB' 'Buffers: 2708 kB' 'Cached: 11035692 kB' 'SwapCached: 0 kB' 'Active: 7435428 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034308 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490112 kB' 'Mapped: 200008 kB' 'Shmem: 6547468 kB' 'KReclaimable: 468668 kB' 'Slab: 1051720 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583052 kB' 'KernelStack: 12896 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8111868 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.531 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.531 20:04:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.791 20:04:27 -- setup/common.sh@33 -- # echo 1536 00:03:22.791 20:04:27 -- setup/common.sh@33 -- # return 0 00:03:22.791 20:04:27 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:22.791 20:04:27 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.791 20:04:27 -- setup/hugepages.sh@27 -- # local node 00:03:22.791 20:04:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.791 20:04:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:22.791 20:04:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.791 20:04:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:22.791 20:04:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.791 20:04:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.791 20:04:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.791 20:04:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.791 20:04:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.791 20:04:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.791 20:04:27 -- setup/common.sh@18 -- # local node=0 00:03:22.791 20:04:27 -- setup/common.sh@19 -- # local var val 00:03:22.791 20:04:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.791 20:04:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.791 20:04:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.791 20:04:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.791 20:04:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.791 20:04:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20955772 kB' 'MemUsed: 11919152 kB' 'SwapCached: 0 kB' 'Active: 5928208 kB' 'Inactive: 3554096 kB' 'Active(anon): 5720700 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254316 kB' 'Mapped: 103280 kB' 'AnonPages: 231132 kB' 'Shmem: 5492712 kB' 'KernelStack: 7128 kB' 'PageTables: 4740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685076 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 368052 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.791 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.791 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@33 -- # echo 0 00:03:22.792 20:04:27 -- setup/common.sh@33 -- # return 0 00:03:22.792 20:04:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.792 20:04:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.792 20:04:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.792 20:04:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:22.792 20:04:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.792 20:04:27 -- setup/common.sh@18 -- # local node=1 00:03:22.792 20:04:27 -- setup/common.sh@19 -- # local var val 00:03:22.792 20:04:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.792 20:04:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.792 20:04:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:22.792 20:04:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:22.792 20:04:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.792 20:04:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22556520 kB' 'MemUsed: 5104228 kB' 'SwapCached: 0 kB' 'Active: 1507284 kB' 'Inactive: 535716 kB' 'Active(anon): 1313672 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1784112 kB' 'Mapped: 96728 kB' 'AnonPages: 258992 kB' 'Shmem: 1054784 kB' 'KernelStack: 5768 kB' 'PageTables: 3096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 151644 kB' 'Slab: 366644 kB' 'SReclaimable: 151644 kB' 'SUnreclaim: 215000 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.792 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.792 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # continue 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.793 20:04:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.793 20:04:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.793 20:04:27 -- setup/common.sh@33 -- # echo 0 00:03:22.793 20:04:27 -- setup/common.sh@33 -- # return 0 00:03:22.793 20:04:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.793 20:04:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.793 20:04:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.793 20:04:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.793 20:04:27 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:22.793 node0=512 expecting 512 00:03:22.793 20:04:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.793 20:04:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.793 20:04:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.793 20:04:27 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:22.793 node1=1024 expecting 1024 00:03:22.793 20:04:27 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:22.793 00:03:22.793 real 0m1.485s 00:03:22.793 user 0m0.616s 00:03:22.793 sys 0m0.835s 00:03:22.793 20:04:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.793 20:04:27 -- common/autotest_common.sh@10 -- # set +x 00:03:22.793 ************************************ 00:03:22.793 END TEST custom_alloc 00:03:22.793 ************************************ 00:03:22.793 20:04:27 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:22.793 20:04:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.793 20:04:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.793 20:04:27 -- common/autotest_common.sh@10 -- # set +x 00:03:22.793 ************************************ 00:03:22.793 START TEST no_shrink_alloc 00:03:22.793 ************************************ 00:03:22.793 20:04:27 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:22.794 20:04:27 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:22.794 20:04:27 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:22.794 20:04:27 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:22.794 20:04:27 -- setup/hugepages.sh@51 -- # shift 00:03:22.794 20:04:27 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:22.794 20:04:27 -- setup/hugepages.sh@52 -- # local node_ids 00:03:22.794 20:04:27 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.794 20:04:27 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:22.794 20:04:27 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:22.794 20:04:27 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:22.794 20:04:27 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.794 20:04:27 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:22.794 20:04:27 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.794 20:04:27 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.794 20:04:27 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.794 20:04:27 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:22.794 20:04:27 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:22.794 20:04:27 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:22.794 20:04:27 -- setup/hugepages.sh@73 -- # return 0 00:03:22.794 20:04:27 -- setup/hugepages.sh@198 -- # setup output 00:03:22.794 20:04:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.794 20:04:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:24.166 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.166 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:24.166 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.166 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.166 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.166 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.166 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.166 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.166 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.166 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.166 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.166 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.166 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.166 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.166 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.166 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.166 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.166 20:04:29 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:24.166 20:04:29 -- setup/hugepages.sh@89 -- # local node 00:03:24.166 20:04:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:24.166 20:04:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:24.166 20:04:29 -- setup/hugepages.sh@92 -- # local surp 00:03:24.166 20:04:29 -- setup/hugepages.sh@93 -- # local resv 00:03:24.166 20:04:29 -- setup/hugepages.sh@94 -- # local anon 00:03:24.166 20:04:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:24.166 20:04:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:24.166 20:04:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:24.166 20:04:29 -- setup/common.sh@18 -- # local node= 00:03:24.166 20:04:29 -- setup/common.sh@19 -- # local var val 00:03:24.166 20:04:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.166 20:04:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.166 20:04:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.166 20:04:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.166 20:04:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.166 20:04:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44549408 kB' 'MemAvailable: 48864376 kB' 'Buffers: 2708 kB' 'Cached: 11035756 kB' 'SwapCached: 0 kB' 'Active: 7435784 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034664 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490292 kB' 'Mapped: 200072 kB' 'Shmem: 6547532 kB' 'KReclaimable: 468668 kB' 'Slab: 1051908 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583240 kB' 'KernelStack: 12880 kB' 'PageTables: 7736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8112052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200032 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.166 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.166 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.167 20:04:29 -- setup/common.sh@33 -- # echo 0 00:03:24.167 20:04:29 -- setup/common.sh@33 -- # return 0 00:03:24.167 20:04:29 -- setup/hugepages.sh@97 -- # anon=0 00:03:24.167 20:04:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:24.167 20:04:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.167 20:04:29 -- setup/common.sh@18 -- # local node= 00:03:24.167 20:04:29 -- setup/common.sh@19 -- # local var val 00:03:24.167 20:04:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.167 20:04:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.167 20:04:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.167 20:04:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.167 20:04:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.167 20:04:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.167 20:04:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44556424 kB' 'MemAvailable: 48871392 kB' 'Buffers: 2708 kB' 'Cached: 11035760 kB' 'SwapCached: 0 kB' 'Active: 7436076 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034956 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490632 kB' 'Mapped: 200072 kB' 'Shmem: 6547536 kB' 'KReclaimable: 468668 kB' 'Slab: 1051884 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583216 kB' 'KernelStack: 12880 kB' 'PageTables: 7696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8112064 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199984 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.167 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.167 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.168 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.168 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.169 20:04:29 -- setup/common.sh@33 -- # echo 0 00:03:24.169 20:04:29 -- setup/common.sh@33 -- # return 0 00:03:24.169 20:04:29 -- setup/hugepages.sh@99 -- # surp=0 00:03:24.169 20:04:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:24.169 20:04:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:24.169 20:04:29 -- setup/common.sh@18 -- # local node= 00:03:24.169 20:04:29 -- setup/common.sh@19 -- # local var val 00:03:24.169 20:04:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.169 20:04:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.169 20:04:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.169 20:04:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.169 20:04:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.169 20:04:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44555104 kB' 'MemAvailable: 48870072 kB' 'Buffers: 2708 kB' 'Cached: 11035764 kB' 'SwapCached: 0 kB' 'Active: 7435668 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034548 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490288 kB' 'Mapped: 200896 kB' 'Shmem: 6547540 kB' 'KReclaimable: 468668 kB' 'Slab: 1051920 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583252 kB' 'KernelStack: 12960 kB' 'PageTables: 7916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8114508 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200000 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.169 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.169 20:04:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.170 20:04:29 -- setup/common.sh@33 -- # echo 0 00:03:24.170 20:04:29 -- setup/common.sh@33 -- # return 0 00:03:24.170 20:04:29 -- setup/hugepages.sh@100 -- # resv=0 00:03:24.170 20:04:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:24.170 nr_hugepages=1024 00:03:24.170 20:04:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:24.170 resv_hugepages=0 00:03:24.170 20:04:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:24.170 surplus_hugepages=0 00:03:24.170 20:04:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:24.170 anon_hugepages=0 00:03:24.170 20:04:29 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.170 20:04:29 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:24.170 20:04:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:24.170 20:04:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:24.170 20:04:29 -- setup/common.sh@18 -- # local node= 00:03:24.170 20:04:29 -- setup/common.sh@19 -- # local var val 00:03:24.170 20:04:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.170 20:04:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.170 20:04:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.170 20:04:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.170 20:04:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.170 20:04:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44554172 kB' 'MemAvailable: 48869140 kB' 'Buffers: 2708 kB' 'Cached: 11035784 kB' 'SwapCached: 0 kB' 'Active: 7435756 kB' 'Inactive: 4089812 kB' 'Active(anon): 7034636 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490348 kB' 'Mapped: 200024 kB' 'Shmem: 6547560 kB' 'KReclaimable: 468668 kB' 'Slab: 1051920 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583252 kB' 'KernelStack: 12944 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8112096 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199952 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.170 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.170 20:04:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.171 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.171 20:04:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.172 20:04:29 -- setup/common.sh@33 -- # echo 1024 00:03:24.172 20:04:29 -- setup/common.sh@33 -- # return 0 00:03:24.172 20:04:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.172 20:04:29 -- setup/hugepages.sh@112 -- # get_nodes 00:03:24.172 20:04:29 -- setup/hugepages.sh@27 -- # local node 00:03:24.172 20:04:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.172 20:04:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:24.172 20:04:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.172 20:04:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:24.172 20:04:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:24.172 20:04:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:24.172 20:04:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:24.172 20:04:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:24.172 20:04:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:24.172 20:04:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.172 20:04:29 -- setup/common.sh@18 -- # local node=0 00:03:24.172 20:04:29 -- setup/common.sh@19 -- # local var val 00:03:24.172 20:04:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.172 20:04:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.172 20:04:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:24.172 20:04:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:24.172 20:04:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.172 20:04:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19908060 kB' 'MemUsed: 12966864 kB' 'SwapCached: 0 kB' 'Active: 5928828 kB' 'Inactive: 3554096 kB' 'Active(anon): 5721320 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254324 kB' 'Mapped: 103280 kB' 'AnonPages: 231752 kB' 'Shmem: 5492720 kB' 'KernelStack: 7208 kB' 'PageTables: 4916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685196 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 368172 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.172 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.172 20:04:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # continue 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 20:04:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 20:04:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 20:04:29 -- setup/common.sh@33 -- # echo 0 00:03:24.173 20:04:29 -- setup/common.sh@33 -- # return 0 00:03:24.173 20:04:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.173 20:04:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.173 20:04:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.173 20:04:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.173 20:04:29 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:24.173 node0=1024 expecting 1024 00:03:24.173 20:04:29 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:24.173 20:04:29 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:24.173 20:04:29 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:24.173 20:04:29 -- setup/hugepages.sh@202 -- # setup output 00:03:24.173 20:04:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:24.173 20:04:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.551 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.551 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:25.551 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.551 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.551 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.551 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.551 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.551 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.551 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.551 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.551 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.551 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.551 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.551 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.551 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.551 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.551 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.551 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:25.551 20:04:30 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:25.551 20:04:30 -- setup/hugepages.sh@89 -- # local node 00:03:25.551 20:04:30 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:25.551 20:04:30 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:25.551 20:04:30 -- setup/hugepages.sh@92 -- # local surp 00:03:25.551 20:04:30 -- setup/hugepages.sh@93 -- # local resv 00:03:25.551 20:04:30 -- setup/hugepages.sh@94 -- # local anon 00:03:25.551 20:04:30 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:25.551 20:04:30 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:25.551 20:04:30 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:25.551 20:04:30 -- setup/common.sh@18 -- # local node= 00:03:25.551 20:04:30 -- setup/common.sh@19 -- # local var val 00:03:25.551 20:04:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.551 20:04:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.551 20:04:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.551 20:04:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.551 20:04:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.551 20:04:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44529436 kB' 'MemAvailable: 48843900 kB' 'Buffers: 2708 kB' 'Cached: 11035836 kB' 'SwapCached: 0 kB' 'Active: 7437420 kB' 'Inactive: 4089812 kB' 'Active(anon): 7036300 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492136 kB' 'Mapped: 200132 kB' 'Shmem: 6547612 kB' 'KReclaimable: 468668 kB' 'Slab: 1051896 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583228 kB' 'KernelStack: 13312 kB' 'PageTables: 8616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8114940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200240 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.551 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.551 20:04:30 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.552 20:04:30 -- setup/common.sh@33 -- # echo 0 00:03:25.552 20:04:30 -- setup/common.sh@33 -- # return 0 00:03:25.552 20:04:30 -- setup/hugepages.sh@97 -- # anon=0 00:03:25.552 20:04:30 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:25.552 20:04:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.552 20:04:30 -- setup/common.sh@18 -- # local node= 00:03:25.552 20:04:30 -- setup/common.sh@19 -- # local var val 00:03:25.552 20:04:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.552 20:04:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.552 20:04:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.552 20:04:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.552 20:04:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.552 20:04:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44539444 kB' 'MemAvailable: 48854412 kB' 'Buffers: 2708 kB' 'Cached: 11035840 kB' 'SwapCached: 0 kB' 'Active: 7436924 kB' 'Inactive: 4089812 kB' 'Active(anon): 7035804 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491476 kB' 'Mapped: 200132 kB' 'Shmem: 6547616 kB' 'KReclaimable: 468668 kB' 'Slab: 1052024 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583356 kB' 'KernelStack: 13168 kB' 'PageTables: 8556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8114940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200192 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.552 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.552 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.553 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.553 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.554 20:04:30 -- setup/common.sh@33 -- # echo 0 00:03:25.554 20:04:30 -- setup/common.sh@33 -- # return 0 00:03:25.554 20:04:30 -- setup/hugepages.sh@99 -- # surp=0 00:03:25.554 20:04:30 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:25.554 20:04:30 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:25.554 20:04:30 -- setup/common.sh@18 -- # local node= 00:03:25.554 20:04:30 -- setup/common.sh@19 -- # local var val 00:03:25.554 20:04:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.554 20:04:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.554 20:04:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.554 20:04:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.554 20:04:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.554 20:04:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44537852 kB' 'MemAvailable: 48852820 kB' 'Buffers: 2708 kB' 'Cached: 11035856 kB' 'SwapCached: 0 kB' 'Active: 7438924 kB' 'Inactive: 4089812 kB' 'Active(anon): 7037804 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493444 kB' 'Mapped: 200468 kB' 'Shmem: 6547632 kB' 'KReclaimable: 468668 kB' 'Slab: 1052016 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583348 kB' 'KernelStack: 12896 kB' 'PageTables: 7668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8116028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.554 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.554 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.555 20:04:30 -- setup/common.sh@33 -- # echo 0 00:03:25.555 20:04:30 -- setup/common.sh@33 -- # return 0 00:03:25.555 20:04:30 -- setup/hugepages.sh@100 -- # resv=0 00:03:25.555 20:04:30 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:25.555 nr_hugepages=1024 00:03:25.555 20:04:30 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:25.555 resv_hugepages=0 00:03:25.555 20:04:30 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:25.555 surplus_hugepages=0 00:03:25.555 20:04:30 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:25.555 anon_hugepages=0 00:03:25.555 20:04:30 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.555 20:04:30 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:25.555 20:04:30 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:25.555 20:04:30 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:25.555 20:04:30 -- setup/common.sh@18 -- # local node= 00:03:25.555 20:04:30 -- setup/common.sh@19 -- # local var val 00:03:25.555 20:04:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.555 20:04:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.555 20:04:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.555 20:04:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.555 20:04:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.555 20:04:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44534480 kB' 'MemAvailable: 48849448 kB' 'Buffers: 2708 kB' 'Cached: 11035868 kB' 'SwapCached: 0 kB' 'Active: 7441120 kB' 'Inactive: 4089812 kB' 'Active(anon): 7040000 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495648 kB' 'Mapped: 200812 kB' 'Shmem: 6547644 kB' 'KReclaimable: 468668 kB' 'Slab: 1052016 kB' 'SReclaimable: 468668 kB' 'SUnreclaim: 583348 kB' 'KernelStack: 12928 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8118432 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199972 kB' 'VmallocChunk: 0 kB' 'Percpu: 41280 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2547292 kB' 'DirectMap2M: 18343936 kB' 'DirectMap1G: 49283072 kB' 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.555 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.555 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.556 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.556 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.557 20:04:30 -- setup/common.sh@33 -- # echo 1024 00:03:25.557 20:04:30 -- setup/common.sh@33 -- # return 0 00:03:25.557 20:04:30 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.557 20:04:30 -- setup/hugepages.sh@112 -- # get_nodes 00:03:25.557 20:04:30 -- setup/hugepages.sh@27 -- # local node 00:03:25.557 20:04:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.557 20:04:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:25.557 20:04:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.557 20:04:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:25.557 20:04:30 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:25.557 20:04:30 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:25.557 20:04:30 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.557 20:04:30 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.557 20:04:30 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:25.557 20:04:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.557 20:04:30 -- setup/common.sh@18 -- # local node=0 00:03:25.557 20:04:30 -- setup/common.sh@19 -- # local var val 00:03:25.557 20:04:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.557 20:04:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.557 20:04:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:25.557 20:04:30 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:25.557 20:04:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.557 20:04:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19918748 kB' 'MemUsed: 12956176 kB' 'SwapCached: 0 kB' 'Active: 5927660 kB' 'Inactive: 3554096 kB' 'Active(anon): 5720152 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9254336 kB' 'Mapped: 103632 kB' 'AnonPages: 230632 kB' 'Shmem: 5492732 kB' 'KernelStack: 7192 kB' 'PageTables: 4832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317024 kB' 'Slab: 685284 kB' 'SReclaimable: 317024 kB' 'SUnreclaim: 368260 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.557 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.557 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # continue 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.558 20:04:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.558 20:04:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.558 20:04:30 -- setup/common.sh@33 -- # echo 0 00:03:25.558 20:04:30 -- setup/common.sh@33 -- # return 0 00:03:25.558 20:04:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.558 20:04:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.558 20:04:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.558 20:04:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.558 20:04:30 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:25.558 node0=1024 expecting 1024 00:03:25.558 20:04:30 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:25.558 00:03:25.558 real 0m2.937s 00:03:25.558 user 0m1.203s 00:03:25.558 sys 0m1.668s 00:03:25.558 20:04:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.558 20:04:30 -- common/autotest_common.sh@10 -- # set +x 00:03:25.558 ************************************ 00:03:25.558 END TEST no_shrink_alloc 00:03:25.558 ************************************ 00:03:25.816 20:04:30 -- setup/hugepages.sh@217 -- # clear_hp 00:03:25.816 20:04:30 -- setup/hugepages.sh@37 -- # local node hp 00:03:25.816 20:04:30 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:25.816 20:04:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:25.816 20:04:30 -- setup/hugepages.sh@41 -- # echo 0 00:03:25.816 20:04:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:25.816 20:04:30 -- setup/hugepages.sh@41 -- # echo 0 00:03:25.816 20:04:30 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:25.817 20:04:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:25.817 20:04:30 -- setup/hugepages.sh@41 -- # echo 0 00:03:25.817 20:04:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:25.817 20:04:30 -- setup/hugepages.sh@41 -- # echo 0 00:03:25.817 20:04:30 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:25.817 20:04:30 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:25.817 00:03:25.817 real 0m11.653s 00:03:25.817 user 0m4.504s 00:03:25.817 sys 0m6.105s 00:03:25.817 20:04:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.817 20:04:30 -- common/autotest_common.sh@10 -- # set +x 00:03:25.817 ************************************ 00:03:25.817 END TEST hugepages 00:03:25.817 ************************************ 00:03:25.817 20:04:30 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:25.817 20:04:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.817 20:04:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.817 20:04:30 -- common/autotest_common.sh@10 -- # set +x 00:03:25.817 ************************************ 00:03:25.817 START TEST driver 00:03:25.817 ************************************ 00:03:25.817 20:04:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:25.817 * Looking for test storage... 00:03:25.817 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:25.817 20:04:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:25.817 20:04:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:25.817 20:04:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:25.817 20:04:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:25.817 20:04:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:25.817 20:04:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:25.817 20:04:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:25.817 20:04:30 -- scripts/common.sh@335 -- # IFS=.-: 00:03:25.817 20:04:30 -- scripts/common.sh@335 -- # read -ra ver1 00:03:25.817 20:04:30 -- scripts/common.sh@336 -- # IFS=.-: 00:03:25.817 20:04:30 -- scripts/common.sh@336 -- # read -ra ver2 00:03:25.817 20:04:30 -- scripts/common.sh@337 -- # local 'op=<' 00:03:25.817 20:04:30 -- scripts/common.sh@339 -- # ver1_l=2 00:03:25.817 20:04:30 -- scripts/common.sh@340 -- # ver2_l=1 00:03:25.817 20:04:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:25.817 20:04:30 -- scripts/common.sh@343 -- # case "$op" in 00:03:25.817 20:04:30 -- scripts/common.sh@344 -- # : 1 00:03:25.817 20:04:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:25.817 20:04:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:25.817 20:04:30 -- scripts/common.sh@364 -- # decimal 1 00:03:25.817 20:04:30 -- scripts/common.sh@352 -- # local d=1 00:03:25.817 20:04:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:25.817 20:04:30 -- scripts/common.sh@354 -- # echo 1 00:03:25.817 20:04:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:25.817 20:04:30 -- scripts/common.sh@365 -- # decimal 2 00:03:25.817 20:04:30 -- scripts/common.sh@352 -- # local d=2 00:03:25.817 20:04:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:25.817 20:04:30 -- scripts/common.sh@354 -- # echo 2 00:03:25.817 20:04:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:25.817 20:04:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:25.817 20:04:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:25.817 20:04:30 -- scripts/common.sh@367 -- # return 0 00:03:25.817 20:04:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:25.817 20:04:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:25.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:25.817 --rc genhtml_branch_coverage=1 00:03:25.817 --rc genhtml_function_coverage=1 00:03:25.817 --rc genhtml_legend=1 00:03:25.817 --rc geninfo_all_blocks=1 00:03:25.817 --rc geninfo_unexecuted_blocks=1 00:03:25.817 00:03:25.817 ' 00:03:25.817 20:04:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:25.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:25.817 --rc genhtml_branch_coverage=1 00:03:25.817 --rc genhtml_function_coverage=1 00:03:25.817 --rc genhtml_legend=1 00:03:25.817 --rc geninfo_all_blocks=1 00:03:25.817 --rc geninfo_unexecuted_blocks=1 00:03:25.817 00:03:25.817 ' 00:03:25.817 20:04:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:25.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:25.817 --rc genhtml_branch_coverage=1 00:03:25.817 --rc genhtml_function_coverage=1 00:03:25.817 --rc genhtml_legend=1 00:03:25.817 --rc geninfo_all_blocks=1 00:03:25.817 --rc geninfo_unexecuted_blocks=1 00:03:25.817 00:03:25.817 ' 00:03:25.817 20:04:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:25.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:25.817 --rc genhtml_branch_coverage=1 00:03:25.817 --rc genhtml_function_coverage=1 00:03:25.817 --rc genhtml_legend=1 00:03:25.817 --rc geninfo_all_blocks=1 00:03:25.817 --rc geninfo_unexecuted_blocks=1 00:03:25.817 00:03:25.817 ' 00:03:25.817 20:04:30 -- setup/driver.sh@68 -- # setup reset 00:03:25.817 20:04:30 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:25.817 20:04:30 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:28.349 20:04:33 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:28.349 20:04:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.349 20:04:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.349 20:04:33 -- common/autotest_common.sh@10 -- # set +x 00:03:28.349 ************************************ 00:03:28.349 START TEST guess_driver 00:03:28.349 ************************************ 00:03:28.349 20:04:33 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:28.349 20:04:33 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:28.349 20:04:33 -- setup/driver.sh@47 -- # local fail=0 00:03:28.349 20:04:33 -- setup/driver.sh@49 -- # pick_driver 00:03:28.349 20:04:33 -- setup/driver.sh@36 -- # vfio 00:03:28.349 20:04:33 -- setup/driver.sh@21 -- # local iommu_grups 00:03:28.349 20:04:33 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:28.349 20:04:33 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:28.349 20:04:33 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:28.349 20:04:33 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:28.349 20:04:33 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:28.349 20:04:33 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:28.349 20:04:33 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:28.349 20:04:33 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:28.349 20:04:33 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:28.349 20:04:33 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:28.349 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:28.349 20:04:33 -- setup/driver.sh@30 -- # return 0 00:03:28.349 20:04:33 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:28.349 20:04:33 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:28.350 20:04:33 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:28.350 20:04:33 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:28.350 Looking for driver=vfio-pci 00:03:28.350 20:04:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.350 20:04:33 -- setup/driver.sh@45 -- # setup output config 00:03:28.350 20:04:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.350 20:04:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.725 20:04:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.725 20:04:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.725 20:04:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.660 20:04:35 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.660 20:04:35 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.660 20:04:35 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.660 20:04:35 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:30.660 20:04:35 -- setup/driver.sh@65 -- # setup reset 00:03:30.660 20:04:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:30.660 20:04:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:33.281 00:03:33.281 real 0m4.960s 00:03:33.281 user 0m1.143s 00:03:33.281 sys 0m1.995s 00:03:33.281 20:04:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:33.281 20:04:38 -- common/autotest_common.sh@10 -- # set +x 00:03:33.281 ************************************ 00:03:33.281 END TEST guess_driver 00:03:33.281 ************************************ 00:03:33.281 00:03:33.281 real 0m7.620s 00:03:33.281 user 0m1.807s 00:03:33.281 sys 0m3.063s 00:03:33.281 20:04:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:33.281 20:04:38 -- common/autotest_common.sh@10 -- # set +x 00:03:33.281 ************************************ 00:03:33.281 END TEST driver 00:03:33.281 ************************************ 00:03:33.281 20:04:38 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:33.281 20:04:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.281 20:04:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.281 20:04:38 -- common/autotest_common.sh@10 -- # set +x 00:03:33.281 ************************************ 00:03:33.281 START TEST devices 00:03:33.281 ************************************ 00:03:33.281 20:04:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:33.540 * Looking for test storage... 00:03:33.540 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:33.540 20:04:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:33.540 20:04:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:33.540 20:04:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:33.540 20:04:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:33.540 20:04:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:33.540 20:04:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:33.540 20:04:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:33.540 20:04:38 -- scripts/common.sh@335 -- # IFS=.-: 00:03:33.540 20:04:38 -- scripts/common.sh@335 -- # read -ra ver1 00:03:33.540 20:04:38 -- scripts/common.sh@336 -- # IFS=.-: 00:03:33.540 20:04:38 -- scripts/common.sh@336 -- # read -ra ver2 00:03:33.541 20:04:38 -- scripts/common.sh@337 -- # local 'op=<' 00:03:33.541 20:04:38 -- scripts/common.sh@339 -- # ver1_l=2 00:03:33.541 20:04:38 -- scripts/common.sh@340 -- # ver2_l=1 00:03:33.541 20:04:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:33.541 20:04:38 -- scripts/common.sh@343 -- # case "$op" in 00:03:33.541 20:04:38 -- scripts/common.sh@344 -- # : 1 00:03:33.541 20:04:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:33.541 20:04:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:33.541 20:04:38 -- scripts/common.sh@364 -- # decimal 1 00:03:33.541 20:04:38 -- scripts/common.sh@352 -- # local d=1 00:03:33.541 20:04:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:33.541 20:04:38 -- scripts/common.sh@354 -- # echo 1 00:03:33.541 20:04:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:33.541 20:04:38 -- scripts/common.sh@365 -- # decimal 2 00:03:33.541 20:04:38 -- scripts/common.sh@352 -- # local d=2 00:03:33.541 20:04:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:33.541 20:04:38 -- scripts/common.sh@354 -- # echo 2 00:03:33.541 20:04:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:33.541 20:04:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:33.541 20:04:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:33.541 20:04:38 -- scripts/common.sh@367 -- # return 0 00:03:33.541 20:04:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:33.541 20:04:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:33.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.541 --rc genhtml_branch_coverage=1 00:03:33.541 --rc genhtml_function_coverage=1 00:03:33.541 --rc genhtml_legend=1 00:03:33.541 --rc geninfo_all_blocks=1 00:03:33.541 --rc geninfo_unexecuted_blocks=1 00:03:33.541 00:03:33.541 ' 00:03:33.541 20:04:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:33.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.541 --rc genhtml_branch_coverage=1 00:03:33.541 --rc genhtml_function_coverage=1 00:03:33.541 --rc genhtml_legend=1 00:03:33.541 --rc geninfo_all_blocks=1 00:03:33.541 --rc geninfo_unexecuted_blocks=1 00:03:33.541 00:03:33.541 ' 00:03:33.541 20:04:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:33.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.541 --rc genhtml_branch_coverage=1 00:03:33.541 --rc genhtml_function_coverage=1 00:03:33.541 --rc genhtml_legend=1 00:03:33.541 --rc geninfo_all_blocks=1 00:03:33.541 --rc geninfo_unexecuted_blocks=1 00:03:33.541 00:03:33.541 ' 00:03:33.541 20:04:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:33.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.541 --rc genhtml_branch_coverage=1 00:03:33.541 --rc genhtml_function_coverage=1 00:03:33.541 --rc genhtml_legend=1 00:03:33.541 --rc geninfo_all_blocks=1 00:03:33.541 --rc geninfo_unexecuted_blocks=1 00:03:33.541 00:03:33.541 ' 00:03:33.541 20:04:38 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:33.541 20:04:38 -- setup/devices.sh@192 -- # setup reset 00:03:33.541 20:04:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:33.541 20:04:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:34.916 20:04:39 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:34.916 20:04:39 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:34.916 20:04:39 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:34.916 20:04:39 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:34.916 20:04:39 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:34.916 20:04:39 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:34.916 20:04:39 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:34.916 20:04:39 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:34.916 20:04:39 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:34.916 20:04:39 -- setup/devices.sh@196 -- # blocks=() 00:03:34.916 20:04:39 -- setup/devices.sh@196 -- # declare -a blocks 00:03:34.916 20:04:39 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:34.916 20:04:39 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:34.916 20:04:39 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:34.916 20:04:39 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:34.916 20:04:39 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:34.916 20:04:39 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:34.916 20:04:39 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:34.916 20:04:39 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:34.916 20:04:39 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:34.916 20:04:39 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:34.916 20:04:39 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:34.916 No valid GPT data, bailing 00:03:34.916 20:04:39 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:34.916 20:04:39 -- scripts/common.sh@393 -- # pt= 00:03:34.917 20:04:39 -- scripts/common.sh@394 -- # return 1 00:03:34.917 20:04:39 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:34.917 20:04:39 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:34.917 20:04:39 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:34.917 20:04:39 -- setup/common.sh@80 -- # echo 1000204886016 00:03:34.917 20:04:39 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:34.917 20:04:39 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:34.917 20:04:39 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:34.917 20:04:39 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:34.917 20:04:39 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:34.917 20:04:39 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:34.917 20:04:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:34.917 20:04:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:34.917 20:04:39 -- common/autotest_common.sh@10 -- # set +x 00:03:34.917 ************************************ 00:03:34.917 START TEST nvme_mount 00:03:34.917 ************************************ 00:03:34.917 20:04:39 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:34.917 20:04:39 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:34.917 20:04:39 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:34.917 20:04:39 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.917 20:04:39 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.917 20:04:39 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:34.917 20:04:39 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:34.917 20:04:39 -- setup/common.sh@40 -- # local part_no=1 00:03:34.917 20:04:39 -- setup/common.sh@41 -- # local size=1073741824 00:03:34.917 20:04:39 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:34.917 20:04:39 -- setup/common.sh@44 -- # parts=() 00:03:34.917 20:04:39 -- setup/common.sh@44 -- # local parts 00:03:34.917 20:04:39 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:34.917 20:04:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.917 20:04:39 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:34.917 20:04:39 -- setup/common.sh@46 -- # (( part++ )) 00:03:34.917 20:04:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.917 20:04:39 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:34.917 20:04:39 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:34.917 20:04:39 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:35.852 Creating new GPT entries in memory. 00:03:35.852 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:35.852 other utilities. 00:03:35.852 20:04:40 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:35.852 20:04:40 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:35.852 20:04:40 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:35.852 20:04:40 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:35.853 20:04:40 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:37.228 Creating new GPT entries in memory. 00:03:37.228 The operation has completed successfully. 00:03:37.228 20:04:41 -- setup/common.sh@57 -- # (( part++ )) 00:03:37.228 20:04:41 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:37.228 20:04:41 -- setup/common.sh@62 -- # wait 3024170 00:03:37.228 20:04:41 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.228 20:04:41 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:37.228 20:04:41 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.228 20:04:41 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:37.228 20:04:41 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:37.228 20:04:41 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.228 20:04:42 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.228 20:04:42 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:37.228 20:04:42 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:37.228 20:04:42 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.228 20:04:42 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.228 20:04:42 -- setup/devices.sh@53 -- # local found=0 00:03:37.228 20:04:42 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.228 20:04:42 -- setup/devices.sh@56 -- # : 00:03:37.228 20:04:42 -- setup/devices.sh@59 -- # local pci status 00:03:37.228 20:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.228 20:04:42 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:37.228 20:04:42 -- setup/devices.sh@47 -- # setup output config 00:03:37.228 20:04:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.228 20:04:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:38.160 20:04:43 -- setup/devices.sh@63 -- # found=1 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.160 20:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.160 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.418 20:04:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.418 20:04:43 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:38.418 20:04:43 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.418 20:04:43 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:38.418 20:04:43 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:38.418 20:04:43 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:38.418 20:04:43 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.418 20:04:43 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.418 20:04:43 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.418 20:04:43 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:38.418 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:38.418 20:04:43 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.418 20:04:43 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:38.675 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:38.675 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:38.675 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:38.675 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:38.675 20:04:43 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:38.675 20:04:43 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:38.675 20:04:43 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.675 20:04:43 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:38.675 20:04:43 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:38.675 20:04:43 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.675 20:04:43 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:38.675 20:04:43 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:38.675 20:04:43 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:38.675 20:04:43 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.675 20:04:43 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:38.675 20:04:43 -- setup/devices.sh@53 -- # local found=0 00:03:38.675 20:04:43 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:38.675 20:04:43 -- setup/devices.sh@56 -- # : 00:03:38.675 20:04:43 -- setup/devices.sh@59 -- # local pci status 00:03:38.675 20:04:43 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:38.675 20:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.675 20:04:43 -- setup/devices.sh@47 -- # setup output config 00:03:38.676 20:04:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.676 20:04:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:40.050 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.050 20:04:44 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:40.050 20:04:44 -- setup/devices.sh@63 -- # found=1 00:03:40.050 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.050 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.050 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.050 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.050 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.050 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.050 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.051 20:04:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:44 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:40.051 20:04:44 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:40.051 20:04:44 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.051 20:04:44 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:40.051 20:04:44 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:40.051 20:04:44 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.051 20:04:44 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:40.051 20:04:44 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:40.051 20:04:44 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:40.051 20:04:44 -- setup/devices.sh@50 -- # local mount_point= 00:03:40.051 20:04:44 -- setup/devices.sh@51 -- # local test_file= 00:03:40.051 20:04:44 -- setup/devices.sh@53 -- # local found=0 00:03:40.051 20:04:44 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:40.051 20:04:44 -- setup/devices.sh@59 -- # local pci status 00:03:40.051 20:04:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.051 20:04:45 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:40.051 20:04:45 -- setup/devices.sh@47 -- # setup output config 00:03:40.051 20:04:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:40.051 20:04:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:41.424 20:04:46 -- setup/devices.sh@63 -- # found=1 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.424 20:04:46 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:41.424 20:04:46 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:41.424 20:04:46 -- setup/devices.sh@68 -- # return 0 00:03:41.424 20:04:46 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:41.424 20:04:46 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.424 20:04:46 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:41.424 20:04:46 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:41.424 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:41.424 00:03:41.424 real 0m6.468s 00:03:41.424 user 0m1.514s 00:03:41.424 sys 0m2.514s 00:03:41.424 20:04:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.424 20:04:46 -- common/autotest_common.sh@10 -- # set +x 00:03:41.424 ************************************ 00:03:41.424 END TEST nvme_mount 00:03:41.424 ************************************ 00:03:41.424 20:04:46 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:41.424 20:04:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.424 20:04:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.424 20:04:46 -- common/autotest_common.sh@10 -- # set +x 00:03:41.424 ************************************ 00:03:41.424 START TEST dm_mount 00:03:41.424 ************************************ 00:03:41.424 20:04:46 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:41.424 20:04:46 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:41.424 20:04:46 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:41.424 20:04:46 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:41.424 20:04:46 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:41.424 20:04:46 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:41.424 20:04:46 -- setup/common.sh@40 -- # local part_no=2 00:03:41.424 20:04:46 -- setup/common.sh@41 -- # local size=1073741824 00:03:41.424 20:04:46 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:41.424 20:04:46 -- setup/common.sh@44 -- # parts=() 00:03:41.424 20:04:46 -- setup/common.sh@44 -- # local parts 00:03:41.424 20:04:46 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:41.424 20:04:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.424 20:04:46 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:41.424 20:04:46 -- setup/common.sh@46 -- # (( part++ )) 00:03:41.424 20:04:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.424 20:04:46 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:41.424 20:04:46 -- setup/common.sh@46 -- # (( part++ )) 00:03:41.424 20:04:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.424 20:04:46 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:41.424 20:04:46 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:41.424 20:04:46 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:42.359 Creating new GPT entries in memory. 00:03:42.359 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:42.359 other utilities. 00:03:42.359 20:04:47 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:42.359 20:04:47 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:42.359 20:04:47 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:42.359 20:04:47 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:42.359 20:04:47 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:43.733 Creating new GPT entries in memory. 00:03:43.733 The operation has completed successfully. 00:03:43.733 20:04:48 -- setup/common.sh@57 -- # (( part++ )) 00:03:43.733 20:04:48 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:43.733 20:04:48 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:43.733 20:04:48 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:43.733 20:04:48 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:44.669 The operation has completed successfully. 00:03:44.669 20:04:49 -- setup/common.sh@57 -- # (( part++ )) 00:03:44.669 20:04:49 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:44.669 20:04:49 -- setup/common.sh@62 -- # wait 3026631 00:03:44.669 20:04:49 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:44.669 20:04:49 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.669 20:04:49 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:44.669 20:04:49 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:44.669 20:04:49 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:44.669 20:04:49 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:44.669 20:04:49 -- setup/devices.sh@161 -- # break 00:03:44.669 20:04:49 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:44.669 20:04:49 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:44.669 20:04:49 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:44.669 20:04:49 -- setup/devices.sh@166 -- # dm=dm-0 00:03:44.669 20:04:49 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:44.669 20:04:49 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:44.670 20:04:49 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.670 20:04:49 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:44.670 20:04:49 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.670 20:04:49 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:44.670 20:04:49 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:44.670 20:04:49 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.670 20:04:49 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:44.670 20:04:49 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:44.670 20:04:49 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:44.670 20:04:49 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.670 20:04:49 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:44.670 20:04:49 -- setup/devices.sh@53 -- # local found=0 00:03:44.670 20:04:49 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:44.670 20:04:49 -- setup/devices.sh@56 -- # : 00:03:44.670 20:04:49 -- setup/devices.sh@59 -- # local pci status 00:03:44.670 20:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.670 20:04:49 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:44.670 20:04:49 -- setup/devices.sh@47 -- # setup output config 00:03:44.670 20:04:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:44.670 20:04:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:45.606 20:04:50 -- setup/devices.sh@63 -- # found=1 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.606 20:04:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.606 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.866 20:04:50 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:45.866 20:04:50 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:45.866 20:04:50 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.866 20:04:50 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:45.866 20:04:50 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:45.866 20:04:50 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.866 20:04:50 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:45.866 20:04:50 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:45.866 20:04:50 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:45.866 20:04:50 -- setup/devices.sh@50 -- # local mount_point= 00:03:45.866 20:04:50 -- setup/devices.sh@51 -- # local test_file= 00:03:45.866 20:04:50 -- setup/devices.sh@53 -- # local found=0 00:03:45.866 20:04:50 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:45.866 20:04:50 -- setup/devices.sh@59 -- # local pci status 00:03:45.866 20:04:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.866 20:04:50 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:45.866 20:04:50 -- setup/devices.sh@47 -- # setup output config 00:03:45.866 20:04:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.866 20:04:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:46.802 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.802 20:04:51 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:46.803 20:04:51 -- setup/devices.sh@63 -- # found=1 00:03:46.803 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.803 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.803 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.803 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.803 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.803 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.803 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.803 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.803 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.061 20:04:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.061 20:04:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:47.061 20:04:52 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:47.061 20:04:52 -- setup/devices.sh@68 -- # return 0 00:03:47.061 20:04:52 -- setup/devices.sh@187 -- # cleanup_dm 00:03:47.061 20:04:52 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:47.061 20:04:52 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:47.061 20:04:52 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:47.320 20:04:52 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:47.320 20:04:52 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:47.320 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:47.320 20:04:52 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:47.320 20:04:52 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:47.320 00:03:47.320 real 0m5.772s 00:03:47.320 user 0m0.980s 00:03:47.320 sys 0m1.655s 00:03:47.320 20:04:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.320 20:04:52 -- common/autotest_common.sh@10 -- # set +x 00:03:47.320 ************************************ 00:03:47.320 END TEST dm_mount 00:03:47.320 ************************************ 00:03:47.320 20:04:52 -- setup/devices.sh@1 -- # cleanup 00:03:47.320 20:04:52 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:47.320 20:04:52 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.320 20:04:52 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:47.320 20:04:52 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:47.320 20:04:52 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:47.320 20:04:52 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:47.579 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:47.579 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:47.579 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:47.579 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:47.579 20:04:52 -- setup/devices.sh@12 -- # cleanup_dm 00:03:47.579 20:04:52 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:47.579 20:04:52 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:47.579 20:04:52 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:47.579 20:04:52 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:47.579 20:04:52 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:47.579 20:04:52 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:47.579 00:03:47.579 real 0m14.146s 00:03:47.579 user 0m3.199s 00:03:47.579 sys 0m5.139s 00:03:47.579 20:04:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.579 20:04:52 -- common/autotest_common.sh@10 -- # set +x 00:03:47.579 ************************************ 00:03:47.579 END TEST devices 00:03:47.579 ************************************ 00:03:47.579 00:03:47.579 real 0m44.148s 00:03:47.579 user 0m12.883s 00:03:47.579 sys 0m19.763s 00:03:47.579 20:04:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.579 20:04:52 -- common/autotest_common.sh@10 -- # set +x 00:03:47.579 ************************************ 00:03:47.579 END TEST setup.sh 00:03:47.579 ************************************ 00:03:47.579 20:04:52 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:48.957 Hugepages 00:03:48.957 node hugesize free / total 00:03:48.957 node0 1048576kB 0 / 0 00:03:48.957 node0 2048kB 2048 / 2048 00:03:48.957 node1 1048576kB 0 / 0 00:03:48.957 node1 2048kB 0 / 0 00:03:48.957 00:03:48.957 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:48.957 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:48.957 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:48.957 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:48.957 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:48.957 20:04:53 -- spdk/autotest.sh@128 -- # uname -s 00:03:48.957 20:04:53 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:48.957 20:04:53 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:48.957 20:04:53 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:49.892 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.892 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.892 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.892 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:50.151 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:50.152 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:50.152 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:50.152 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:50.152 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:51.090 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:51.090 20:04:56 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:52.468 20:04:57 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:52.468 20:04:57 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:52.468 20:04:57 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:52.468 20:04:57 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:52.468 20:04:57 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:52.468 20:04:57 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:52.468 20:04:57 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:52.468 20:04:57 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:52.468 20:04:57 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:52.468 20:04:57 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:52.468 20:04:57 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:52.468 20:04:57 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:53.404 Waiting for block devices as requested 00:03:53.404 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:53.662 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:53.662 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:53.662 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:53.920 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:53.920 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:53.921 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:53.921 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:53.921 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:54.180 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:54.180 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:54.180 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:54.180 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:54.438 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:54.438 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:54.438 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:54.697 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:54.697 20:04:59 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:54.697 20:04:59 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:54.697 20:04:59 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:54.697 20:04:59 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:54.697 20:04:59 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:54.697 20:04:59 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:54.697 20:04:59 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:54.697 20:04:59 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:54.697 20:04:59 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:54.697 20:04:59 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:54.697 20:04:59 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:54.697 20:04:59 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:54.697 20:04:59 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:54.697 20:04:59 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:54.697 20:04:59 -- common/autotest_common.sh@1552 -- # continue 00:03:54.697 20:04:59 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:54.697 20:04:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:54.697 20:04:59 -- common/autotest_common.sh@10 -- # set +x 00:03:54.697 20:04:59 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:54.697 20:04:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:54.697 20:04:59 -- common/autotest_common.sh@10 -- # set +x 00:03:54.697 20:04:59 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:56.072 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:56.072 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:56.072 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:57.009 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:57.009 20:05:01 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:57.009 20:05:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:57.009 20:05:01 -- common/autotest_common.sh@10 -- # set +x 00:03:57.009 20:05:01 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:57.009 20:05:01 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:57.009 20:05:01 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:57.009 20:05:01 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:57.009 20:05:01 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:57.009 20:05:01 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:57.009 20:05:01 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:57.009 20:05:01 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:57.009 20:05:01 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:57.009 20:05:01 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:57.009 20:05:01 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:57.009 20:05:02 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:57.010 20:05:02 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:57.010 20:05:02 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:57.010 20:05:02 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:57.010 20:05:02 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:57.010 20:05:02 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:57.010 20:05:02 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:57.010 20:05:02 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:57.010 20:05:02 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:57.010 20:05:02 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3032052 00:03:57.010 20:05:02 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:57.010 20:05:02 -- common/autotest_common.sh@1593 -- # waitforlisten 3032052 00:03:57.010 20:05:02 -- common/autotest_common.sh@829 -- # '[' -z 3032052 ']' 00:03:57.010 20:05:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:57.010 20:05:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:57.010 20:05:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:57.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:57.010 20:05:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:57.010 20:05:02 -- common/autotest_common.sh@10 -- # set +x 00:03:57.268 [2024-11-20 20:05:02.077535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:57.268 [2024-11-20 20:05:02.077620] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3032052 ] 00:03:57.268 EAL: No free 2048 kB hugepages reported on node 1 00:03:57.268 [2024-11-20 20:05:02.139950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:57.268 [2024-11-20 20:05:02.252728] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:57.268 [2024-11-20 20:05:02.252906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:58.201 20:05:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:58.201 20:05:03 -- common/autotest_common.sh@862 -- # return 0 00:03:58.201 20:05:03 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:58.201 20:05:03 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:58.201 20:05:03 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:01.484 nvme0n1 00:04:01.484 20:05:06 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:01.484 [2024-11-20 20:05:06.320357] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:01.484 [2024-11-20 20:05:06.320417] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:01.484 request: 00:04:01.484 { 00:04:01.484 "nvme_ctrlr_name": "nvme0", 00:04:01.484 "password": "test", 00:04:01.484 "method": "bdev_nvme_opal_revert", 00:04:01.484 "req_id": 1 00:04:01.484 } 00:04:01.484 Got JSON-RPC error response 00:04:01.484 response: 00:04:01.484 { 00:04:01.484 "code": -32603, 00:04:01.484 "message": "Internal error" 00:04:01.484 } 00:04:01.484 20:05:06 -- common/autotest_common.sh@1599 -- # true 00:04:01.484 20:05:06 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:01.484 20:05:06 -- common/autotest_common.sh@1603 -- # killprocess 3032052 00:04:01.484 20:05:06 -- common/autotest_common.sh@936 -- # '[' -z 3032052 ']' 00:04:01.484 20:05:06 -- common/autotest_common.sh@940 -- # kill -0 3032052 00:04:01.484 20:05:06 -- common/autotest_common.sh@941 -- # uname 00:04:01.484 20:05:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:01.484 20:05:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3032052 00:04:01.484 20:05:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:01.484 20:05:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:01.484 20:05:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3032052' 00:04:01.484 killing process with pid 3032052 00:04:01.484 20:05:06 -- common/autotest_common.sh@955 -- # kill 3032052 00:04:01.484 20:05:06 -- common/autotest_common.sh@960 -- # wait 3032052 00:04:03.383 20:05:08 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:03.383 20:05:08 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:03.383 20:05:08 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:03.383 20:05:08 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:03.383 20:05:08 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:03.383 20:05:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:03.383 20:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:03.383 20:05:08 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:03.383 20:05:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.383 20:05:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.383 20:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:03.383 ************************************ 00:04:03.383 START TEST env 00:04:03.383 ************************************ 00:04:03.383 20:05:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:03.383 * Looking for test storage... 00:04:03.383 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:03.383 20:05:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:03.383 20:05:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:03.383 20:05:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:03.383 20:05:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:03.383 20:05:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:03.383 20:05:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:03.383 20:05:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:03.383 20:05:08 -- scripts/common.sh@335 -- # IFS=.-: 00:04:03.383 20:05:08 -- scripts/common.sh@335 -- # read -ra ver1 00:04:03.383 20:05:08 -- scripts/common.sh@336 -- # IFS=.-: 00:04:03.383 20:05:08 -- scripts/common.sh@336 -- # read -ra ver2 00:04:03.384 20:05:08 -- scripts/common.sh@337 -- # local 'op=<' 00:04:03.384 20:05:08 -- scripts/common.sh@339 -- # ver1_l=2 00:04:03.384 20:05:08 -- scripts/common.sh@340 -- # ver2_l=1 00:04:03.384 20:05:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:03.384 20:05:08 -- scripts/common.sh@343 -- # case "$op" in 00:04:03.384 20:05:08 -- scripts/common.sh@344 -- # : 1 00:04:03.384 20:05:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:03.384 20:05:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:03.384 20:05:08 -- scripts/common.sh@364 -- # decimal 1 00:04:03.384 20:05:08 -- scripts/common.sh@352 -- # local d=1 00:04:03.384 20:05:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:03.384 20:05:08 -- scripts/common.sh@354 -- # echo 1 00:04:03.384 20:05:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:03.384 20:05:08 -- scripts/common.sh@365 -- # decimal 2 00:04:03.384 20:05:08 -- scripts/common.sh@352 -- # local d=2 00:04:03.384 20:05:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:03.384 20:05:08 -- scripts/common.sh@354 -- # echo 2 00:04:03.384 20:05:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:03.384 20:05:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:03.384 20:05:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:03.384 20:05:08 -- scripts/common.sh@367 -- # return 0 00:04:03.384 20:05:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:03.384 20:05:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:03.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.384 --rc genhtml_branch_coverage=1 00:04:03.384 --rc genhtml_function_coverage=1 00:04:03.384 --rc genhtml_legend=1 00:04:03.384 --rc geninfo_all_blocks=1 00:04:03.384 --rc geninfo_unexecuted_blocks=1 00:04:03.384 00:04:03.384 ' 00:04:03.384 20:05:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:03.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.384 --rc genhtml_branch_coverage=1 00:04:03.384 --rc genhtml_function_coverage=1 00:04:03.384 --rc genhtml_legend=1 00:04:03.384 --rc geninfo_all_blocks=1 00:04:03.384 --rc geninfo_unexecuted_blocks=1 00:04:03.384 00:04:03.384 ' 00:04:03.384 20:05:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:03.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.384 --rc genhtml_branch_coverage=1 00:04:03.384 --rc genhtml_function_coverage=1 00:04:03.384 --rc genhtml_legend=1 00:04:03.384 --rc geninfo_all_blocks=1 00:04:03.384 --rc geninfo_unexecuted_blocks=1 00:04:03.384 00:04:03.384 ' 00:04:03.384 20:05:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:03.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.384 --rc genhtml_branch_coverage=1 00:04:03.384 --rc genhtml_function_coverage=1 00:04:03.384 --rc genhtml_legend=1 00:04:03.384 --rc geninfo_all_blocks=1 00:04:03.384 --rc geninfo_unexecuted_blocks=1 00:04:03.384 00:04:03.384 ' 00:04:03.384 20:05:08 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:03.384 20:05:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.384 20:05:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.384 20:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:03.384 ************************************ 00:04:03.384 START TEST env_memory 00:04:03.384 ************************************ 00:04:03.384 20:05:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:03.384 00:04:03.384 00:04:03.384 CUnit - A unit testing framework for C - Version 2.1-3 00:04:03.384 http://cunit.sourceforge.net/ 00:04:03.384 00:04:03.384 00:04:03.384 Suite: memory 00:04:03.384 Test: alloc and free memory map ...[2024-11-20 20:05:08.365232] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:03.384 passed 00:04:03.384 Test: mem map translation ...[2024-11-20 20:05:08.384656] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:03.384 [2024-11-20 20:05:08.384679] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:03.384 [2024-11-20 20:05:08.384719] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:03.384 [2024-11-20 20:05:08.384731] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:03.384 passed 00:04:03.644 Test: mem map registration ...[2024-11-20 20:05:08.425181] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:03.644 [2024-11-20 20:05:08.425202] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:03.644 passed 00:04:03.644 Test: mem map adjacent registrations ...passed 00:04:03.644 00:04:03.644 Run Summary: Type Total Ran Passed Failed Inactive 00:04:03.644 suites 1 1 n/a 0 0 00:04:03.644 tests 4 4 4 0 0 00:04:03.644 asserts 152 152 152 0 n/a 00:04:03.644 00:04:03.644 Elapsed time = 0.136 seconds 00:04:03.644 00:04:03.644 real 0m0.142s 00:04:03.644 user 0m0.137s 00:04:03.644 sys 0m0.005s 00:04:03.644 20:05:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.644 20:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:03.644 ************************************ 00:04:03.644 END TEST env_memory 00:04:03.644 ************************************ 00:04:03.644 20:05:08 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:03.644 20:05:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.644 20:05:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.644 20:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:03.644 ************************************ 00:04:03.644 START TEST env_vtophys 00:04:03.644 ************************************ 00:04:03.644 20:05:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:03.644 EAL: lib.eal log level changed from notice to debug 00:04:03.644 EAL: Detected lcore 0 as core 0 on socket 0 00:04:03.644 EAL: Detected lcore 1 as core 1 on socket 0 00:04:03.644 EAL: Detected lcore 2 as core 2 on socket 0 00:04:03.644 EAL: Detected lcore 3 as core 3 on socket 0 00:04:03.644 EAL: Detected lcore 4 as core 4 on socket 0 00:04:03.644 EAL: Detected lcore 5 as core 5 on socket 0 00:04:03.644 EAL: Detected lcore 6 as core 8 on socket 0 00:04:03.644 EAL: Detected lcore 7 as core 9 on socket 0 00:04:03.644 EAL: Detected lcore 8 as core 10 on socket 0 00:04:03.644 EAL: Detected lcore 9 as core 11 on socket 0 00:04:03.644 EAL: Detected lcore 10 as core 12 on socket 0 00:04:03.644 EAL: Detected lcore 11 as core 13 on socket 0 00:04:03.644 EAL: Detected lcore 12 as core 0 on socket 1 00:04:03.644 EAL: Detected lcore 13 as core 1 on socket 1 00:04:03.644 EAL: Detected lcore 14 as core 2 on socket 1 00:04:03.644 EAL: Detected lcore 15 as core 3 on socket 1 00:04:03.644 EAL: Detected lcore 16 as core 4 on socket 1 00:04:03.644 EAL: Detected lcore 17 as core 5 on socket 1 00:04:03.644 EAL: Detected lcore 18 as core 8 on socket 1 00:04:03.644 EAL: Detected lcore 19 as core 9 on socket 1 00:04:03.644 EAL: Detected lcore 20 as core 10 on socket 1 00:04:03.644 EAL: Detected lcore 21 as core 11 on socket 1 00:04:03.644 EAL: Detected lcore 22 as core 12 on socket 1 00:04:03.644 EAL: Detected lcore 23 as core 13 on socket 1 00:04:03.644 EAL: Detected lcore 24 as core 0 on socket 0 00:04:03.644 EAL: Detected lcore 25 as core 1 on socket 0 00:04:03.644 EAL: Detected lcore 26 as core 2 on socket 0 00:04:03.644 EAL: Detected lcore 27 as core 3 on socket 0 00:04:03.644 EAL: Detected lcore 28 as core 4 on socket 0 00:04:03.644 EAL: Detected lcore 29 as core 5 on socket 0 00:04:03.644 EAL: Detected lcore 30 as core 8 on socket 0 00:04:03.644 EAL: Detected lcore 31 as core 9 on socket 0 00:04:03.644 EAL: Detected lcore 32 as core 10 on socket 0 00:04:03.644 EAL: Detected lcore 33 as core 11 on socket 0 00:04:03.644 EAL: Detected lcore 34 as core 12 on socket 0 00:04:03.644 EAL: Detected lcore 35 as core 13 on socket 0 00:04:03.644 EAL: Detected lcore 36 as core 0 on socket 1 00:04:03.644 EAL: Detected lcore 37 as core 1 on socket 1 00:04:03.644 EAL: Detected lcore 38 as core 2 on socket 1 00:04:03.644 EAL: Detected lcore 39 as core 3 on socket 1 00:04:03.644 EAL: Detected lcore 40 as core 4 on socket 1 00:04:03.644 EAL: Detected lcore 41 as core 5 on socket 1 00:04:03.644 EAL: Detected lcore 42 as core 8 on socket 1 00:04:03.644 EAL: Detected lcore 43 as core 9 on socket 1 00:04:03.644 EAL: Detected lcore 44 as core 10 on socket 1 00:04:03.644 EAL: Detected lcore 45 as core 11 on socket 1 00:04:03.644 EAL: Detected lcore 46 as core 12 on socket 1 00:04:03.644 EAL: Detected lcore 47 as core 13 on socket 1 00:04:03.644 EAL: Maximum logical cores by configuration: 128 00:04:03.644 EAL: Detected CPU lcores: 48 00:04:03.644 EAL: Detected NUMA nodes: 2 00:04:03.644 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:03.644 EAL: Detected shared linkage of DPDK 00:04:03.644 EAL: No shared files mode enabled, IPC will be disabled 00:04:03.644 EAL: Bus pci wants IOVA as 'DC' 00:04:03.644 EAL: Buses did not request a specific IOVA mode. 00:04:03.644 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:03.644 EAL: Selected IOVA mode 'VA' 00:04:03.644 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.644 EAL: Probing VFIO support... 00:04:03.644 EAL: IOMMU type 1 (Type 1) is supported 00:04:03.644 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:03.644 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:03.644 EAL: VFIO support initialized 00:04:03.644 EAL: Ask a virtual area of 0x2e000 bytes 00:04:03.644 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:03.644 EAL: Setting up physically contiguous memory... 00:04:03.644 EAL: Setting maximum number of open files to 524288 00:04:03.644 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:03.644 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:03.644 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:03.644 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.644 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:03.644 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:03.644 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.644 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:03.644 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:03.644 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.644 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:03.644 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:03.644 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.644 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:03.644 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:03.644 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.644 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:03.644 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:03.644 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.644 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:03.644 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:03.644 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.644 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:03.644 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:03.644 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.644 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:03.644 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:03.644 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:03.644 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.644 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:03.644 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:03.644 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.644 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:03.644 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:03.644 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.645 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:03.645 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:03.645 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.645 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:03.645 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:03.645 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.645 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:03.645 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:03.645 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.645 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:03.645 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:03.645 EAL: Ask a virtual area of 0x61000 bytes 00:04:03.645 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:03.645 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:03.645 EAL: Ask a virtual area of 0x400000000 bytes 00:04:03.645 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:03.645 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:03.645 EAL: Hugepages will be freed exactly as allocated. 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: TSC frequency is ~2700000 KHz 00:04:03.645 EAL: Main lcore 0 is ready (tid=7ff7aefe2a00;cpuset=[0]) 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 0 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 2MB 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:03.645 EAL: Mem event callback 'spdk:(nil)' registered 00:04:03.645 00:04:03.645 00:04:03.645 CUnit - A unit testing framework for C - Version 2.1-3 00:04:03.645 http://cunit.sourceforge.net/ 00:04:03.645 00:04:03.645 00:04:03.645 Suite: components_suite 00:04:03.645 Test: vtophys_malloc_test ...passed 00:04:03.645 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 4 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 4MB 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was shrunk by 4MB 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 4 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 6MB 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was shrunk by 6MB 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 4 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 10MB 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was shrunk by 10MB 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 4 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 18MB 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was shrunk by 18MB 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 4 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 34MB 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was shrunk by 34MB 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.645 EAL: Restoring previous memory policy: 4 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was expanded by 66MB 00:04:03.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.645 EAL: request: mp_malloc_sync 00:04:03.645 EAL: No shared files mode enabled, IPC is disabled 00:04:03.645 EAL: Heap on socket 0 was shrunk by 66MB 00:04:03.645 EAL: Trying to obtain current memory policy. 00:04:03.645 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.903 EAL: Restoring previous memory policy: 4 00:04:03.903 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.903 EAL: request: mp_malloc_sync 00:04:03.903 EAL: No shared files mode enabled, IPC is disabled 00:04:03.903 EAL: Heap on socket 0 was expanded by 130MB 00:04:03.903 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.903 EAL: request: mp_malloc_sync 00:04:03.903 EAL: No shared files mode enabled, IPC is disabled 00:04:03.903 EAL: Heap on socket 0 was shrunk by 130MB 00:04:03.903 EAL: Trying to obtain current memory policy. 00:04:03.903 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.903 EAL: Restoring previous memory policy: 4 00:04:03.903 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.903 EAL: request: mp_malloc_sync 00:04:03.903 EAL: No shared files mode enabled, IPC is disabled 00:04:03.903 EAL: Heap on socket 0 was expanded by 258MB 00:04:03.903 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.903 EAL: request: mp_malloc_sync 00:04:03.903 EAL: No shared files mode enabled, IPC is disabled 00:04:03.903 EAL: Heap on socket 0 was shrunk by 258MB 00:04:03.904 EAL: Trying to obtain current memory policy. 00:04:03.904 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.161 EAL: Restoring previous memory policy: 4 00:04:04.162 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.162 EAL: request: mp_malloc_sync 00:04:04.162 EAL: No shared files mode enabled, IPC is disabled 00:04:04.162 EAL: Heap on socket 0 was expanded by 514MB 00:04:04.162 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.420 EAL: request: mp_malloc_sync 00:04:04.420 EAL: No shared files mode enabled, IPC is disabled 00:04:04.420 EAL: Heap on socket 0 was shrunk by 514MB 00:04:04.420 EAL: Trying to obtain current memory policy. 00:04:04.420 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.678 EAL: Restoring previous memory policy: 4 00:04:04.678 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.678 EAL: request: mp_malloc_sync 00:04:04.678 EAL: No shared files mode enabled, IPC is disabled 00:04:04.678 EAL: Heap on socket 0 was expanded by 1026MB 00:04:04.936 EAL: Calling mem event callback 'spdk:(nil)' 00:04:05.194 EAL: request: mp_malloc_sync 00:04:05.194 EAL: No shared files mode enabled, IPC is disabled 00:04:05.194 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:05.194 passed 00:04:05.194 00:04:05.194 Run Summary: Type Total Ran Passed Failed Inactive 00:04:05.194 suites 1 1 n/a 0 0 00:04:05.194 tests 2 2 2 0 0 00:04:05.194 asserts 497 497 497 0 n/a 00:04:05.194 00:04:05.194 Elapsed time = 1.388 seconds 00:04:05.194 EAL: Calling mem event callback 'spdk:(nil)' 00:04:05.194 EAL: request: mp_malloc_sync 00:04:05.194 EAL: No shared files mode enabled, IPC is disabled 00:04:05.194 EAL: Heap on socket 0 was shrunk by 2MB 00:04:05.194 EAL: No shared files mode enabled, IPC is disabled 00:04:05.194 EAL: No shared files mode enabled, IPC is disabled 00:04:05.194 EAL: No shared files mode enabled, IPC is disabled 00:04:05.194 00:04:05.194 real 0m1.506s 00:04:05.194 user 0m0.879s 00:04:05.194 sys 0m0.594s 00:04:05.194 20:05:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.194 20:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:05.194 ************************************ 00:04:05.194 END TEST env_vtophys 00:04:05.194 ************************************ 00:04:05.194 20:05:10 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:05.194 20:05:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.195 20:05:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.195 20:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:05.195 ************************************ 00:04:05.195 START TEST env_pci 00:04:05.195 ************************************ 00:04:05.195 20:05:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:05.195 00:04:05.195 00:04:05.195 CUnit - A unit testing framework for C - Version 2.1-3 00:04:05.195 http://cunit.sourceforge.net/ 00:04:05.195 00:04:05.195 00:04:05.195 Suite: pci 00:04:05.195 Test: pci_hook ...[2024-11-20 20:05:10.049063] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3033096 has claimed it 00:04:05.195 EAL: Cannot find device (10000:00:01.0) 00:04:05.195 EAL: Failed to attach device on primary process 00:04:05.195 passed 00:04:05.195 00:04:05.195 Run Summary: Type Total Ran Passed Failed Inactive 00:04:05.195 suites 1 1 n/a 0 0 00:04:05.195 tests 1 1 1 0 0 00:04:05.195 asserts 25 25 25 0 n/a 00:04:05.195 00:04:05.195 Elapsed time = 0.022 seconds 00:04:05.195 00:04:05.195 real 0m0.035s 00:04:05.195 user 0m0.009s 00:04:05.195 sys 0m0.025s 00:04:05.195 20:05:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.195 20:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:05.195 ************************************ 00:04:05.195 END TEST env_pci 00:04:05.195 ************************************ 00:04:05.195 20:05:10 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:05.195 20:05:10 -- env/env.sh@15 -- # uname 00:04:05.195 20:05:10 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:05.195 20:05:10 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:05.195 20:05:10 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:05.195 20:05:10 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:05.195 20:05:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.195 20:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:05.195 ************************************ 00:04:05.195 START TEST env_dpdk_post_init 00:04:05.195 ************************************ 00:04:05.195 20:05:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:05.195 EAL: Detected CPU lcores: 48 00:04:05.195 EAL: Detected NUMA nodes: 2 00:04:05.195 EAL: Detected shared linkage of DPDK 00:04:05.195 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:05.195 EAL: Selected IOVA mode 'VA' 00:04:05.195 EAL: No free 2048 kB hugepages reported on node 1 00:04:05.195 EAL: VFIO support initialized 00:04:05.195 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:05.195 EAL: Using IOMMU type 1 (Type 1) 00:04:05.195 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:05.195 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:05.453 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:06.387 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:09.667 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:09.667 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:09.667 Starting DPDK initialization... 00:04:09.667 Starting SPDK post initialization... 00:04:09.667 SPDK NVMe probe 00:04:09.667 Attaching to 0000:88:00.0 00:04:09.667 Attached to 0000:88:00.0 00:04:09.667 Cleaning up... 00:04:09.667 00:04:09.667 real 0m4.403s 00:04:09.667 user 0m3.274s 00:04:09.667 sys 0m0.186s 00:04:09.667 20:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.667 20:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:09.667 ************************************ 00:04:09.667 END TEST env_dpdk_post_init 00:04:09.667 ************************************ 00:04:09.667 20:05:14 -- env/env.sh@26 -- # uname 00:04:09.667 20:05:14 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:09.667 20:05:14 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:09.667 20:05:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.667 20:05:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.667 20:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:09.667 ************************************ 00:04:09.667 START TEST env_mem_callbacks 00:04:09.667 ************************************ 00:04:09.667 20:05:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:09.667 EAL: Detected CPU lcores: 48 00:04:09.667 EAL: Detected NUMA nodes: 2 00:04:09.667 EAL: Detected shared linkage of DPDK 00:04:09.667 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:09.667 EAL: Selected IOVA mode 'VA' 00:04:09.667 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.667 EAL: VFIO support initialized 00:04:09.667 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:09.667 00:04:09.667 00:04:09.667 CUnit - A unit testing framework for C - Version 2.1-3 00:04:09.667 http://cunit.sourceforge.net/ 00:04:09.667 00:04:09.667 00:04:09.667 Suite: memory 00:04:09.667 Test: test ... 00:04:09.667 register 0x200000200000 2097152 00:04:09.667 malloc 3145728 00:04:09.667 register 0x200000400000 4194304 00:04:09.667 buf 0x200000500000 len 3145728 PASSED 00:04:09.667 malloc 64 00:04:09.667 buf 0x2000004fff40 len 64 PASSED 00:04:09.667 malloc 4194304 00:04:09.667 register 0x200000800000 6291456 00:04:09.667 buf 0x200000a00000 len 4194304 PASSED 00:04:09.667 free 0x200000500000 3145728 00:04:09.667 free 0x2000004fff40 64 00:04:09.667 unregister 0x200000400000 4194304 PASSED 00:04:09.667 free 0x200000a00000 4194304 00:04:09.667 unregister 0x200000800000 6291456 PASSED 00:04:09.668 malloc 8388608 00:04:09.668 register 0x200000400000 10485760 00:04:09.668 buf 0x200000600000 len 8388608 PASSED 00:04:09.668 free 0x200000600000 8388608 00:04:09.668 unregister 0x200000400000 10485760 PASSED 00:04:09.668 passed 00:04:09.668 00:04:09.668 Run Summary: Type Total Ran Passed Failed Inactive 00:04:09.668 suites 1 1 n/a 0 0 00:04:09.668 tests 1 1 1 0 0 00:04:09.668 asserts 15 15 15 0 n/a 00:04:09.668 00:04:09.668 Elapsed time = 0.005 seconds 00:04:09.668 00:04:09.668 real 0m0.047s 00:04:09.668 user 0m0.019s 00:04:09.668 sys 0m0.028s 00:04:09.668 20:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.668 20:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:09.668 ************************************ 00:04:09.668 END TEST env_mem_callbacks 00:04:09.668 ************************************ 00:04:09.668 00:04:09.668 real 0m6.412s 00:04:09.668 user 0m4.473s 00:04:09.668 sys 0m0.992s 00:04:09.668 20:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.668 20:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:09.668 ************************************ 00:04:09.668 END TEST env 00:04:09.668 ************************************ 00:04:09.668 20:05:14 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:09.668 20:05:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.668 20:05:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.668 20:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:09.668 ************************************ 00:04:09.668 START TEST rpc 00:04:09.668 ************************************ 00:04:09.668 20:05:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:09.668 * Looking for test storage... 00:04:09.668 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:09.668 20:05:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:09.668 20:05:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:09.668 20:05:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:09.926 20:05:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:09.926 20:05:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.926 20:05:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.926 20:05:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.926 20:05:14 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.926 20:05:14 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.926 20:05:14 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.926 20:05:14 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.926 20:05:14 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.926 20:05:14 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.926 20:05:14 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.926 20:05:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.926 20:05:14 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.926 20:05:14 -- scripts/common.sh@344 -- # : 1 00:04:09.926 20:05:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.926 20:05:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.926 20:05:14 -- scripts/common.sh@364 -- # decimal 1 00:04:09.926 20:05:14 -- scripts/common.sh@352 -- # local d=1 00:04:09.926 20:05:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.926 20:05:14 -- scripts/common.sh@354 -- # echo 1 00:04:09.926 20:05:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.926 20:05:14 -- scripts/common.sh@365 -- # decimal 2 00:04:09.926 20:05:14 -- scripts/common.sh@352 -- # local d=2 00:04:09.926 20:05:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.926 20:05:14 -- scripts/common.sh@354 -- # echo 2 00:04:09.926 20:05:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.926 20:05:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.926 20:05:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.926 20:05:14 -- scripts/common.sh@367 -- # return 0 00:04:09.926 20:05:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.926 20:05:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.926 --rc genhtml_branch_coverage=1 00:04:09.926 --rc genhtml_function_coverage=1 00:04:09.926 --rc genhtml_legend=1 00:04:09.926 --rc geninfo_all_blocks=1 00:04:09.926 --rc geninfo_unexecuted_blocks=1 00:04:09.926 00:04:09.926 ' 00:04:09.926 20:05:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.926 --rc genhtml_branch_coverage=1 00:04:09.926 --rc genhtml_function_coverage=1 00:04:09.926 --rc genhtml_legend=1 00:04:09.926 --rc geninfo_all_blocks=1 00:04:09.926 --rc geninfo_unexecuted_blocks=1 00:04:09.926 00:04:09.926 ' 00:04:09.926 20:05:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.927 --rc genhtml_branch_coverage=1 00:04:09.927 --rc genhtml_function_coverage=1 00:04:09.927 --rc genhtml_legend=1 00:04:09.927 --rc geninfo_all_blocks=1 00:04:09.927 --rc geninfo_unexecuted_blocks=1 00:04:09.927 00:04:09.927 ' 00:04:09.927 20:05:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.927 --rc genhtml_branch_coverage=1 00:04:09.927 --rc genhtml_function_coverage=1 00:04:09.927 --rc genhtml_legend=1 00:04:09.927 --rc geninfo_all_blocks=1 00:04:09.927 --rc geninfo_unexecuted_blocks=1 00:04:09.927 00:04:09.927 ' 00:04:09.927 20:05:14 -- rpc/rpc.sh@65 -- # spdk_pid=3033768 00:04:09.927 20:05:14 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:09.927 20:05:14 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:09.927 20:05:14 -- rpc/rpc.sh@67 -- # waitforlisten 3033768 00:04:09.927 20:05:14 -- common/autotest_common.sh@829 -- # '[' -z 3033768 ']' 00:04:09.927 20:05:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:09.927 20:05:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:09.927 20:05:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:09.927 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:09.927 20:05:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:09.927 20:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:09.927 [2024-11-20 20:05:14.816903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:09.927 [2024-11-20 20:05:14.817000] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3033768 ] 00:04:09.927 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.927 [2024-11-20 20:05:14.873806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:10.185 [2024-11-20 20:05:14.982694] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:10.185 [2024-11-20 20:05:14.982842] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:10.185 [2024-11-20 20:05:14.982864] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3033768' to capture a snapshot of events at runtime. 00:04:10.185 [2024-11-20 20:05:14.982876] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3033768 for offline analysis/debug. 00:04:10.185 [2024-11-20 20:05:14.982904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.119 20:05:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:11.119 20:05:15 -- common/autotest_common.sh@862 -- # return 0 00:04:11.119 20:05:15 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:11.120 20:05:15 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:11.120 20:05:15 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:11.120 20:05:15 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:11.120 20:05:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.120 20:05:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 ************************************ 00:04:11.120 START TEST rpc_integrity 00:04:11.120 ************************************ 00:04:11.120 20:05:15 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:11.120 20:05:15 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:11.120 20:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:15 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:11.120 20:05:15 -- rpc/rpc.sh@13 -- # jq length 00:04:11.120 20:05:15 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:11.120 20:05:15 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:11.120 20:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:15 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:11.120 20:05:15 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:11.120 20:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:15 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:11.120 { 00:04:11.120 "name": "Malloc0", 00:04:11.120 "aliases": [ 00:04:11.120 "d2114a49-d090-408f-8fa3-7b2a13c48df8" 00:04:11.120 ], 00:04:11.120 "product_name": "Malloc disk", 00:04:11.120 "block_size": 512, 00:04:11.120 "num_blocks": 16384, 00:04:11.120 "uuid": "d2114a49-d090-408f-8fa3-7b2a13c48df8", 00:04:11.120 "assigned_rate_limits": { 00:04:11.120 "rw_ios_per_sec": 0, 00:04:11.120 "rw_mbytes_per_sec": 0, 00:04:11.120 "r_mbytes_per_sec": 0, 00:04:11.120 "w_mbytes_per_sec": 0 00:04:11.120 }, 00:04:11.120 "claimed": false, 00:04:11.120 "zoned": false, 00:04:11.120 "supported_io_types": { 00:04:11.120 "read": true, 00:04:11.120 "write": true, 00:04:11.120 "unmap": true, 00:04:11.120 "write_zeroes": true, 00:04:11.120 "flush": true, 00:04:11.120 "reset": true, 00:04:11.120 "compare": false, 00:04:11.120 "compare_and_write": false, 00:04:11.120 "abort": true, 00:04:11.120 "nvme_admin": false, 00:04:11.120 "nvme_io": false 00:04:11.120 }, 00:04:11.120 "memory_domains": [ 00:04:11.120 { 00:04:11.120 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.120 "dma_device_type": 2 00:04:11.120 } 00:04:11.120 ], 00:04:11.120 "driver_specific": {} 00:04:11.120 } 00:04:11.120 ]' 00:04:11.120 20:05:15 -- rpc/rpc.sh@17 -- # jq length 00:04:11.120 20:05:15 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:11.120 20:05:15 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:11.120 20:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 [2024-11-20 20:05:15.936996] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:11.120 [2024-11-20 20:05:15.937045] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:11.120 [2024-11-20 20:05:15.937079] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xaf5cb0 00:04:11.120 [2024-11-20 20:05:15.937113] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:11.120 [2024-11-20 20:05:15.938585] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:11.120 [2024-11-20 20:05:15.938613] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:11.120 Passthru0 00:04:11.120 20:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:15 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:11.120 20:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:15 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:11.120 { 00:04:11.120 "name": "Malloc0", 00:04:11.120 "aliases": [ 00:04:11.120 "d2114a49-d090-408f-8fa3-7b2a13c48df8" 00:04:11.120 ], 00:04:11.120 "product_name": "Malloc disk", 00:04:11.120 "block_size": 512, 00:04:11.120 "num_blocks": 16384, 00:04:11.120 "uuid": "d2114a49-d090-408f-8fa3-7b2a13c48df8", 00:04:11.120 "assigned_rate_limits": { 00:04:11.120 "rw_ios_per_sec": 0, 00:04:11.120 "rw_mbytes_per_sec": 0, 00:04:11.120 "r_mbytes_per_sec": 0, 00:04:11.120 "w_mbytes_per_sec": 0 00:04:11.120 }, 00:04:11.120 "claimed": true, 00:04:11.120 "claim_type": "exclusive_write", 00:04:11.120 "zoned": false, 00:04:11.120 "supported_io_types": { 00:04:11.120 "read": true, 00:04:11.120 "write": true, 00:04:11.120 "unmap": true, 00:04:11.120 "write_zeroes": true, 00:04:11.120 "flush": true, 00:04:11.120 "reset": true, 00:04:11.120 "compare": false, 00:04:11.120 "compare_and_write": false, 00:04:11.120 "abort": true, 00:04:11.120 "nvme_admin": false, 00:04:11.120 "nvme_io": false 00:04:11.120 }, 00:04:11.120 "memory_domains": [ 00:04:11.120 { 00:04:11.120 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.120 "dma_device_type": 2 00:04:11.120 } 00:04:11.120 ], 00:04:11.120 "driver_specific": {} 00:04:11.120 }, 00:04:11.120 { 00:04:11.120 "name": "Passthru0", 00:04:11.120 "aliases": [ 00:04:11.120 "de0d4bfd-dac9-5ef6-b7e3-39981393c1c2" 00:04:11.120 ], 00:04:11.120 "product_name": "passthru", 00:04:11.120 "block_size": 512, 00:04:11.120 "num_blocks": 16384, 00:04:11.120 "uuid": "de0d4bfd-dac9-5ef6-b7e3-39981393c1c2", 00:04:11.120 "assigned_rate_limits": { 00:04:11.120 "rw_ios_per_sec": 0, 00:04:11.120 "rw_mbytes_per_sec": 0, 00:04:11.120 "r_mbytes_per_sec": 0, 00:04:11.120 "w_mbytes_per_sec": 0 00:04:11.120 }, 00:04:11.120 "claimed": false, 00:04:11.120 "zoned": false, 00:04:11.120 "supported_io_types": { 00:04:11.120 "read": true, 00:04:11.120 "write": true, 00:04:11.120 "unmap": true, 00:04:11.120 "write_zeroes": true, 00:04:11.120 "flush": true, 00:04:11.120 "reset": true, 00:04:11.120 "compare": false, 00:04:11.120 "compare_and_write": false, 00:04:11.120 "abort": true, 00:04:11.120 "nvme_admin": false, 00:04:11.120 "nvme_io": false 00:04:11.120 }, 00:04:11.120 "memory_domains": [ 00:04:11.120 { 00:04:11.120 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.120 "dma_device_type": 2 00:04:11.120 } 00:04:11.120 ], 00:04:11.120 "driver_specific": { 00:04:11.120 "passthru": { 00:04:11.120 "name": "Passthru0", 00:04:11.120 "base_bdev_name": "Malloc0" 00:04:11.120 } 00:04:11.120 } 00:04:11.120 } 00:04:11.120 ]' 00:04:11.120 20:05:15 -- rpc/rpc.sh@21 -- # jq length 00:04:11.120 20:05:15 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:11.120 20:05:15 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:11.120 20:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:16 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:11.120 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:16 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:11.120 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:16 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:11.120 20:05:16 -- rpc/rpc.sh@26 -- # jq length 00:04:11.120 20:05:16 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:11.120 00:04:11.120 real 0m0.227s 00:04:11.120 user 0m0.146s 00:04:11.120 sys 0m0.022s 00:04:11.120 20:05:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.120 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 ************************************ 00:04:11.120 END TEST rpc_integrity 00:04:11.120 ************************************ 00:04:11.120 20:05:16 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:11.120 20:05:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.120 20:05:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.120 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 ************************************ 00:04:11.120 START TEST rpc_plugins 00:04:11.120 ************************************ 00:04:11.120 20:05:16 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:11.120 20:05:16 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:11.120 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:16 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:11.120 20:05:16 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:11.120 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.120 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.120 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.120 20:05:16 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:11.120 { 00:04:11.120 "name": "Malloc1", 00:04:11.120 "aliases": [ 00:04:11.120 "02013fd3-05a8-44ac-8fbc-6832414c1457" 00:04:11.120 ], 00:04:11.121 "product_name": "Malloc disk", 00:04:11.121 "block_size": 4096, 00:04:11.121 "num_blocks": 256, 00:04:11.121 "uuid": "02013fd3-05a8-44ac-8fbc-6832414c1457", 00:04:11.121 "assigned_rate_limits": { 00:04:11.121 "rw_ios_per_sec": 0, 00:04:11.121 "rw_mbytes_per_sec": 0, 00:04:11.121 "r_mbytes_per_sec": 0, 00:04:11.121 "w_mbytes_per_sec": 0 00:04:11.121 }, 00:04:11.121 "claimed": false, 00:04:11.121 "zoned": false, 00:04:11.121 "supported_io_types": { 00:04:11.121 "read": true, 00:04:11.121 "write": true, 00:04:11.121 "unmap": true, 00:04:11.121 "write_zeroes": true, 00:04:11.121 "flush": true, 00:04:11.121 "reset": true, 00:04:11.121 "compare": false, 00:04:11.121 "compare_and_write": false, 00:04:11.121 "abort": true, 00:04:11.121 "nvme_admin": false, 00:04:11.121 "nvme_io": false 00:04:11.121 }, 00:04:11.121 "memory_domains": [ 00:04:11.121 { 00:04:11.121 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.121 "dma_device_type": 2 00:04:11.121 } 00:04:11.121 ], 00:04:11.121 "driver_specific": {} 00:04:11.121 } 00:04:11.121 ]' 00:04:11.121 20:05:16 -- rpc/rpc.sh@32 -- # jq length 00:04:11.121 20:05:16 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:11.121 20:05:16 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:11.121 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.121 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.121 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.121 20:05:16 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:11.121 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.121 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.379 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.379 20:05:16 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:11.379 20:05:16 -- rpc/rpc.sh@36 -- # jq length 00:04:11.379 20:05:16 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:11.379 00:04:11.379 real 0m0.108s 00:04:11.379 user 0m0.073s 00:04:11.379 sys 0m0.007s 00:04:11.379 20:05:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.379 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.379 ************************************ 00:04:11.379 END TEST rpc_plugins 00:04:11.379 ************************************ 00:04:11.379 20:05:16 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:11.379 20:05:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.379 20:05:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.379 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.379 ************************************ 00:04:11.379 START TEST rpc_trace_cmd_test 00:04:11.379 ************************************ 00:04:11.379 20:05:16 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:11.379 20:05:16 -- rpc/rpc.sh@40 -- # local info 00:04:11.379 20:05:16 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:11.379 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.379 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.379 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.379 20:05:16 -- rpc/rpc.sh@42 -- # info='{ 00:04:11.379 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3033768", 00:04:11.379 "tpoint_group_mask": "0x8", 00:04:11.379 "iscsi_conn": { 00:04:11.379 "mask": "0x2", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "scsi": { 00:04:11.379 "mask": "0x4", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "bdev": { 00:04:11.379 "mask": "0x8", 00:04:11.379 "tpoint_mask": "0xffffffffffffffff" 00:04:11.379 }, 00:04:11.379 "nvmf_rdma": { 00:04:11.379 "mask": "0x10", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "nvmf_tcp": { 00:04:11.379 "mask": "0x20", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "ftl": { 00:04:11.379 "mask": "0x40", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "blobfs": { 00:04:11.379 "mask": "0x80", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "dsa": { 00:04:11.379 "mask": "0x200", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "thread": { 00:04:11.379 "mask": "0x400", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "nvme_pcie": { 00:04:11.379 "mask": "0x800", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "iaa": { 00:04:11.379 "mask": "0x1000", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "nvme_tcp": { 00:04:11.379 "mask": "0x2000", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 }, 00:04:11.379 "bdev_nvme": { 00:04:11.379 "mask": "0x4000", 00:04:11.379 "tpoint_mask": "0x0" 00:04:11.379 } 00:04:11.379 }' 00:04:11.379 20:05:16 -- rpc/rpc.sh@43 -- # jq length 00:04:11.379 20:05:16 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:11.379 20:05:16 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:11.379 20:05:16 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:11.379 20:05:16 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:11.379 20:05:16 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:11.379 20:05:16 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:11.379 20:05:16 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:11.379 20:05:16 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:11.379 20:05:16 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:11.379 00:04:11.379 real 0m0.194s 00:04:11.379 user 0m0.174s 00:04:11.379 sys 0m0.013s 00:04:11.379 20:05:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.379 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.379 ************************************ 00:04:11.379 END TEST rpc_trace_cmd_test 00:04:11.379 ************************************ 00:04:11.638 20:05:16 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:11.638 20:05:16 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:11.638 20:05:16 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:11.638 20:05:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.638 20:05:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.638 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.638 ************************************ 00:04:11.638 START TEST rpc_daemon_integrity 00:04:11.638 ************************************ 00:04:11.638 20:05:16 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:11.638 20:05:16 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:11.638 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.638 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.638 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.638 20:05:16 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:11.638 20:05:16 -- rpc/rpc.sh@13 -- # jq length 00:04:11.638 20:05:16 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:11.638 20:05:16 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:11.638 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.638 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.638 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.638 20:05:16 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:11.638 20:05:16 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:11.638 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.638 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.638 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.638 20:05:16 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:11.638 { 00:04:11.638 "name": "Malloc2", 00:04:11.638 "aliases": [ 00:04:11.638 "79bcd477-9f72-48be-abb7-5aeb4e94dfcf" 00:04:11.638 ], 00:04:11.638 "product_name": "Malloc disk", 00:04:11.638 "block_size": 512, 00:04:11.638 "num_blocks": 16384, 00:04:11.638 "uuid": "79bcd477-9f72-48be-abb7-5aeb4e94dfcf", 00:04:11.638 "assigned_rate_limits": { 00:04:11.638 "rw_ios_per_sec": 0, 00:04:11.638 "rw_mbytes_per_sec": 0, 00:04:11.638 "r_mbytes_per_sec": 0, 00:04:11.638 "w_mbytes_per_sec": 0 00:04:11.638 }, 00:04:11.638 "claimed": false, 00:04:11.638 "zoned": false, 00:04:11.638 "supported_io_types": { 00:04:11.638 "read": true, 00:04:11.638 "write": true, 00:04:11.638 "unmap": true, 00:04:11.638 "write_zeroes": true, 00:04:11.638 "flush": true, 00:04:11.638 "reset": true, 00:04:11.638 "compare": false, 00:04:11.638 "compare_and_write": false, 00:04:11.638 "abort": true, 00:04:11.638 "nvme_admin": false, 00:04:11.638 "nvme_io": false 00:04:11.638 }, 00:04:11.638 "memory_domains": [ 00:04:11.638 { 00:04:11.638 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.638 "dma_device_type": 2 00:04:11.638 } 00:04:11.638 ], 00:04:11.638 "driver_specific": {} 00:04:11.638 } 00:04:11.638 ]' 00:04:11.638 20:05:16 -- rpc/rpc.sh@17 -- # jq length 00:04:11.638 20:05:16 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:11.638 20:05:16 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:11.638 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.638 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.638 [2024-11-20 20:05:16.543376] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:11.638 [2024-11-20 20:05:16.543422] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:11.638 [2024-11-20 20:05:16.543446] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xaf7590 00:04:11.638 [2024-11-20 20:05:16.543461] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:11.638 [2024-11-20 20:05:16.544779] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:11.638 [2024-11-20 20:05:16.544807] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:11.638 Passthru0 00:04:11.638 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.638 20:05:16 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:11.638 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.638 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.638 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.638 20:05:16 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:11.638 { 00:04:11.638 "name": "Malloc2", 00:04:11.638 "aliases": [ 00:04:11.638 "79bcd477-9f72-48be-abb7-5aeb4e94dfcf" 00:04:11.638 ], 00:04:11.638 "product_name": "Malloc disk", 00:04:11.638 "block_size": 512, 00:04:11.638 "num_blocks": 16384, 00:04:11.638 "uuid": "79bcd477-9f72-48be-abb7-5aeb4e94dfcf", 00:04:11.638 "assigned_rate_limits": { 00:04:11.638 "rw_ios_per_sec": 0, 00:04:11.638 "rw_mbytes_per_sec": 0, 00:04:11.638 "r_mbytes_per_sec": 0, 00:04:11.638 "w_mbytes_per_sec": 0 00:04:11.638 }, 00:04:11.638 "claimed": true, 00:04:11.638 "claim_type": "exclusive_write", 00:04:11.638 "zoned": false, 00:04:11.638 "supported_io_types": { 00:04:11.638 "read": true, 00:04:11.638 "write": true, 00:04:11.638 "unmap": true, 00:04:11.638 "write_zeroes": true, 00:04:11.638 "flush": true, 00:04:11.638 "reset": true, 00:04:11.638 "compare": false, 00:04:11.638 "compare_and_write": false, 00:04:11.638 "abort": true, 00:04:11.639 "nvme_admin": false, 00:04:11.639 "nvme_io": false 00:04:11.639 }, 00:04:11.639 "memory_domains": [ 00:04:11.639 { 00:04:11.639 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.639 "dma_device_type": 2 00:04:11.639 } 00:04:11.639 ], 00:04:11.639 "driver_specific": {} 00:04:11.639 }, 00:04:11.639 { 00:04:11.639 "name": "Passthru0", 00:04:11.639 "aliases": [ 00:04:11.639 "dcbdd3e6-ac57-5d33-92b5-ffee1b55189c" 00:04:11.639 ], 00:04:11.639 "product_name": "passthru", 00:04:11.639 "block_size": 512, 00:04:11.639 "num_blocks": 16384, 00:04:11.639 "uuid": "dcbdd3e6-ac57-5d33-92b5-ffee1b55189c", 00:04:11.639 "assigned_rate_limits": { 00:04:11.639 "rw_ios_per_sec": 0, 00:04:11.639 "rw_mbytes_per_sec": 0, 00:04:11.639 "r_mbytes_per_sec": 0, 00:04:11.639 "w_mbytes_per_sec": 0 00:04:11.639 }, 00:04:11.639 "claimed": false, 00:04:11.639 "zoned": false, 00:04:11.639 "supported_io_types": { 00:04:11.639 "read": true, 00:04:11.639 "write": true, 00:04:11.639 "unmap": true, 00:04:11.639 "write_zeroes": true, 00:04:11.639 "flush": true, 00:04:11.639 "reset": true, 00:04:11.639 "compare": false, 00:04:11.639 "compare_and_write": false, 00:04:11.639 "abort": true, 00:04:11.639 "nvme_admin": false, 00:04:11.639 "nvme_io": false 00:04:11.639 }, 00:04:11.639 "memory_domains": [ 00:04:11.639 { 00:04:11.639 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.639 "dma_device_type": 2 00:04:11.639 } 00:04:11.639 ], 00:04:11.639 "driver_specific": { 00:04:11.639 "passthru": { 00:04:11.639 "name": "Passthru0", 00:04:11.639 "base_bdev_name": "Malloc2" 00:04:11.639 } 00:04:11.639 } 00:04:11.639 } 00:04:11.639 ]' 00:04:11.639 20:05:16 -- rpc/rpc.sh@21 -- # jq length 00:04:11.639 20:05:16 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:11.639 20:05:16 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:11.639 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.639 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.639 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.639 20:05:16 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:11.639 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.639 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.639 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.639 20:05:16 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:11.639 20:05:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.639 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.639 20:05:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.639 20:05:16 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:11.639 20:05:16 -- rpc/rpc.sh@26 -- # jq length 00:04:11.639 20:05:16 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:11.639 00:04:11.639 real 0m0.228s 00:04:11.639 user 0m0.150s 00:04:11.639 sys 0m0.021s 00:04:11.639 20:05:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.639 20:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:11.639 ************************************ 00:04:11.639 END TEST rpc_daemon_integrity 00:04:11.639 ************************************ 00:04:11.897 20:05:16 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:11.897 20:05:16 -- rpc/rpc.sh@84 -- # killprocess 3033768 00:04:11.897 20:05:16 -- common/autotest_common.sh@936 -- # '[' -z 3033768 ']' 00:04:11.897 20:05:16 -- common/autotest_common.sh@940 -- # kill -0 3033768 00:04:11.897 20:05:16 -- common/autotest_common.sh@941 -- # uname 00:04:11.897 20:05:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:11.897 20:05:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3033768 00:04:11.897 20:05:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:11.897 20:05:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:11.897 20:05:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3033768' 00:04:11.897 killing process with pid 3033768 00:04:11.897 20:05:16 -- common/autotest_common.sh@955 -- # kill 3033768 00:04:11.897 20:05:16 -- common/autotest_common.sh@960 -- # wait 3033768 00:04:12.155 00:04:12.155 real 0m2.553s 00:04:12.155 user 0m3.253s 00:04:12.155 sys 0m0.590s 00:04:12.155 20:05:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.155 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.155 ************************************ 00:04:12.155 END TEST rpc 00:04:12.155 ************************************ 00:04:12.413 20:05:17 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:12.413 20:05:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.413 20:05:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.413 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.413 ************************************ 00:04:12.413 START TEST rpc_client 00:04:12.413 ************************************ 00:04:12.413 20:05:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:12.413 * Looking for test storage... 00:04:12.413 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:12.413 20:05:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:12.413 20:05:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:12.413 20:05:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:12.413 20:05:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:12.413 20:05:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:12.413 20:05:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:12.413 20:05:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:12.413 20:05:17 -- scripts/common.sh@335 -- # IFS=.-: 00:04:12.413 20:05:17 -- scripts/common.sh@335 -- # read -ra ver1 00:04:12.413 20:05:17 -- scripts/common.sh@336 -- # IFS=.-: 00:04:12.413 20:05:17 -- scripts/common.sh@336 -- # read -ra ver2 00:04:12.413 20:05:17 -- scripts/common.sh@337 -- # local 'op=<' 00:04:12.413 20:05:17 -- scripts/common.sh@339 -- # ver1_l=2 00:04:12.413 20:05:17 -- scripts/common.sh@340 -- # ver2_l=1 00:04:12.413 20:05:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:12.413 20:05:17 -- scripts/common.sh@343 -- # case "$op" in 00:04:12.413 20:05:17 -- scripts/common.sh@344 -- # : 1 00:04:12.413 20:05:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:12.414 20:05:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:12.414 20:05:17 -- scripts/common.sh@364 -- # decimal 1 00:04:12.414 20:05:17 -- scripts/common.sh@352 -- # local d=1 00:04:12.414 20:05:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:12.414 20:05:17 -- scripts/common.sh@354 -- # echo 1 00:04:12.414 20:05:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:12.414 20:05:17 -- scripts/common.sh@365 -- # decimal 2 00:04:12.414 20:05:17 -- scripts/common.sh@352 -- # local d=2 00:04:12.414 20:05:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:12.414 20:05:17 -- scripts/common.sh@354 -- # echo 2 00:04:12.414 20:05:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:12.414 20:05:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:12.414 20:05:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:12.414 20:05:17 -- scripts/common.sh@367 -- # return 0 00:04:12.414 20:05:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:12.414 20:05:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:12.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.414 --rc genhtml_branch_coverage=1 00:04:12.414 --rc genhtml_function_coverage=1 00:04:12.414 --rc genhtml_legend=1 00:04:12.414 --rc geninfo_all_blocks=1 00:04:12.414 --rc geninfo_unexecuted_blocks=1 00:04:12.414 00:04:12.414 ' 00:04:12.414 20:05:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:12.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.414 --rc genhtml_branch_coverage=1 00:04:12.414 --rc genhtml_function_coverage=1 00:04:12.414 --rc genhtml_legend=1 00:04:12.414 --rc geninfo_all_blocks=1 00:04:12.414 --rc geninfo_unexecuted_blocks=1 00:04:12.414 00:04:12.414 ' 00:04:12.414 20:05:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:12.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.414 --rc genhtml_branch_coverage=1 00:04:12.414 --rc genhtml_function_coverage=1 00:04:12.414 --rc genhtml_legend=1 00:04:12.414 --rc geninfo_all_blocks=1 00:04:12.414 --rc geninfo_unexecuted_blocks=1 00:04:12.414 00:04:12.414 ' 00:04:12.414 20:05:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:12.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.414 --rc genhtml_branch_coverage=1 00:04:12.414 --rc genhtml_function_coverage=1 00:04:12.414 --rc genhtml_legend=1 00:04:12.414 --rc geninfo_all_blocks=1 00:04:12.414 --rc geninfo_unexecuted_blocks=1 00:04:12.414 00:04:12.414 ' 00:04:12.414 20:05:17 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:12.414 OK 00:04:12.414 20:05:17 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:12.414 00:04:12.414 real 0m0.146s 00:04:12.414 user 0m0.090s 00:04:12.414 sys 0m0.064s 00:04:12.414 20:05:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.414 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.414 ************************************ 00:04:12.414 END TEST rpc_client 00:04:12.414 ************************************ 00:04:12.414 20:05:17 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:12.414 20:05:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.414 20:05:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.414 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.414 ************************************ 00:04:12.414 START TEST json_config 00:04:12.414 ************************************ 00:04:12.414 20:05:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:12.414 20:05:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:12.414 20:05:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:12.414 20:05:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:12.673 20:05:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:12.673 20:05:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:12.673 20:05:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:12.673 20:05:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:12.673 20:05:17 -- scripts/common.sh@335 -- # IFS=.-: 00:04:12.673 20:05:17 -- scripts/common.sh@335 -- # read -ra ver1 00:04:12.673 20:05:17 -- scripts/common.sh@336 -- # IFS=.-: 00:04:12.673 20:05:17 -- scripts/common.sh@336 -- # read -ra ver2 00:04:12.673 20:05:17 -- scripts/common.sh@337 -- # local 'op=<' 00:04:12.673 20:05:17 -- scripts/common.sh@339 -- # ver1_l=2 00:04:12.673 20:05:17 -- scripts/common.sh@340 -- # ver2_l=1 00:04:12.673 20:05:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:12.673 20:05:17 -- scripts/common.sh@343 -- # case "$op" in 00:04:12.673 20:05:17 -- scripts/common.sh@344 -- # : 1 00:04:12.673 20:05:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:12.673 20:05:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:12.673 20:05:17 -- scripts/common.sh@364 -- # decimal 1 00:04:12.673 20:05:17 -- scripts/common.sh@352 -- # local d=1 00:04:12.673 20:05:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:12.673 20:05:17 -- scripts/common.sh@354 -- # echo 1 00:04:12.673 20:05:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:12.673 20:05:17 -- scripts/common.sh@365 -- # decimal 2 00:04:12.673 20:05:17 -- scripts/common.sh@352 -- # local d=2 00:04:12.673 20:05:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:12.673 20:05:17 -- scripts/common.sh@354 -- # echo 2 00:04:12.673 20:05:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:12.673 20:05:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:12.673 20:05:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:12.673 20:05:17 -- scripts/common.sh@367 -- # return 0 00:04:12.673 20:05:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:12.673 20:05:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:12.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.673 --rc genhtml_branch_coverage=1 00:04:12.673 --rc genhtml_function_coverage=1 00:04:12.673 --rc genhtml_legend=1 00:04:12.673 --rc geninfo_all_blocks=1 00:04:12.673 --rc geninfo_unexecuted_blocks=1 00:04:12.673 00:04:12.673 ' 00:04:12.673 20:05:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:12.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.673 --rc genhtml_branch_coverage=1 00:04:12.673 --rc genhtml_function_coverage=1 00:04:12.673 --rc genhtml_legend=1 00:04:12.673 --rc geninfo_all_blocks=1 00:04:12.673 --rc geninfo_unexecuted_blocks=1 00:04:12.673 00:04:12.673 ' 00:04:12.673 20:05:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:12.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.673 --rc genhtml_branch_coverage=1 00:04:12.673 --rc genhtml_function_coverage=1 00:04:12.673 --rc genhtml_legend=1 00:04:12.673 --rc geninfo_all_blocks=1 00:04:12.673 --rc geninfo_unexecuted_blocks=1 00:04:12.673 00:04:12.673 ' 00:04:12.673 20:05:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:12.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.673 --rc genhtml_branch_coverage=1 00:04:12.673 --rc genhtml_function_coverage=1 00:04:12.673 --rc genhtml_legend=1 00:04:12.673 --rc geninfo_all_blocks=1 00:04:12.673 --rc geninfo_unexecuted_blocks=1 00:04:12.673 00:04:12.673 ' 00:04:12.673 20:05:17 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:12.673 20:05:17 -- nvmf/common.sh@7 -- # uname -s 00:04:12.673 20:05:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:12.673 20:05:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:12.673 20:05:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:12.673 20:05:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:12.673 20:05:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:12.673 20:05:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:12.673 20:05:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:12.673 20:05:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:12.673 20:05:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:12.673 20:05:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:12.673 20:05:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:12.673 20:05:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:12.673 20:05:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:12.673 20:05:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:12.673 20:05:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:12.673 20:05:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:12.673 20:05:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:12.673 20:05:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:12.673 20:05:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:12.673 20:05:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:12.674 20:05:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:12.674 20:05:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:12.674 20:05:17 -- paths/export.sh@5 -- # export PATH 00:04:12.674 20:05:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:12.674 20:05:17 -- nvmf/common.sh@46 -- # : 0 00:04:12.674 20:05:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:12.674 20:05:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:12.674 20:05:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:12.674 20:05:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:12.674 20:05:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:12.674 20:05:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:12.674 20:05:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:12.674 20:05:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:12.674 20:05:17 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:12.674 20:05:17 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:12.674 20:05:17 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:12.674 20:05:17 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:12.674 20:05:17 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:12.674 20:05:17 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:12.674 20:05:17 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:12.674 20:05:17 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:12.674 20:05:17 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:12.674 20:05:17 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:12.674 20:05:17 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:12.674 20:05:17 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:12.674 INFO: JSON configuration test init 00:04:12.674 20:05:17 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:12.674 20:05:17 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:12.674 20:05:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:12.674 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.674 20:05:17 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:12.674 20:05:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:12.674 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.674 20:05:17 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:12.674 20:05:17 -- json_config/json_config.sh@98 -- # local app=target 00:04:12.674 20:05:17 -- json_config/json_config.sh@99 -- # shift 00:04:12.674 20:05:17 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:12.674 20:05:17 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:12.674 20:05:17 -- json_config/json_config.sh@111 -- # app_pid[$app]=3034359 00:04:12.674 20:05:17 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:12.674 20:05:17 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:12.674 Waiting for target to run... 00:04:12.674 20:05:17 -- json_config/json_config.sh@114 -- # waitforlisten 3034359 /var/tmp/spdk_tgt.sock 00:04:12.674 20:05:17 -- common/autotest_common.sh@829 -- # '[' -z 3034359 ']' 00:04:12.674 20:05:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:12.674 20:05:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:12.674 20:05:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:12.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:12.674 20:05:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:12.674 20:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:12.674 [2024-11-20 20:05:17.569892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:12.674 [2024-11-20 20:05:17.569974] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3034359 ] 00:04:12.674 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.932 [2024-11-20 20:05:17.899196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:13.190 [2024-11-20 20:05:17.986423] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:13.190 [2024-11-20 20:05:17.986591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:13.755 20:05:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:13.755 20:05:18 -- common/autotest_common.sh@862 -- # return 0 00:04:13.755 20:05:18 -- json_config/json_config.sh@115 -- # echo '' 00:04:13.755 00:04:13.755 20:05:18 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:13.755 20:05:18 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:13.755 20:05:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:13.755 20:05:18 -- common/autotest_common.sh@10 -- # set +x 00:04:13.755 20:05:18 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:13.755 20:05:18 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:13.755 20:05:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:13.755 20:05:18 -- common/autotest_common.sh@10 -- # set +x 00:04:13.755 20:05:18 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:13.755 20:05:18 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:13.755 20:05:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:17.039 20:05:21 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:17.039 20:05:21 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:17.039 20:05:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:17.039 20:05:21 -- common/autotest_common.sh@10 -- # set +x 00:04:17.039 20:05:21 -- json_config/json_config.sh@48 -- # local ret=0 00:04:17.039 20:05:21 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:17.039 20:05:21 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:17.039 20:05:21 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:17.039 20:05:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:17.039 20:05:21 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:17.039 20:05:21 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:17.039 20:05:21 -- json_config/json_config.sh@51 -- # local get_types 00:04:17.039 20:05:21 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:17.039 20:05:21 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:17.039 20:05:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:17.039 20:05:21 -- common/autotest_common.sh@10 -- # set +x 00:04:17.039 20:05:21 -- json_config/json_config.sh@58 -- # return 0 00:04:17.039 20:05:21 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:17.039 20:05:21 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:17.039 20:05:21 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:17.039 20:05:21 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:17.039 20:05:21 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:17.039 20:05:21 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:17.039 20:05:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:17.039 20:05:21 -- common/autotest_common.sh@10 -- # set +x 00:04:17.039 20:05:22 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:17.039 20:05:22 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:17.039 20:05:22 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:17.039 20:05:22 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:17.039 20:05:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:17.297 MallocForNvmf0 00:04:17.297 20:05:22 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:17.297 20:05:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:17.555 MallocForNvmf1 00:04:17.555 20:05:22 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:17.555 20:05:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:17.813 [2024-11-20 20:05:22.714641] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:17.813 20:05:22 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:17.813 20:05:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:18.073 20:05:22 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:18.073 20:05:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:18.330 20:05:23 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:18.330 20:05:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:18.588 20:05:23 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:18.588 20:05:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:18.846 [2024-11-20 20:05:23.721975] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:18.846 20:05:23 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:18.846 20:05:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:18.846 20:05:23 -- common/autotest_common.sh@10 -- # set +x 00:04:18.846 20:05:23 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:18.846 20:05:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:18.846 20:05:23 -- common/autotest_common.sh@10 -- # set +x 00:04:18.846 20:05:23 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:18.846 20:05:23 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:18.846 20:05:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:19.104 MallocBdevForConfigChangeCheck 00:04:19.104 20:05:24 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:19.104 20:05:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:19.104 20:05:24 -- common/autotest_common.sh@10 -- # set +x 00:04:19.104 20:05:24 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:19.104 20:05:24 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:19.669 20:05:24 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:19.669 INFO: shutting down applications... 00:04:19.669 20:05:24 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:19.669 20:05:24 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:19.669 20:05:24 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:19.669 20:05:24 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:21.042 Calling clear_iscsi_subsystem 00:04:21.042 Calling clear_nvmf_subsystem 00:04:21.042 Calling clear_nbd_subsystem 00:04:21.042 Calling clear_ublk_subsystem 00:04:21.042 Calling clear_vhost_blk_subsystem 00:04:21.042 Calling clear_vhost_scsi_subsystem 00:04:21.042 Calling clear_scheduler_subsystem 00:04:21.042 Calling clear_bdev_subsystem 00:04:21.042 Calling clear_accel_subsystem 00:04:21.042 Calling clear_vmd_subsystem 00:04:21.042 Calling clear_sock_subsystem 00:04:21.042 Calling clear_iobuf_subsystem 00:04:21.042 20:05:26 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:21.042 20:05:26 -- json_config/json_config.sh@396 -- # count=100 00:04:21.042 20:05:26 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:21.042 20:05:26 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:21.042 20:05:26 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:21.042 20:05:26 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:21.608 20:05:26 -- json_config/json_config.sh@398 -- # break 00:04:21.608 20:05:26 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:21.608 20:05:26 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:21.608 20:05:26 -- json_config/json_config.sh@120 -- # local app=target 00:04:21.608 20:05:26 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:21.608 20:05:26 -- json_config/json_config.sh@124 -- # [[ -n 3034359 ]] 00:04:21.608 20:05:26 -- json_config/json_config.sh@127 -- # kill -SIGINT 3034359 00:04:21.608 20:05:26 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:21.608 20:05:26 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:21.608 20:05:26 -- json_config/json_config.sh@130 -- # kill -0 3034359 00:04:21.608 20:05:26 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:22.176 20:05:26 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:22.176 20:05:26 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:22.176 20:05:26 -- json_config/json_config.sh@130 -- # kill -0 3034359 00:04:22.176 20:05:26 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:22.176 20:05:26 -- json_config/json_config.sh@132 -- # break 00:04:22.176 20:05:26 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:22.176 20:05:26 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:22.176 SPDK target shutdown done 00:04:22.176 20:05:26 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:22.176 INFO: relaunching applications... 00:04:22.176 20:05:26 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:22.176 20:05:26 -- json_config/json_config.sh@98 -- # local app=target 00:04:22.176 20:05:26 -- json_config/json_config.sh@99 -- # shift 00:04:22.176 20:05:26 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:22.176 20:05:26 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:22.176 20:05:26 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:22.176 20:05:26 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:22.176 20:05:26 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:22.176 20:05:26 -- json_config/json_config.sh@111 -- # app_pid[$app]=3035616 00:04:22.176 20:05:26 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:22.176 20:05:26 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:22.176 Waiting for target to run... 00:04:22.176 20:05:26 -- json_config/json_config.sh@114 -- # waitforlisten 3035616 /var/tmp/spdk_tgt.sock 00:04:22.176 20:05:26 -- common/autotest_common.sh@829 -- # '[' -z 3035616 ']' 00:04:22.176 20:05:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:22.176 20:05:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:22.176 20:05:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:22.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:22.177 20:05:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:22.177 20:05:26 -- common/autotest_common.sh@10 -- # set +x 00:04:22.177 [2024-11-20 20:05:26.959206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:22.177 [2024-11-20 20:05:26.959289] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3035616 ] 00:04:22.177 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.744 [2024-11-20 20:05:27.479328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:22.744 [2024-11-20 20:05:27.581181] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:22.744 [2024-11-20 20:05:27.581367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:26.052 [2024-11-20 20:05:30.619878] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:26.052 [2024-11-20 20:05:30.652386] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:26.052 20:05:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:26.052 20:05:30 -- common/autotest_common.sh@862 -- # return 0 00:04:26.052 20:05:30 -- json_config/json_config.sh@115 -- # echo '' 00:04:26.052 00:04:26.052 20:05:30 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:26.052 20:05:30 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:26.052 INFO: Checking if target configuration is the same... 00:04:26.052 20:05:30 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.052 20:05:30 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:26.053 20:05:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:26.053 + '[' 2 -ne 2 ']' 00:04:26.053 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:26.053 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:26.053 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:26.053 +++ basename /dev/fd/62 00:04:26.053 ++ mktemp /tmp/62.XXX 00:04:26.053 + tmp_file_1=/tmp/62.Zw2 00:04:26.053 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.053 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:26.053 + tmp_file_2=/tmp/spdk_tgt_config.json.Cts 00:04:26.053 + ret=0 00:04:26.053 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:26.352 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:26.352 + diff -u /tmp/62.Zw2 /tmp/spdk_tgt_config.json.Cts 00:04:26.352 + echo 'INFO: JSON config files are the same' 00:04:26.352 INFO: JSON config files are the same 00:04:26.352 + rm /tmp/62.Zw2 /tmp/spdk_tgt_config.json.Cts 00:04:26.352 + exit 0 00:04:26.352 20:05:31 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:26.352 20:05:31 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:26.352 INFO: changing configuration and checking if this can be detected... 00:04:26.352 20:05:31 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:26.352 20:05:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:26.632 20:05:31 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.632 20:05:31 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:26.632 20:05:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:26.632 + '[' 2 -ne 2 ']' 00:04:26.632 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:26.632 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:26.632 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:26.632 +++ basename /dev/fd/62 00:04:26.632 ++ mktemp /tmp/62.XXX 00:04:26.632 + tmp_file_1=/tmp/62.YA2 00:04:26.632 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.632 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:26.632 + tmp_file_2=/tmp/spdk_tgt_config.json.9zu 00:04:26.632 + ret=0 00:04:26.632 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:26.890 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:27.148 + diff -u /tmp/62.YA2 /tmp/spdk_tgt_config.json.9zu 00:04:27.148 + ret=1 00:04:27.148 + echo '=== Start of file: /tmp/62.YA2 ===' 00:04:27.148 + cat /tmp/62.YA2 00:04:27.148 + echo '=== End of file: /tmp/62.YA2 ===' 00:04:27.148 + echo '' 00:04:27.148 + echo '=== Start of file: /tmp/spdk_tgt_config.json.9zu ===' 00:04:27.148 + cat /tmp/spdk_tgt_config.json.9zu 00:04:27.148 + echo '=== End of file: /tmp/spdk_tgt_config.json.9zu ===' 00:04:27.148 + echo '' 00:04:27.148 + rm /tmp/62.YA2 /tmp/spdk_tgt_config.json.9zu 00:04:27.148 + exit 1 00:04:27.148 20:05:31 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:27.148 INFO: configuration change detected. 00:04:27.148 20:05:31 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:27.148 20:05:31 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:27.148 20:05:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.148 20:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:27.148 20:05:31 -- json_config/json_config.sh@360 -- # local ret=0 00:04:27.148 20:05:31 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:27.148 20:05:31 -- json_config/json_config.sh@370 -- # [[ -n 3035616 ]] 00:04:27.148 20:05:31 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:27.148 20:05:31 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:27.148 20:05:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.148 20:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:27.148 20:05:31 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:27.148 20:05:31 -- json_config/json_config.sh@246 -- # uname -s 00:04:27.148 20:05:31 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:27.148 20:05:31 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:27.148 20:05:31 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:27.148 20:05:31 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:27.148 20:05:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:27.148 20:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:27.148 20:05:32 -- json_config/json_config.sh@376 -- # killprocess 3035616 00:04:27.148 20:05:32 -- common/autotest_common.sh@936 -- # '[' -z 3035616 ']' 00:04:27.148 20:05:32 -- common/autotest_common.sh@940 -- # kill -0 3035616 00:04:27.148 20:05:32 -- common/autotest_common.sh@941 -- # uname 00:04:27.148 20:05:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:27.148 20:05:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3035616 00:04:27.148 20:05:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:27.148 20:05:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:27.148 20:05:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3035616' 00:04:27.148 killing process with pid 3035616 00:04:27.148 20:05:32 -- common/autotest_common.sh@955 -- # kill 3035616 00:04:27.148 20:05:32 -- common/autotest_common.sh@960 -- # wait 3035616 00:04:29.048 20:05:33 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:29.048 20:05:33 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:29.048 20:05:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:29.048 20:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:29.048 20:05:33 -- json_config/json_config.sh@381 -- # return 0 00:04:29.048 20:05:33 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:29.048 INFO: Success 00:04:29.048 00:04:29.048 real 0m16.353s 00:04:29.048 user 0m18.934s 00:04:29.048 sys 0m2.041s 00:04:29.048 20:05:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:29.048 20:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:29.048 ************************************ 00:04:29.048 END TEST json_config 00:04:29.048 ************************************ 00:04:29.048 20:05:33 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:29.048 20:05:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.048 20:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.048 20:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:29.048 ************************************ 00:04:29.048 START TEST json_config_extra_key 00:04:29.048 ************************************ 00:04:29.048 20:05:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:29.048 20:05:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:29.048 20:05:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:29.048 20:05:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:29.048 20:05:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:29.048 20:05:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:29.048 20:05:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:29.048 20:05:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:29.048 20:05:33 -- scripts/common.sh@335 -- # IFS=.-: 00:04:29.048 20:05:33 -- scripts/common.sh@335 -- # read -ra ver1 00:04:29.048 20:05:33 -- scripts/common.sh@336 -- # IFS=.-: 00:04:29.048 20:05:33 -- scripts/common.sh@336 -- # read -ra ver2 00:04:29.048 20:05:33 -- scripts/common.sh@337 -- # local 'op=<' 00:04:29.048 20:05:33 -- scripts/common.sh@339 -- # ver1_l=2 00:04:29.048 20:05:33 -- scripts/common.sh@340 -- # ver2_l=1 00:04:29.048 20:05:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:29.048 20:05:33 -- scripts/common.sh@343 -- # case "$op" in 00:04:29.048 20:05:33 -- scripts/common.sh@344 -- # : 1 00:04:29.048 20:05:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:29.048 20:05:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:29.048 20:05:33 -- scripts/common.sh@364 -- # decimal 1 00:04:29.048 20:05:33 -- scripts/common.sh@352 -- # local d=1 00:04:29.048 20:05:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:29.048 20:05:33 -- scripts/common.sh@354 -- # echo 1 00:04:29.048 20:05:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:29.048 20:05:33 -- scripts/common.sh@365 -- # decimal 2 00:04:29.048 20:05:33 -- scripts/common.sh@352 -- # local d=2 00:04:29.048 20:05:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:29.048 20:05:33 -- scripts/common.sh@354 -- # echo 2 00:04:29.048 20:05:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:29.048 20:05:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:29.048 20:05:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:29.048 20:05:33 -- scripts/common.sh@367 -- # return 0 00:04:29.048 20:05:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:29.048 20:05:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.048 --rc genhtml_branch_coverage=1 00:04:29.048 --rc genhtml_function_coverage=1 00:04:29.048 --rc genhtml_legend=1 00:04:29.048 --rc geninfo_all_blocks=1 00:04:29.048 --rc geninfo_unexecuted_blocks=1 00:04:29.048 00:04:29.048 ' 00:04:29.048 20:05:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.048 --rc genhtml_branch_coverage=1 00:04:29.048 --rc genhtml_function_coverage=1 00:04:29.048 --rc genhtml_legend=1 00:04:29.048 --rc geninfo_all_blocks=1 00:04:29.048 --rc geninfo_unexecuted_blocks=1 00:04:29.048 00:04:29.048 ' 00:04:29.048 20:05:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.048 --rc genhtml_branch_coverage=1 00:04:29.048 --rc genhtml_function_coverage=1 00:04:29.048 --rc genhtml_legend=1 00:04:29.048 --rc geninfo_all_blocks=1 00:04:29.048 --rc geninfo_unexecuted_blocks=1 00:04:29.048 00:04:29.048 ' 00:04:29.048 20:05:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.048 --rc genhtml_branch_coverage=1 00:04:29.048 --rc genhtml_function_coverage=1 00:04:29.048 --rc genhtml_legend=1 00:04:29.048 --rc geninfo_all_blocks=1 00:04:29.048 --rc geninfo_unexecuted_blocks=1 00:04:29.048 00:04:29.048 ' 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:29.048 20:05:33 -- nvmf/common.sh@7 -- # uname -s 00:04:29.048 20:05:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:29.048 20:05:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:29.048 20:05:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:29.048 20:05:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:29.048 20:05:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:29.048 20:05:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:29.048 20:05:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:29.048 20:05:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:29.048 20:05:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:29.048 20:05:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:29.048 20:05:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:29.048 20:05:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:29.048 20:05:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:29.048 20:05:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:29.048 20:05:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:29.048 20:05:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:29.048 20:05:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:29.048 20:05:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:29.048 20:05:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:29.048 20:05:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:29.048 20:05:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:29.048 20:05:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:29.048 20:05:33 -- paths/export.sh@5 -- # export PATH 00:04:29.048 20:05:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:29.048 20:05:33 -- nvmf/common.sh@46 -- # : 0 00:04:29.048 20:05:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:29.048 20:05:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:29.048 20:05:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:29.048 20:05:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:29.048 20:05:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:29.048 20:05:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:29.048 20:05:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:29.048 20:05:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:29.048 INFO: launching applications... 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3036566 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:29.048 Waiting for target to run... 00:04:29.048 20:05:33 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3036566 /var/tmp/spdk_tgt.sock 00:04:29.048 20:05:33 -- common/autotest_common.sh@829 -- # '[' -z 3036566 ']' 00:04:29.048 20:05:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:29.048 20:05:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:29.048 20:05:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:29.048 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:29.048 20:05:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:29.048 20:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:29.048 [2024-11-20 20:05:33.938908] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:29.048 [2024-11-20 20:05:33.939003] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3036566 ] 00:04:29.048 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.307 [2024-11-20 20:05:34.278017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.565 [2024-11-20 20:05:34.364623] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:29.565 [2024-11-20 20:05:34.364799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.131 20:05:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:30.131 20:05:34 -- common/autotest_common.sh@862 -- # return 0 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:30.131 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:30.131 INFO: shutting down applications... 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3036566 ]] 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3036566 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3036566 00:04:30.131 20:05:34 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3036566 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:30.389 SPDK target shutdown done 00:04:30.389 20:05:35 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:30.389 Success 00:04:30.389 00:04:30.389 real 0m1.635s 00:04:30.389 user 0m1.656s 00:04:30.389 sys 0m0.438s 00:04:30.389 20:05:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.389 20:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:30.389 ************************************ 00:04:30.389 END TEST json_config_extra_key 00:04:30.389 ************************************ 00:04:30.389 20:05:35 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:30.389 20:05:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.389 20:05:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.389 20:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:30.389 ************************************ 00:04:30.389 START TEST alias_rpc 00:04:30.389 ************************************ 00:04:30.389 20:05:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:30.647 * Looking for test storage... 00:04:30.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:30.647 20:05:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.647 20:05:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.647 20:05:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.647 20:05:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.647 20:05:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.647 20:05:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.647 20:05:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.647 20:05:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.647 20:05:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.647 20:05:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.647 20:05:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.647 20:05:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.647 20:05:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.647 20:05:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.647 20:05:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.647 20:05:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.647 20:05:35 -- scripts/common.sh@344 -- # : 1 00:04:30.647 20:05:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.647 20:05:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.647 20:05:35 -- scripts/common.sh@364 -- # decimal 1 00:04:30.647 20:05:35 -- scripts/common.sh@352 -- # local d=1 00:04:30.647 20:05:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.647 20:05:35 -- scripts/common.sh@354 -- # echo 1 00:04:30.647 20:05:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.647 20:05:35 -- scripts/common.sh@365 -- # decimal 2 00:04:30.647 20:05:35 -- scripts/common.sh@352 -- # local d=2 00:04:30.647 20:05:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.647 20:05:35 -- scripts/common.sh@354 -- # echo 2 00:04:30.647 20:05:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.647 20:05:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.647 20:05:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.647 20:05:35 -- scripts/common.sh@367 -- # return 0 00:04:30.647 20:05:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.647 20:05:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.647 --rc genhtml_branch_coverage=1 00:04:30.647 --rc genhtml_function_coverage=1 00:04:30.647 --rc genhtml_legend=1 00:04:30.647 --rc geninfo_all_blocks=1 00:04:30.647 --rc geninfo_unexecuted_blocks=1 00:04:30.647 00:04:30.647 ' 00:04:30.647 20:05:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.647 --rc genhtml_branch_coverage=1 00:04:30.647 --rc genhtml_function_coverage=1 00:04:30.647 --rc genhtml_legend=1 00:04:30.647 --rc geninfo_all_blocks=1 00:04:30.647 --rc geninfo_unexecuted_blocks=1 00:04:30.647 00:04:30.647 ' 00:04:30.647 20:05:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.647 --rc genhtml_branch_coverage=1 00:04:30.647 --rc genhtml_function_coverage=1 00:04:30.647 --rc genhtml_legend=1 00:04:30.647 --rc geninfo_all_blocks=1 00:04:30.647 --rc geninfo_unexecuted_blocks=1 00:04:30.647 00:04:30.647 ' 00:04:30.647 20:05:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.647 --rc genhtml_branch_coverage=1 00:04:30.647 --rc genhtml_function_coverage=1 00:04:30.647 --rc genhtml_legend=1 00:04:30.647 --rc geninfo_all_blocks=1 00:04:30.647 --rc geninfo_unexecuted_blocks=1 00:04:30.647 00:04:30.647 ' 00:04:30.647 20:05:35 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:30.647 20:05:35 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3036886 00:04:30.647 20:05:35 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:30.647 20:05:35 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3036886 00:04:30.647 20:05:35 -- common/autotest_common.sh@829 -- # '[' -z 3036886 ']' 00:04:30.647 20:05:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:30.647 20:05:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.647 20:05:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:30.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:30.647 20:05:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.648 20:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:30.648 [2024-11-20 20:05:35.597625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.648 [2024-11-20 20:05:35.597723] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3036886 ] 00:04:30.648 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.648 [2024-11-20 20:05:35.654486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.905 [2024-11-20 20:05:35.765567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.905 [2024-11-20 20:05:35.765744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.839 20:05:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.839 20:05:36 -- common/autotest_common.sh@862 -- # return 0 00:04:31.839 20:05:36 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:32.097 20:05:36 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3036886 00:04:32.097 20:05:36 -- common/autotest_common.sh@936 -- # '[' -z 3036886 ']' 00:04:32.097 20:05:36 -- common/autotest_common.sh@940 -- # kill -0 3036886 00:04:32.097 20:05:36 -- common/autotest_common.sh@941 -- # uname 00:04:32.097 20:05:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:32.097 20:05:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3036886 00:04:32.097 20:05:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:32.097 20:05:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:32.097 20:05:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3036886' 00:04:32.097 killing process with pid 3036886 00:04:32.097 20:05:36 -- common/autotest_common.sh@955 -- # kill 3036886 00:04:32.097 20:05:36 -- common/autotest_common.sh@960 -- # wait 3036886 00:04:32.664 00:04:32.664 real 0m1.977s 00:04:32.664 user 0m2.360s 00:04:32.664 sys 0m0.449s 00:04:32.664 20:05:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:32.664 20:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:32.664 ************************************ 00:04:32.664 END TEST alias_rpc 00:04:32.664 ************************************ 00:04:32.664 20:05:37 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:32.664 20:05:37 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:32.664 20:05:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.664 20:05:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.664 20:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:32.664 ************************************ 00:04:32.664 START TEST spdkcli_tcp 00:04:32.664 ************************************ 00:04:32.664 20:05:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:32.664 * Looking for test storage... 00:04:32.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:32.664 20:05:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:32.664 20:05:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:32.664 20:05:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:32.664 20:05:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:32.664 20:05:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:32.664 20:05:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:32.664 20:05:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:32.664 20:05:37 -- scripts/common.sh@335 -- # IFS=.-: 00:04:32.664 20:05:37 -- scripts/common.sh@335 -- # read -ra ver1 00:04:32.664 20:05:37 -- scripts/common.sh@336 -- # IFS=.-: 00:04:32.664 20:05:37 -- scripts/common.sh@336 -- # read -ra ver2 00:04:32.664 20:05:37 -- scripts/common.sh@337 -- # local 'op=<' 00:04:32.664 20:05:37 -- scripts/common.sh@339 -- # ver1_l=2 00:04:32.664 20:05:37 -- scripts/common.sh@340 -- # ver2_l=1 00:04:32.664 20:05:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:32.664 20:05:37 -- scripts/common.sh@343 -- # case "$op" in 00:04:32.664 20:05:37 -- scripts/common.sh@344 -- # : 1 00:04:32.664 20:05:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:32.664 20:05:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:32.664 20:05:37 -- scripts/common.sh@364 -- # decimal 1 00:04:32.664 20:05:37 -- scripts/common.sh@352 -- # local d=1 00:04:32.664 20:05:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:32.664 20:05:37 -- scripts/common.sh@354 -- # echo 1 00:04:32.664 20:05:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:32.664 20:05:37 -- scripts/common.sh@365 -- # decimal 2 00:04:32.664 20:05:37 -- scripts/common.sh@352 -- # local d=2 00:04:32.664 20:05:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:32.664 20:05:37 -- scripts/common.sh@354 -- # echo 2 00:04:32.664 20:05:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:32.664 20:05:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:32.664 20:05:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:32.664 20:05:37 -- scripts/common.sh@367 -- # return 0 00:04:32.664 20:05:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:32.664 20:05:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:32.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.664 --rc genhtml_branch_coverage=1 00:04:32.664 --rc genhtml_function_coverage=1 00:04:32.664 --rc genhtml_legend=1 00:04:32.664 --rc geninfo_all_blocks=1 00:04:32.664 --rc geninfo_unexecuted_blocks=1 00:04:32.664 00:04:32.664 ' 00:04:32.664 20:05:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:32.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.664 --rc genhtml_branch_coverage=1 00:04:32.664 --rc genhtml_function_coverage=1 00:04:32.664 --rc genhtml_legend=1 00:04:32.664 --rc geninfo_all_blocks=1 00:04:32.664 --rc geninfo_unexecuted_blocks=1 00:04:32.664 00:04:32.664 ' 00:04:32.664 20:05:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:32.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.664 --rc genhtml_branch_coverage=1 00:04:32.664 --rc genhtml_function_coverage=1 00:04:32.664 --rc genhtml_legend=1 00:04:32.664 --rc geninfo_all_blocks=1 00:04:32.664 --rc geninfo_unexecuted_blocks=1 00:04:32.664 00:04:32.664 ' 00:04:32.664 20:05:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:32.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.664 --rc genhtml_branch_coverage=1 00:04:32.664 --rc genhtml_function_coverage=1 00:04:32.664 --rc genhtml_legend=1 00:04:32.664 --rc geninfo_all_blocks=1 00:04:32.664 --rc geninfo_unexecuted_blocks=1 00:04:32.664 00:04:32.664 ' 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:32.664 20:05:37 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:32.664 20:05:37 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:32.664 20:05:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:32.664 20:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3037100 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:32.664 20:05:37 -- spdkcli/tcp.sh@27 -- # waitforlisten 3037100 00:04:32.664 20:05:37 -- common/autotest_common.sh@829 -- # '[' -z 3037100 ']' 00:04:32.664 20:05:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.664 20:05:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.664 20:05:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.664 20:05:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.664 20:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:32.665 [2024-11-20 20:05:37.609441] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.665 [2024-11-20 20:05:37.609538] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037100 ] 00:04:32.665 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.665 [2024-11-20 20:05:37.665865] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:32.923 [2024-11-20 20:05:37.773750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:32.923 [2024-11-20 20:05:37.773974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:32.923 [2024-11-20 20:05:37.773980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.864 20:05:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.864 20:05:38 -- common/autotest_common.sh@862 -- # return 0 00:04:33.864 20:05:38 -- spdkcli/tcp.sh@31 -- # socat_pid=3037241 00:04:33.864 20:05:38 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:33.864 20:05:38 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:33.864 [ 00:04:33.864 "bdev_malloc_delete", 00:04:33.864 "bdev_malloc_create", 00:04:33.864 "bdev_null_resize", 00:04:33.864 "bdev_null_delete", 00:04:33.864 "bdev_null_create", 00:04:33.865 "bdev_nvme_cuse_unregister", 00:04:33.865 "bdev_nvme_cuse_register", 00:04:33.865 "bdev_opal_new_user", 00:04:33.865 "bdev_opal_set_lock_state", 00:04:33.865 "bdev_opal_delete", 00:04:33.865 "bdev_opal_get_info", 00:04:33.865 "bdev_opal_create", 00:04:33.865 "bdev_nvme_opal_revert", 00:04:33.865 "bdev_nvme_opal_init", 00:04:33.865 "bdev_nvme_send_cmd", 00:04:33.865 "bdev_nvme_get_path_iostat", 00:04:33.865 "bdev_nvme_get_mdns_discovery_info", 00:04:33.865 "bdev_nvme_stop_mdns_discovery", 00:04:33.865 "bdev_nvme_start_mdns_discovery", 00:04:33.865 "bdev_nvme_set_multipath_policy", 00:04:33.865 "bdev_nvme_set_preferred_path", 00:04:33.865 "bdev_nvme_get_io_paths", 00:04:33.865 "bdev_nvme_remove_error_injection", 00:04:33.865 "bdev_nvme_add_error_injection", 00:04:33.865 "bdev_nvme_get_discovery_info", 00:04:33.865 "bdev_nvme_stop_discovery", 00:04:33.865 "bdev_nvme_start_discovery", 00:04:33.865 "bdev_nvme_get_controller_health_info", 00:04:33.865 "bdev_nvme_disable_controller", 00:04:33.865 "bdev_nvme_enable_controller", 00:04:33.865 "bdev_nvme_reset_controller", 00:04:33.865 "bdev_nvme_get_transport_statistics", 00:04:33.865 "bdev_nvme_apply_firmware", 00:04:33.865 "bdev_nvme_detach_controller", 00:04:33.865 "bdev_nvme_get_controllers", 00:04:33.865 "bdev_nvme_attach_controller", 00:04:33.865 "bdev_nvme_set_hotplug", 00:04:33.865 "bdev_nvme_set_options", 00:04:33.865 "bdev_passthru_delete", 00:04:33.865 "bdev_passthru_create", 00:04:33.865 "bdev_lvol_grow_lvstore", 00:04:33.865 "bdev_lvol_get_lvols", 00:04:33.865 "bdev_lvol_get_lvstores", 00:04:33.865 "bdev_lvol_delete", 00:04:33.865 "bdev_lvol_set_read_only", 00:04:33.865 "bdev_lvol_resize", 00:04:33.865 "bdev_lvol_decouple_parent", 00:04:33.865 "bdev_lvol_inflate", 00:04:33.865 "bdev_lvol_rename", 00:04:33.865 "bdev_lvol_clone_bdev", 00:04:33.865 "bdev_lvol_clone", 00:04:33.865 "bdev_lvol_snapshot", 00:04:33.865 "bdev_lvol_create", 00:04:33.865 "bdev_lvol_delete_lvstore", 00:04:33.865 "bdev_lvol_rename_lvstore", 00:04:33.865 "bdev_lvol_create_lvstore", 00:04:33.865 "bdev_raid_set_options", 00:04:33.865 "bdev_raid_remove_base_bdev", 00:04:33.865 "bdev_raid_add_base_bdev", 00:04:33.865 "bdev_raid_delete", 00:04:33.865 "bdev_raid_create", 00:04:33.865 "bdev_raid_get_bdevs", 00:04:33.865 "bdev_error_inject_error", 00:04:33.865 "bdev_error_delete", 00:04:33.865 "bdev_error_create", 00:04:33.865 "bdev_split_delete", 00:04:33.865 "bdev_split_create", 00:04:33.865 "bdev_delay_delete", 00:04:33.865 "bdev_delay_create", 00:04:33.865 "bdev_delay_update_latency", 00:04:33.865 "bdev_zone_block_delete", 00:04:33.865 "bdev_zone_block_create", 00:04:33.865 "blobfs_create", 00:04:33.865 "blobfs_detect", 00:04:33.865 "blobfs_set_cache_size", 00:04:33.865 "bdev_aio_delete", 00:04:33.865 "bdev_aio_rescan", 00:04:33.865 "bdev_aio_create", 00:04:33.865 "bdev_ftl_set_property", 00:04:33.865 "bdev_ftl_get_properties", 00:04:33.865 "bdev_ftl_get_stats", 00:04:33.865 "bdev_ftl_unmap", 00:04:33.865 "bdev_ftl_unload", 00:04:33.865 "bdev_ftl_delete", 00:04:33.865 "bdev_ftl_load", 00:04:33.865 "bdev_ftl_create", 00:04:33.865 "bdev_virtio_attach_controller", 00:04:33.865 "bdev_virtio_scsi_get_devices", 00:04:33.865 "bdev_virtio_detach_controller", 00:04:33.865 "bdev_virtio_blk_set_hotplug", 00:04:33.865 "bdev_iscsi_delete", 00:04:33.865 "bdev_iscsi_create", 00:04:33.865 "bdev_iscsi_set_options", 00:04:33.865 "accel_error_inject_error", 00:04:33.865 "ioat_scan_accel_module", 00:04:33.865 "dsa_scan_accel_module", 00:04:33.865 "iaa_scan_accel_module", 00:04:33.865 "iscsi_set_options", 00:04:33.865 "iscsi_get_auth_groups", 00:04:33.865 "iscsi_auth_group_remove_secret", 00:04:33.865 "iscsi_auth_group_add_secret", 00:04:33.865 "iscsi_delete_auth_group", 00:04:33.865 "iscsi_create_auth_group", 00:04:33.865 "iscsi_set_discovery_auth", 00:04:33.865 "iscsi_get_options", 00:04:33.865 "iscsi_target_node_request_logout", 00:04:33.865 "iscsi_target_node_set_redirect", 00:04:33.865 "iscsi_target_node_set_auth", 00:04:33.865 "iscsi_target_node_add_lun", 00:04:33.865 "iscsi_get_connections", 00:04:33.865 "iscsi_portal_group_set_auth", 00:04:33.865 "iscsi_start_portal_group", 00:04:33.865 "iscsi_delete_portal_group", 00:04:33.865 "iscsi_create_portal_group", 00:04:33.865 "iscsi_get_portal_groups", 00:04:33.865 "iscsi_delete_target_node", 00:04:33.865 "iscsi_target_node_remove_pg_ig_maps", 00:04:33.865 "iscsi_target_node_add_pg_ig_maps", 00:04:33.865 "iscsi_create_target_node", 00:04:33.865 "iscsi_get_target_nodes", 00:04:33.865 "iscsi_delete_initiator_group", 00:04:33.865 "iscsi_initiator_group_remove_initiators", 00:04:33.865 "iscsi_initiator_group_add_initiators", 00:04:33.865 "iscsi_create_initiator_group", 00:04:33.865 "iscsi_get_initiator_groups", 00:04:33.865 "nvmf_set_crdt", 00:04:33.865 "nvmf_set_config", 00:04:33.865 "nvmf_set_max_subsystems", 00:04:33.865 "nvmf_subsystem_get_listeners", 00:04:33.865 "nvmf_subsystem_get_qpairs", 00:04:33.865 "nvmf_subsystem_get_controllers", 00:04:33.865 "nvmf_get_stats", 00:04:33.865 "nvmf_get_transports", 00:04:33.865 "nvmf_create_transport", 00:04:33.865 "nvmf_get_targets", 00:04:33.865 "nvmf_delete_target", 00:04:33.865 "nvmf_create_target", 00:04:33.865 "nvmf_subsystem_allow_any_host", 00:04:33.865 "nvmf_subsystem_remove_host", 00:04:33.865 "nvmf_subsystem_add_host", 00:04:33.865 "nvmf_subsystem_remove_ns", 00:04:33.865 "nvmf_subsystem_add_ns", 00:04:33.865 "nvmf_subsystem_listener_set_ana_state", 00:04:33.865 "nvmf_discovery_get_referrals", 00:04:33.865 "nvmf_discovery_remove_referral", 00:04:33.865 "nvmf_discovery_add_referral", 00:04:33.865 "nvmf_subsystem_remove_listener", 00:04:33.865 "nvmf_subsystem_add_listener", 00:04:33.865 "nvmf_delete_subsystem", 00:04:33.865 "nvmf_create_subsystem", 00:04:33.865 "nvmf_get_subsystems", 00:04:33.865 "env_dpdk_get_mem_stats", 00:04:33.865 "nbd_get_disks", 00:04:33.865 "nbd_stop_disk", 00:04:33.865 "nbd_start_disk", 00:04:33.865 "ublk_recover_disk", 00:04:33.865 "ublk_get_disks", 00:04:33.865 "ublk_stop_disk", 00:04:33.865 "ublk_start_disk", 00:04:33.865 "ublk_destroy_target", 00:04:33.865 "ublk_create_target", 00:04:33.865 "virtio_blk_create_transport", 00:04:33.865 "virtio_blk_get_transports", 00:04:33.865 "vhost_controller_set_coalescing", 00:04:33.865 "vhost_get_controllers", 00:04:33.865 "vhost_delete_controller", 00:04:33.865 "vhost_create_blk_controller", 00:04:33.865 "vhost_scsi_controller_remove_target", 00:04:33.865 "vhost_scsi_controller_add_target", 00:04:33.865 "vhost_start_scsi_controller", 00:04:33.865 "vhost_create_scsi_controller", 00:04:33.865 "thread_set_cpumask", 00:04:33.865 "framework_get_scheduler", 00:04:33.865 "framework_set_scheduler", 00:04:33.865 "framework_get_reactors", 00:04:33.865 "thread_get_io_channels", 00:04:33.865 "thread_get_pollers", 00:04:33.865 "thread_get_stats", 00:04:33.865 "framework_monitor_context_switch", 00:04:33.865 "spdk_kill_instance", 00:04:33.865 "log_enable_timestamps", 00:04:33.865 "log_get_flags", 00:04:33.865 "log_clear_flag", 00:04:33.865 "log_set_flag", 00:04:33.865 "log_get_level", 00:04:33.865 "log_set_level", 00:04:33.865 "log_get_print_level", 00:04:33.865 "log_set_print_level", 00:04:33.865 "framework_enable_cpumask_locks", 00:04:33.865 "framework_disable_cpumask_locks", 00:04:33.865 "framework_wait_init", 00:04:33.865 "framework_start_init", 00:04:33.865 "scsi_get_devices", 00:04:33.865 "bdev_get_histogram", 00:04:33.865 "bdev_enable_histogram", 00:04:33.865 "bdev_set_qos_limit", 00:04:33.865 "bdev_set_qd_sampling_period", 00:04:33.865 "bdev_get_bdevs", 00:04:33.865 "bdev_reset_iostat", 00:04:33.865 "bdev_get_iostat", 00:04:33.865 "bdev_examine", 00:04:33.865 "bdev_wait_for_examine", 00:04:33.865 "bdev_set_options", 00:04:33.865 "notify_get_notifications", 00:04:33.865 "notify_get_types", 00:04:33.865 "accel_get_stats", 00:04:33.865 "accel_set_options", 00:04:33.865 "accel_set_driver", 00:04:33.865 "accel_crypto_key_destroy", 00:04:33.865 "accel_crypto_keys_get", 00:04:33.865 "accel_crypto_key_create", 00:04:33.865 "accel_assign_opc", 00:04:33.865 "accel_get_module_info", 00:04:33.865 "accel_get_opc_assignments", 00:04:33.865 "vmd_rescan", 00:04:33.865 "vmd_remove_device", 00:04:33.865 "vmd_enable", 00:04:33.865 "sock_set_default_impl", 00:04:33.865 "sock_impl_set_options", 00:04:33.865 "sock_impl_get_options", 00:04:33.865 "iobuf_get_stats", 00:04:33.865 "iobuf_set_options", 00:04:33.865 "framework_get_pci_devices", 00:04:33.865 "framework_get_config", 00:04:33.866 "framework_get_subsystems", 00:04:33.866 "trace_get_info", 00:04:33.866 "trace_get_tpoint_group_mask", 00:04:33.866 "trace_disable_tpoint_group", 00:04:33.866 "trace_enable_tpoint_group", 00:04:33.866 "trace_clear_tpoint_mask", 00:04:33.866 "trace_set_tpoint_mask", 00:04:33.866 "spdk_get_version", 00:04:33.866 "rpc_get_methods" 00:04:33.866 ] 00:04:33.866 20:05:38 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:33.866 20:05:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:33.866 20:05:38 -- common/autotest_common.sh@10 -- # set +x 00:04:33.866 20:05:38 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:33.866 20:05:38 -- spdkcli/tcp.sh@38 -- # killprocess 3037100 00:04:33.866 20:05:38 -- common/autotest_common.sh@936 -- # '[' -z 3037100 ']' 00:04:33.866 20:05:38 -- common/autotest_common.sh@940 -- # kill -0 3037100 00:04:33.866 20:05:38 -- common/autotest_common.sh@941 -- # uname 00:04:33.866 20:05:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:33.866 20:05:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3037100 00:04:33.866 20:05:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:33.866 20:05:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:33.866 20:05:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3037100' 00:04:33.866 killing process with pid 3037100 00:04:33.866 20:05:38 -- common/autotest_common.sh@955 -- # kill 3037100 00:04:33.866 20:05:38 -- common/autotest_common.sh@960 -- # wait 3037100 00:04:34.431 00:04:34.431 real 0m1.900s 00:04:34.431 user 0m3.605s 00:04:34.431 sys 0m0.490s 00:04:34.431 20:05:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.431 20:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:34.431 ************************************ 00:04:34.431 END TEST spdkcli_tcp 00:04:34.431 ************************************ 00:04:34.431 20:05:39 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:34.431 20:05:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.431 20:05:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.431 20:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:34.431 ************************************ 00:04:34.431 START TEST dpdk_mem_utility 00:04:34.431 ************************************ 00:04:34.431 20:05:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:34.431 * Looking for test storage... 00:04:34.431 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:34.431 20:05:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.431 20:05:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.431 20:05:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.688 20:05:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.688 20:05:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.688 20:05:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.688 20:05:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.688 20:05:39 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.688 20:05:39 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.688 20:05:39 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.688 20:05:39 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.688 20:05:39 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.688 20:05:39 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.688 20:05:39 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.688 20:05:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.688 20:05:39 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.688 20:05:39 -- scripts/common.sh@344 -- # : 1 00:04:34.688 20:05:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.688 20:05:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.688 20:05:39 -- scripts/common.sh@364 -- # decimal 1 00:04:34.688 20:05:39 -- scripts/common.sh@352 -- # local d=1 00:04:34.688 20:05:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.688 20:05:39 -- scripts/common.sh@354 -- # echo 1 00:04:34.688 20:05:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.688 20:05:39 -- scripts/common.sh@365 -- # decimal 2 00:04:34.688 20:05:39 -- scripts/common.sh@352 -- # local d=2 00:04:34.688 20:05:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.688 20:05:39 -- scripts/common.sh@354 -- # echo 2 00:04:34.688 20:05:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.688 20:05:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.688 20:05:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.688 20:05:39 -- scripts/common.sh@367 -- # return 0 00:04:34.688 20:05:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.688 20:05:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.688 --rc genhtml_branch_coverage=1 00:04:34.688 --rc genhtml_function_coverage=1 00:04:34.688 --rc genhtml_legend=1 00:04:34.688 --rc geninfo_all_blocks=1 00:04:34.688 --rc geninfo_unexecuted_blocks=1 00:04:34.688 00:04:34.688 ' 00:04:34.688 20:05:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.688 --rc genhtml_branch_coverage=1 00:04:34.688 --rc genhtml_function_coverage=1 00:04:34.688 --rc genhtml_legend=1 00:04:34.688 --rc geninfo_all_blocks=1 00:04:34.688 --rc geninfo_unexecuted_blocks=1 00:04:34.688 00:04:34.688 ' 00:04:34.688 20:05:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.688 --rc genhtml_branch_coverage=1 00:04:34.688 --rc genhtml_function_coverage=1 00:04:34.688 --rc genhtml_legend=1 00:04:34.688 --rc geninfo_all_blocks=1 00:04:34.688 --rc geninfo_unexecuted_blocks=1 00:04:34.688 00:04:34.688 ' 00:04:34.688 20:05:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.689 --rc genhtml_branch_coverage=1 00:04:34.689 --rc genhtml_function_coverage=1 00:04:34.689 --rc genhtml_legend=1 00:04:34.689 --rc geninfo_all_blocks=1 00:04:34.689 --rc geninfo_unexecuted_blocks=1 00:04:34.689 00:04:34.689 ' 00:04:34.689 20:05:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:34.689 20:05:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3037444 00:04:34.689 20:05:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:34.689 20:05:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3037444 00:04:34.689 20:05:39 -- common/autotest_common.sh@829 -- # '[' -z 3037444 ']' 00:04:34.689 20:05:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.689 20:05:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.689 20:05:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.689 20:05:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.689 20:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:34.689 [2024-11-20 20:05:39.535733] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.689 [2024-11-20 20:05:39.535807] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037444 ] 00:04:34.689 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.689 [2024-11-20 20:05:39.593925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:34.689 [2024-11-20 20:05:39.700750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:34.689 [2024-11-20 20:05:39.700936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.623 20:05:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.623 20:05:40 -- common/autotest_common.sh@862 -- # return 0 00:04:35.623 20:05:40 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:35.623 20:05:40 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:35.623 20:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.623 20:05:40 -- common/autotest_common.sh@10 -- # set +x 00:04:35.623 { 00:04:35.623 "filename": "/tmp/spdk_mem_dump.txt" 00:04:35.623 } 00:04:35.623 20:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.623 20:05:40 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:35.623 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:35.623 1 heaps totaling size 814.000000 MiB 00:04:35.623 size: 814.000000 MiB heap id: 0 00:04:35.623 end heaps---------- 00:04:35.623 8 mempools totaling size 598.116089 MiB 00:04:35.623 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:35.623 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:35.623 size: 84.521057 MiB name: bdev_io_3037444 00:04:35.623 size: 51.011292 MiB name: evtpool_3037444 00:04:35.623 size: 50.003479 MiB name: msgpool_3037444 00:04:35.623 size: 21.763794 MiB name: PDU_Pool 00:04:35.623 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:35.623 size: 0.026123 MiB name: Session_Pool 00:04:35.623 end mempools------- 00:04:35.623 6 memzones totaling size 4.142822 MiB 00:04:35.623 size: 1.000366 MiB name: RG_ring_0_3037444 00:04:35.623 size: 1.000366 MiB name: RG_ring_1_3037444 00:04:35.623 size: 1.000366 MiB name: RG_ring_4_3037444 00:04:35.623 size: 1.000366 MiB name: RG_ring_5_3037444 00:04:35.623 size: 0.125366 MiB name: RG_ring_2_3037444 00:04:35.623 size: 0.015991 MiB name: RG_ring_3_3037444 00:04:35.623 end memzones------- 00:04:35.623 20:05:40 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:35.623 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:35.623 list of free elements. size: 12.519348 MiB 00:04:35.623 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:35.623 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:35.623 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:35.623 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:35.623 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:35.623 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:35.623 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:35.623 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:35.623 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:35.623 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:35.623 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:35.623 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:35.623 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:35.623 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:35.623 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:35.623 list of standard malloc elements. size: 199.218079 MiB 00:04:35.623 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:35.623 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:35.623 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:35.623 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:35.623 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:35.623 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:35.623 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:35.623 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:35.623 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:35.623 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:35.623 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:35.623 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:35.623 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:35.624 list of memzone associated elements. size: 602.262573 MiB 00:04:35.624 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:35.624 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:35.624 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:35.624 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:35.624 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:35.624 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3037444_0 00:04:35.624 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:35.624 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3037444_0 00:04:35.624 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:35.624 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3037444_0 00:04:35.624 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:35.624 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:35.624 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:35.624 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:35.624 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:35.624 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3037444 00:04:35.624 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:35.624 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3037444 00:04:35.624 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:35.624 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3037444 00:04:35.624 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:35.624 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:35.624 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:35.624 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:35.624 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:35.624 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:35.624 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:35.624 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:35.624 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:35.624 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3037444 00:04:35.624 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:35.624 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3037444 00:04:35.624 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:35.624 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3037444 00:04:35.624 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:35.624 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3037444 00:04:35.624 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:35.624 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3037444 00:04:35.624 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:35.624 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:35.624 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:35.624 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:35.624 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:35.624 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:35.624 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:35.624 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3037444 00:04:35.624 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:35.624 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:35.624 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:35.624 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:35.624 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:35.624 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3037444 00:04:35.624 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:35.624 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:35.624 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:35.624 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3037444 00:04:35.624 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:35.624 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3037444 00:04:35.624 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:35.624 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:35.624 20:05:40 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:35.624 20:05:40 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3037444 00:04:35.624 20:05:40 -- common/autotest_common.sh@936 -- # '[' -z 3037444 ']' 00:04:35.624 20:05:40 -- common/autotest_common.sh@940 -- # kill -0 3037444 00:04:35.624 20:05:40 -- common/autotest_common.sh@941 -- # uname 00:04:35.624 20:05:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:35.624 20:05:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3037444 00:04:35.624 20:05:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:35.882 20:05:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:35.882 20:05:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3037444' 00:04:35.882 killing process with pid 3037444 00:04:35.882 20:05:40 -- common/autotest_common.sh@955 -- # kill 3037444 00:04:35.882 20:05:40 -- common/autotest_common.sh@960 -- # wait 3037444 00:04:36.140 00:04:36.140 real 0m1.766s 00:04:36.140 user 0m1.919s 00:04:36.140 sys 0m0.484s 00:04:36.140 20:05:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.140 20:05:41 -- common/autotest_common.sh@10 -- # set +x 00:04:36.140 ************************************ 00:04:36.140 END TEST dpdk_mem_utility 00:04:36.140 ************************************ 00:04:36.140 20:05:41 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:36.140 20:05:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:36.140 20:05:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.140 20:05:41 -- common/autotest_common.sh@10 -- # set +x 00:04:36.140 ************************************ 00:04:36.140 START TEST event 00:04:36.140 ************************************ 00:04:36.140 20:05:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:36.400 * Looking for test storage... 00:04:36.400 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:36.400 20:05:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:36.400 20:05:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:36.400 20:05:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:36.400 20:05:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:36.400 20:05:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:36.400 20:05:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:36.400 20:05:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:36.400 20:05:41 -- scripts/common.sh@335 -- # IFS=.-: 00:04:36.400 20:05:41 -- scripts/common.sh@335 -- # read -ra ver1 00:04:36.400 20:05:41 -- scripts/common.sh@336 -- # IFS=.-: 00:04:36.400 20:05:41 -- scripts/common.sh@336 -- # read -ra ver2 00:04:36.400 20:05:41 -- scripts/common.sh@337 -- # local 'op=<' 00:04:36.400 20:05:41 -- scripts/common.sh@339 -- # ver1_l=2 00:04:36.400 20:05:41 -- scripts/common.sh@340 -- # ver2_l=1 00:04:36.400 20:05:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:36.400 20:05:41 -- scripts/common.sh@343 -- # case "$op" in 00:04:36.400 20:05:41 -- scripts/common.sh@344 -- # : 1 00:04:36.400 20:05:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:36.400 20:05:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:36.400 20:05:41 -- scripts/common.sh@364 -- # decimal 1 00:04:36.400 20:05:41 -- scripts/common.sh@352 -- # local d=1 00:04:36.400 20:05:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:36.400 20:05:41 -- scripts/common.sh@354 -- # echo 1 00:04:36.400 20:05:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:36.400 20:05:41 -- scripts/common.sh@365 -- # decimal 2 00:04:36.400 20:05:41 -- scripts/common.sh@352 -- # local d=2 00:04:36.400 20:05:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:36.400 20:05:41 -- scripts/common.sh@354 -- # echo 2 00:04:36.400 20:05:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:36.400 20:05:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:36.400 20:05:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:36.400 20:05:41 -- scripts/common.sh@367 -- # return 0 00:04:36.400 20:05:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:36.400 20:05:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:36.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.400 --rc genhtml_branch_coverage=1 00:04:36.400 --rc genhtml_function_coverage=1 00:04:36.400 --rc genhtml_legend=1 00:04:36.400 --rc geninfo_all_blocks=1 00:04:36.400 --rc geninfo_unexecuted_blocks=1 00:04:36.400 00:04:36.400 ' 00:04:36.400 20:05:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:36.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.400 --rc genhtml_branch_coverage=1 00:04:36.400 --rc genhtml_function_coverage=1 00:04:36.400 --rc genhtml_legend=1 00:04:36.400 --rc geninfo_all_blocks=1 00:04:36.400 --rc geninfo_unexecuted_blocks=1 00:04:36.400 00:04:36.400 ' 00:04:36.400 20:05:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:36.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.400 --rc genhtml_branch_coverage=1 00:04:36.400 --rc genhtml_function_coverage=1 00:04:36.400 --rc genhtml_legend=1 00:04:36.400 --rc geninfo_all_blocks=1 00:04:36.400 --rc geninfo_unexecuted_blocks=1 00:04:36.400 00:04:36.400 ' 00:04:36.400 20:05:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:36.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.400 --rc genhtml_branch_coverage=1 00:04:36.400 --rc genhtml_function_coverage=1 00:04:36.400 --rc genhtml_legend=1 00:04:36.400 --rc geninfo_all_blocks=1 00:04:36.400 --rc geninfo_unexecuted_blocks=1 00:04:36.400 00:04:36.400 ' 00:04:36.400 20:05:41 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:36.400 20:05:41 -- bdev/nbd_common.sh@6 -- # set -e 00:04:36.400 20:05:41 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:36.400 20:05:41 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:36.400 20:05:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.400 20:05:41 -- common/autotest_common.sh@10 -- # set +x 00:04:36.400 ************************************ 00:04:36.400 START TEST event_perf 00:04:36.400 ************************************ 00:04:36.400 20:05:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:36.400 Running I/O for 1 seconds...[2024-11-20 20:05:41.310641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.400 [2024-11-20 20:05:41.310723] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037770 ] 00:04:36.400 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.400 [2024-11-20 20:05:41.373241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:36.658 [2024-11-20 20:05:41.496240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:36.658 [2024-11-20 20:05:41.496266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:36.658 [2024-11-20 20:05:41.496290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:36.658 [2024-11-20 20:05:41.496293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.591 Running I/O for 1 seconds... 00:04:37.591 lcore 0: 227145 00:04:37.591 lcore 1: 227144 00:04:37.591 lcore 2: 227143 00:04:37.591 lcore 3: 227144 00:04:37.591 done. 00:04:37.591 00:04:37.591 real 0m1.320s 00:04:37.591 user 0m4.225s 00:04:37.591 sys 0m0.090s 00:04:37.591 20:05:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.591 20:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:37.591 ************************************ 00:04:37.592 END TEST event_perf 00:04:37.592 ************************************ 00:04:37.850 20:05:42 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:37.850 20:05:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:37.850 20:05:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.850 20:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:37.850 ************************************ 00:04:37.850 START TEST event_reactor 00:04:37.850 ************************************ 00:04:37.850 20:05:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:37.850 [2024-11-20 20:05:42.659811] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.850 [2024-11-20 20:05:42.659898] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037934 ] 00:04:37.850 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.850 [2024-11-20 20:05:42.724409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.850 [2024-11-20 20:05:42.838691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.226 test_start 00:04:39.226 oneshot 00:04:39.226 tick 100 00:04:39.226 tick 100 00:04:39.226 tick 250 00:04:39.226 tick 100 00:04:39.226 tick 100 00:04:39.226 tick 100 00:04:39.226 tick 250 00:04:39.226 tick 500 00:04:39.226 tick 100 00:04:39.226 tick 100 00:04:39.226 tick 250 00:04:39.226 tick 100 00:04:39.226 tick 100 00:04:39.226 test_end 00:04:39.226 00:04:39.226 real 0m1.315s 00:04:39.226 user 0m1.222s 00:04:39.226 sys 0m0.088s 00:04:39.226 20:05:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.226 20:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:39.226 ************************************ 00:04:39.226 END TEST event_reactor 00:04:39.226 ************************************ 00:04:39.226 20:05:43 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:39.226 20:05:43 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:39.226 20:05:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.226 20:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:39.226 ************************************ 00:04:39.226 START TEST event_reactor_perf 00:04:39.226 ************************************ 00:04:39.226 20:05:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:39.226 [2024-11-20 20:05:44.003327] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.226 [2024-11-20 20:05:44.003414] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3038092 ] 00:04:39.226 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.226 [2024-11-20 20:05:44.064842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.226 [2024-11-20 20:05:44.181560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.600 test_start 00:04:40.600 test_end 00:04:40.600 Performance: 351281 events per second 00:04:40.600 00:04:40.600 real 0m1.317s 00:04:40.600 user 0m1.233s 00:04:40.600 sys 0m0.078s 00:04:40.600 20:05:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.600 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.600 ************************************ 00:04:40.600 END TEST event_reactor_perf 00:04:40.600 ************************************ 00:04:40.600 20:05:45 -- event/event.sh@49 -- # uname -s 00:04:40.600 20:05:45 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:40.600 20:05:45 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:40.600 20:05:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.600 20:05:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.600 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.600 ************************************ 00:04:40.600 START TEST event_scheduler 00:04:40.600 ************************************ 00:04:40.600 20:05:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:40.600 * Looking for test storage... 00:04:40.600 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:40.600 20:05:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.600 20:05:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.600 20:05:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.600 20:05:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.600 20:05:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.600 20:05:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.600 20:05:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.600 20:05:45 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.600 20:05:45 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.600 20:05:45 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.600 20:05:45 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.600 20:05:45 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.600 20:05:45 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.600 20:05:45 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.600 20:05:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.600 20:05:45 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.600 20:05:45 -- scripts/common.sh@344 -- # : 1 00:04:40.600 20:05:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.600 20:05:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.600 20:05:45 -- scripts/common.sh@364 -- # decimal 1 00:04:40.600 20:05:45 -- scripts/common.sh@352 -- # local d=1 00:04:40.600 20:05:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.600 20:05:45 -- scripts/common.sh@354 -- # echo 1 00:04:40.600 20:05:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.600 20:05:45 -- scripts/common.sh@365 -- # decimal 2 00:04:40.600 20:05:45 -- scripts/common.sh@352 -- # local d=2 00:04:40.600 20:05:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.600 20:05:45 -- scripts/common.sh@354 -- # echo 2 00:04:40.600 20:05:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.600 20:05:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.601 20:05:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.601 20:05:45 -- scripts/common.sh@367 -- # return 0 00:04:40.601 20:05:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.601 20:05:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.601 --rc genhtml_branch_coverage=1 00:04:40.601 --rc genhtml_function_coverage=1 00:04:40.601 --rc genhtml_legend=1 00:04:40.601 --rc geninfo_all_blocks=1 00:04:40.601 --rc geninfo_unexecuted_blocks=1 00:04:40.601 00:04:40.601 ' 00:04:40.601 20:05:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.601 --rc genhtml_branch_coverage=1 00:04:40.601 --rc genhtml_function_coverage=1 00:04:40.601 --rc genhtml_legend=1 00:04:40.601 --rc geninfo_all_blocks=1 00:04:40.601 --rc geninfo_unexecuted_blocks=1 00:04:40.601 00:04:40.601 ' 00:04:40.601 20:05:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.601 --rc genhtml_branch_coverage=1 00:04:40.601 --rc genhtml_function_coverage=1 00:04:40.601 --rc genhtml_legend=1 00:04:40.601 --rc geninfo_all_blocks=1 00:04:40.601 --rc geninfo_unexecuted_blocks=1 00:04:40.601 00:04:40.601 ' 00:04:40.601 20:05:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.601 --rc genhtml_branch_coverage=1 00:04:40.601 --rc genhtml_function_coverage=1 00:04:40.601 --rc genhtml_legend=1 00:04:40.601 --rc geninfo_all_blocks=1 00:04:40.601 --rc geninfo_unexecuted_blocks=1 00:04:40.601 00:04:40.601 ' 00:04:40.601 20:05:45 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:40.601 20:05:45 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3038288 00:04:40.601 20:05:45 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:40.601 20:05:45 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:40.601 20:05:45 -- scheduler/scheduler.sh@37 -- # waitforlisten 3038288 00:04:40.601 20:05:45 -- common/autotest_common.sh@829 -- # '[' -z 3038288 ']' 00:04:40.601 20:05:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.601 20:05:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.601 20:05:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.601 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.601 20:05:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.601 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.601 [2024-11-20 20:05:45.515842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.601 [2024-11-20 20:05:45.515930] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3038288 ] 00:04:40.601 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.601 [2024-11-20 20:05:45.571024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:40.860 [2024-11-20 20:05:45.681373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.860 [2024-11-20 20:05:45.681393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:40.860 [2024-11-20 20:05:45.681421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:40.860 [2024-11-20 20:05:45.681424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:40.860 20:05:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.860 20:05:45 -- common/autotest_common.sh@862 -- # return 0 00:04:40.860 20:05:45 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:40.860 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.860 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.860 POWER: Env isn't set yet! 00:04:40.860 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:40.860 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:40.860 POWER: Cannot get available frequencies of lcore 0 00:04:40.860 POWER: Attempting to initialise PSTAT power management... 00:04:40.860 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:40.860 POWER: Initialized successfully for lcore 0 power management 00:04:40.860 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:40.860 POWER: Initialized successfully for lcore 1 power management 00:04:40.860 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:40.860 POWER: Initialized successfully for lcore 2 power management 00:04:40.860 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:40.860 POWER: Initialized successfully for lcore 3 power management 00:04:40.860 [2024-11-20 20:05:45.782280] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:40.860 [2024-11-20 20:05:45.782297] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:40.860 [2024-11-20 20:05:45.782308] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:40.860 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.860 20:05:45 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:40.860 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.860 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.860 [2024-11-20 20:05:45.886516] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:40.860 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.860 20:05:45 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:40.860 20:05:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.860 20:05:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.860 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.860 ************************************ 00:04:40.860 START TEST scheduler_create_thread 00:04:40.860 ************************************ 00:04:40.860 20:05:45 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:40.860 20:05:45 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:40.860 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.860 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.118 2 00:04:41.118 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 3 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 4 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 5 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 6 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 7 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 8 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 9 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 10 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.119 20:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.119 20:05:45 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:41.119 20:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.119 20:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:41.684 20:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.684 20:05:46 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:41.684 20:05:46 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:41.684 20:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.684 20:05:46 -- common/autotest_common.sh@10 -- # set +x 00:04:42.617 20:05:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.617 00:04:42.617 real 0m1.757s 00:04:42.617 user 0m0.014s 00:04:42.617 sys 0m0.001s 00:04:42.617 20:05:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.617 20:05:47 -- common/autotest_common.sh@10 -- # set +x 00:04:42.617 ************************************ 00:04:42.617 END TEST scheduler_create_thread 00:04:42.617 ************************************ 00:04:42.875 20:05:47 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:42.875 20:05:47 -- scheduler/scheduler.sh@46 -- # killprocess 3038288 00:04:42.875 20:05:47 -- common/autotest_common.sh@936 -- # '[' -z 3038288 ']' 00:04:42.875 20:05:47 -- common/autotest_common.sh@940 -- # kill -0 3038288 00:04:42.875 20:05:47 -- common/autotest_common.sh@941 -- # uname 00:04:42.875 20:05:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:42.875 20:05:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3038288 00:04:42.875 20:05:47 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:42.875 20:05:47 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:42.875 20:05:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3038288' 00:04:42.875 killing process with pid 3038288 00:04:42.875 20:05:47 -- common/autotest_common.sh@955 -- # kill 3038288 00:04:42.875 20:05:47 -- common/autotest_common.sh@960 -- # wait 3038288 00:04:43.133 [2024-11-20 20:05:48.130154] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:43.391 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:43.391 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:43.391 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:43.391 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:43.391 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:43.391 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:43.391 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:43.391 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:43.391 00:04:43.391 real 0m3.046s 00:04:43.391 user 0m3.957s 00:04:43.391 sys 0m0.331s 00:04:43.391 20:05:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.391 20:05:48 -- common/autotest_common.sh@10 -- # set +x 00:04:43.391 ************************************ 00:04:43.391 END TEST event_scheduler 00:04:43.391 ************************************ 00:04:43.391 20:05:48 -- event/event.sh@51 -- # modprobe -n nbd 00:04:43.391 20:05:48 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:43.391 20:05:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.391 20:05:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.391 20:05:48 -- common/autotest_common.sh@10 -- # set +x 00:04:43.391 ************************************ 00:04:43.391 START TEST app_repeat 00:04:43.391 ************************************ 00:04:43.391 20:05:48 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:43.391 20:05:48 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.391 20:05:48 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.391 20:05:48 -- event/event.sh@13 -- # local nbd_list 00:04:43.391 20:05:48 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:43.391 20:05:48 -- event/event.sh@14 -- # local bdev_list 00:04:43.391 20:05:48 -- event/event.sh@15 -- # local repeat_times=4 00:04:43.391 20:05:48 -- event/event.sh@17 -- # modprobe nbd 00:04:43.391 20:05:48 -- event/event.sh@19 -- # repeat_pid=3038740 00:04:43.391 20:05:48 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:43.391 20:05:48 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:43.391 20:05:48 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3038740' 00:04:43.391 Process app_repeat pid: 3038740 00:04:43.391 20:05:48 -- event/event.sh@23 -- # for i in {0..2} 00:04:43.391 20:05:48 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:43.391 spdk_app_start Round 0 00:04:43.391 20:05:48 -- event/event.sh@25 -- # waitforlisten 3038740 /var/tmp/spdk-nbd.sock 00:04:43.391 20:05:48 -- common/autotest_common.sh@829 -- # '[' -z 3038740 ']' 00:04:43.392 20:05:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:43.392 20:05:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.392 20:05:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:43.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:43.392 20:05:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.392 20:05:48 -- common/autotest_common.sh@10 -- # set +x 00:04:43.650 [2024-11-20 20:05:48.437592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.650 [2024-11-20 20:05:48.437678] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3038740 ] 00:04:43.650 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.650 [2024-11-20 20:05:48.496622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:43.650 [2024-11-20 20:05:48.605572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:43.650 [2024-11-20 20:05:48.605576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.584 20:05:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:44.584 20:05:49 -- common/autotest_common.sh@862 -- # return 0 00:04:44.584 20:05:49 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:44.842 Malloc0 00:04:44.842 20:05:49 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:45.101 Malloc1 00:04:45.101 20:05:49 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@12 -- # local i 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.101 20:05:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:45.359 /dev/nbd0 00:04:45.359 20:05:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:45.359 20:05:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:45.359 20:05:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:45.359 20:05:50 -- common/autotest_common.sh@867 -- # local i 00:04:45.359 20:05:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:45.359 20:05:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:45.359 20:05:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:45.359 20:05:50 -- common/autotest_common.sh@871 -- # break 00:04:45.359 20:05:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:45.359 20:05:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:45.359 20:05:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:45.359 1+0 records in 00:04:45.359 1+0 records out 00:04:45.359 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000155612 s, 26.3 MB/s 00:04:45.359 20:05:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.359 20:05:50 -- common/autotest_common.sh@884 -- # size=4096 00:04:45.359 20:05:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.359 20:05:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:45.359 20:05:50 -- common/autotest_common.sh@887 -- # return 0 00:04:45.359 20:05:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:45.359 20:05:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.359 20:05:50 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:45.617 /dev/nbd1 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:45.617 20:05:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:45.617 20:05:50 -- common/autotest_common.sh@867 -- # local i 00:04:45.617 20:05:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:45.617 20:05:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:45.617 20:05:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:45.617 20:05:50 -- common/autotest_common.sh@871 -- # break 00:04:45.617 20:05:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:45.617 20:05:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:45.617 20:05:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:45.617 1+0 records in 00:04:45.617 1+0 records out 00:04:45.617 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000170748 s, 24.0 MB/s 00:04:45.617 20:05:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.617 20:05:50 -- common/autotest_common.sh@884 -- # size=4096 00:04:45.617 20:05:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.617 20:05:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:45.617 20:05:50 -- common/autotest_common.sh@887 -- # return 0 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.617 20:05:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:45.875 { 00:04:45.875 "nbd_device": "/dev/nbd0", 00:04:45.875 "bdev_name": "Malloc0" 00:04:45.875 }, 00:04:45.875 { 00:04:45.875 "nbd_device": "/dev/nbd1", 00:04:45.875 "bdev_name": "Malloc1" 00:04:45.875 } 00:04:45.875 ]' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:45.875 { 00:04:45.875 "nbd_device": "/dev/nbd0", 00:04:45.875 "bdev_name": "Malloc0" 00:04:45.875 }, 00:04:45.875 { 00:04:45.875 "nbd_device": "/dev/nbd1", 00:04:45.875 "bdev_name": "Malloc1" 00:04:45.875 } 00:04:45.875 ]' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:45.875 /dev/nbd1' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:45.875 /dev/nbd1' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@65 -- # count=2 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@95 -- # count=2 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:45.875 256+0 records in 00:04:45.875 256+0 records out 00:04:45.875 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00513874 s, 204 MB/s 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:45.875 256+0 records in 00:04:45.875 256+0 records out 00:04:45.875 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224264 s, 46.8 MB/s 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:45.875 20:05:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:45.875 256+0 records in 00:04:45.875 256+0 records out 00:04:45.875 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244748 s, 42.8 MB/s 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@51 -- # local i 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:46.133 20:05:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@41 -- # break 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@45 -- # return 0 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:46.391 20:05:51 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@41 -- # break 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@45 -- # return 0 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.650 20:05:51 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@65 -- # true 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@65 -- # count=0 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@104 -- # count=0 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:46.907 20:05:51 -- bdev/nbd_common.sh@109 -- # return 0 00:04:46.907 20:05:51 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:47.166 20:05:52 -- event/event.sh@35 -- # sleep 3 00:04:47.424 [2024-11-20 20:05:52.330138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:47.424 [2024-11-20 20:05:52.442337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.424 [2024-11-20 20:05:52.442337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:47.682 [2024-11-20 20:05:52.501218] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:47.682 [2024-11-20 20:05:52.501283] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:50.209 20:05:55 -- event/event.sh@23 -- # for i in {0..2} 00:04:50.209 20:05:55 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:50.209 spdk_app_start Round 1 00:04:50.209 20:05:55 -- event/event.sh@25 -- # waitforlisten 3038740 /var/tmp/spdk-nbd.sock 00:04:50.209 20:05:55 -- common/autotest_common.sh@829 -- # '[' -z 3038740 ']' 00:04:50.209 20:05:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:50.209 20:05:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:50.209 20:05:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:50.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:50.209 20:05:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:50.209 20:05:55 -- common/autotest_common.sh@10 -- # set +x 00:04:50.466 20:05:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:50.466 20:05:55 -- common/autotest_common.sh@862 -- # return 0 00:04:50.466 20:05:55 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:50.734 Malloc0 00:04:50.734 20:05:55 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.052 Malloc1 00:04:51.052 20:05:55 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@12 -- # local i 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.052 20:05:55 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:51.309 /dev/nbd0 00:04:51.309 20:05:56 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:51.309 20:05:56 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:51.309 20:05:56 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:51.309 20:05:56 -- common/autotest_common.sh@867 -- # local i 00:04:51.309 20:05:56 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:51.309 20:05:56 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:51.309 20:05:56 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:51.309 20:05:56 -- common/autotest_common.sh@871 -- # break 00:04:51.309 20:05:56 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:51.309 20:05:56 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:51.309 20:05:56 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:51.309 1+0 records in 00:04:51.309 1+0 records out 00:04:51.309 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000165334 s, 24.8 MB/s 00:04:51.309 20:05:56 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.309 20:05:56 -- common/autotest_common.sh@884 -- # size=4096 00:04:51.309 20:05:56 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.309 20:05:56 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:51.309 20:05:56 -- common/autotest_common.sh@887 -- # return 0 00:04:51.309 20:05:56 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:51.309 20:05:56 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.309 20:05:56 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:51.567 /dev/nbd1 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:51.567 20:05:56 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:51.567 20:05:56 -- common/autotest_common.sh@867 -- # local i 00:04:51.567 20:05:56 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:51.567 20:05:56 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:51.567 20:05:56 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:51.567 20:05:56 -- common/autotest_common.sh@871 -- # break 00:04:51.567 20:05:56 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:51.567 20:05:56 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:51.567 20:05:56 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:51.567 1+0 records in 00:04:51.567 1+0 records out 00:04:51.567 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000224595 s, 18.2 MB/s 00:04:51.567 20:05:56 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.567 20:05:56 -- common/autotest_common.sh@884 -- # size=4096 00:04:51.567 20:05:56 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.567 20:05:56 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:51.567 20:05:56 -- common/autotest_common.sh@887 -- # return 0 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.567 20:05:56 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:51.825 { 00:04:51.825 "nbd_device": "/dev/nbd0", 00:04:51.825 "bdev_name": "Malloc0" 00:04:51.825 }, 00:04:51.825 { 00:04:51.825 "nbd_device": "/dev/nbd1", 00:04:51.825 "bdev_name": "Malloc1" 00:04:51.825 } 00:04:51.825 ]' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:51.825 { 00:04:51.825 "nbd_device": "/dev/nbd0", 00:04:51.825 "bdev_name": "Malloc0" 00:04:51.825 }, 00:04:51.825 { 00:04:51.825 "nbd_device": "/dev/nbd1", 00:04:51.825 "bdev_name": "Malloc1" 00:04:51.825 } 00:04:51.825 ]' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:51.825 /dev/nbd1' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:51.825 /dev/nbd1' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@65 -- # count=2 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@95 -- # count=2 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:51.825 256+0 records in 00:04:51.825 256+0 records out 00:04:51.825 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00519254 s, 202 MB/s 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:51.825 256+0 records in 00:04:51.825 256+0 records out 00:04:51.825 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197135 s, 53.2 MB/s 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:51.825 256+0 records in 00:04:51.825 256+0 records out 00:04:51.825 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234033 s, 44.8 MB/s 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@51 -- # local i 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:51.825 20:05:56 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@41 -- # break 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@45 -- # return 0 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:52.083 20:05:57 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@41 -- # break 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@45 -- # return 0 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.341 20:05:57 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.598 20:05:57 -- bdev/nbd_common.sh@65 -- # true 00:04:52.855 20:05:57 -- bdev/nbd_common.sh@65 -- # count=0 00:04:52.855 20:05:57 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:52.855 20:05:57 -- bdev/nbd_common.sh@104 -- # count=0 00:04:52.855 20:05:57 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:52.855 20:05:57 -- bdev/nbd_common.sh@109 -- # return 0 00:04:52.855 20:05:57 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:53.114 20:05:57 -- event/event.sh@35 -- # sleep 3 00:04:53.373 [2024-11-20 20:05:58.173672] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:53.373 [2024-11-20 20:05:58.287851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:53.373 [2024-11-20 20:05:58.287856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.373 [2024-11-20 20:05:58.349279] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:53.373 [2024-11-20 20:05:58.349349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:55.904 20:06:00 -- event/event.sh@23 -- # for i in {0..2} 00:04:55.904 20:06:00 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:55.904 spdk_app_start Round 2 00:04:55.904 20:06:00 -- event/event.sh@25 -- # waitforlisten 3038740 /var/tmp/spdk-nbd.sock 00:04:55.904 20:06:00 -- common/autotest_common.sh@829 -- # '[' -z 3038740 ']' 00:04:55.904 20:06:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:55.904 20:06:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:55.904 20:06:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:55.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:55.904 20:06:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:55.904 20:06:00 -- common/autotest_common.sh@10 -- # set +x 00:04:56.162 20:06:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:56.162 20:06:01 -- common/autotest_common.sh@862 -- # return 0 00:04:56.162 20:06:01 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.420 Malloc0 00:04:56.420 20:06:01 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.677 Malloc1 00:04:56.936 20:06:01 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@12 -- # local i 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.936 20:06:01 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:57.194 /dev/nbd0 00:04:57.194 20:06:01 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:57.194 20:06:02 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:57.194 20:06:02 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:57.194 20:06:02 -- common/autotest_common.sh@867 -- # local i 00:04:57.194 20:06:02 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:57.194 20:06:02 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:57.194 20:06:02 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:57.194 20:06:02 -- common/autotest_common.sh@871 -- # break 00:04:57.194 20:06:02 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:57.194 20:06:02 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:57.194 20:06:02 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.194 1+0 records in 00:04:57.194 1+0 records out 00:04:57.194 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000174944 s, 23.4 MB/s 00:04:57.194 20:06:02 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.194 20:06:02 -- common/autotest_common.sh@884 -- # size=4096 00:04:57.194 20:06:02 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.194 20:06:02 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:57.194 20:06:02 -- common/autotest_common.sh@887 -- # return 0 00:04:57.194 20:06:02 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.194 20:06:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.194 20:06:02 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:57.452 /dev/nbd1 00:04:57.452 20:06:02 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:57.452 20:06:02 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:57.452 20:06:02 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:57.452 20:06:02 -- common/autotest_common.sh@867 -- # local i 00:04:57.452 20:06:02 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:57.452 20:06:02 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:57.452 20:06:02 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:57.452 20:06:02 -- common/autotest_common.sh@871 -- # break 00:04:57.453 20:06:02 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:57.453 20:06:02 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:57.453 20:06:02 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.453 1+0 records in 00:04:57.453 1+0 records out 00:04:57.453 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000200557 s, 20.4 MB/s 00:04:57.453 20:06:02 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.453 20:06:02 -- common/autotest_common.sh@884 -- # size=4096 00:04:57.453 20:06:02 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.453 20:06:02 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:57.453 20:06:02 -- common/autotest_common.sh@887 -- # return 0 00:04:57.453 20:06:02 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.453 20:06:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.453 20:06:02 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.453 20:06:02 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.453 20:06:02 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:57.711 { 00:04:57.711 "nbd_device": "/dev/nbd0", 00:04:57.711 "bdev_name": "Malloc0" 00:04:57.711 }, 00:04:57.711 { 00:04:57.711 "nbd_device": "/dev/nbd1", 00:04:57.711 "bdev_name": "Malloc1" 00:04:57.711 } 00:04:57.711 ]' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:57.711 { 00:04:57.711 "nbd_device": "/dev/nbd0", 00:04:57.711 "bdev_name": "Malloc0" 00:04:57.711 }, 00:04:57.711 { 00:04:57.711 "nbd_device": "/dev/nbd1", 00:04:57.711 "bdev_name": "Malloc1" 00:04:57.711 } 00:04:57.711 ]' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:57.711 /dev/nbd1' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:57.711 /dev/nbd1' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@65 -- # count=2 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@95 -- # count=2 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:57.711 256+0 records in 00:04:57.711 256+0 records out 00:04:57.711 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0038929 s, 269 MB/s 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:57.711 256+0 records in 00:04:57.711 256+0 records out 00:04:57.711 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228619 s, 45.9 MB/s 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:57.711 256+0 records in 00:04:57.711 256+0 records out 00:04:57.711 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236553 s, 44.3 MB/s 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@51 -- # local i 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.711 20:06:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@41 -- # break 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.969 20:06:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@41 -- # break 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@45 -- # return 0 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.227 20:06:03 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:58.486 20:06:03 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:58.486 20:06:03 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:58.486 20:06:03 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@65 -- # true 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@65 -- # count=0 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@104 -- # count=0 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:58.744 20:06:03 -- bdev/nbd_common.sh@109 -- # return 0 00:04:58.744 20:06:03 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:59.002 20:06:03 -- event/event.sh@35 -- # sleep 3 00:04:59.260 [2024-11-20 20:06:04.137480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:59.260 [2024-11-20 20:06:04.248361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.260 [2024-11-20 20:06:04.248364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:59.518 [2024-11-20 20:06:04.310058] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:59.518 [2024-11-20 20:06:04.310141] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:02.047 20:06:06 -- event/event.sh@38 -- # waitforlisten 3038740 /var/tmp/spdk-nbd.sock 00:05:02.047 20:06:06 -- common/autotest_common.sh@829 -- # '[' -z 3038740 ']' 00:05:02.047 20:06:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:02.047 20:06:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.047 20:06:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:02.047 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:02.047 20:06:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.047 20:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:02.305 20:06:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:02.305 20:06:07 -- common/autotest_common.sh@862 -- # return 0 00:05:02.305 20:06:07 -- event/event.sh@39 -- # killprocess 3038740 00:05:02.305 20:06:07 -- common/autotest_common.sh@936 -- # '[' -z 3038740 ']' 00:05:02.305 20:06:07 -- common/autotest_common.sh@940 -- # kill -0 3038740 00:05:02.305 20:06:07 -- common/autotest_common.sh@941 -- # uname 00:05:02.305 20:06:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:02.305 20:06:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3038740 00:05:02.305 20:06:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:02.306 20:06:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:02.306 20:06:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3038740' 00:05:02.306 killing process with pid 3038740 00:05:02.306 20:06:07 -- common/autotest_common.sh@955 -- # kill 3038740 00:05:02.306 20:06:07 -- common/autotest_common.sh@960 -- # wait 3038740 00:05:02.565 spdk_app_start is called in Round 0. 00:05:02.565 Shutdown signal received, stop current app iteration 00:05:02.565 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:02.565 spdk_app_start is called in Round 1. 00:05:02.565 Shutdown signal received, stop current app iteration 00:05:02.565 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:02.565 spdk_app_start is called in Round 2. 00:05:02.565 Shutdown signal received, stop current app iteration 00:05:02.565 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:02.565 spdk_app_start is called in Round 3. 00:05:02.565 Shutdown signal received, stop current app iteration 00:05:02.565 20:06:07 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:02.565 20:06:07 -- event/event.sh@42 -- # return 0 00:05:02.565 00:05:02.565 real 0m18.997s 00:05:02.565 user 0m41.485s 00:05:02.565 sys 0m3.182s 00:05:02.565 20:06:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.565 20:06:07 -- common/autotest_common.sh@10 -- # set +x 00:05:02.565 ************************************ 00:05:02.565 END TEST app_repeat 00:05:02.565 ************************************ 00:05:02.565 20:06:07 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:02.565 20:06:07 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:02.565 20:06:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.565 20:06:07 -- common/autotest_common.sh@10 -- # set +x 00:05:02.565 ************************************ 00:05:02.565 START TEST cpu_locks 00:05:02.565 ************************************ 00:05:02.565 20:06:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:02.565 * Looking for test storage... 00:05:02.565 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:02.565 20:06:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:02.565 20:06:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:02.565 20:06:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:02.565 20:06:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:02.565 20:06:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:02.565 20:06:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:02.565 20:06:07 -- scripts/common.sh@335 -- # IFS=.-: 00:05:02.565 20:06:07 -- scripts/common.sh@335 -- # read -ra ver1 00:05:02.565 20:06:07 -- scripts/common.sh@336 -- # IFS=.-: 00:05:02.565 20:06:07 -- scripts/common.sh@336 -- # read -ra ver2 00:05:02.565 20:06:07 -- scripts/common.sh@337 -- # local 'op=<' 00:05:02.565 20:06:07 -- scripts/common.sh@339 -- # ver1_l=2 00:05:02.565 20:06:07 -- scripts/common.sh@340 -- # ver2_l=1 00:05:02.565 20:06:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:02.565 20:06:07 -- scripts/common.sh@343 -- # case "$op" in 00:05:02.565 20:06:07 -- scripts/common.sh@344 -- # : 1 00:05:02.565 20:06:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:02.565 20:06:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:02.565 20:06:07 -- scripts/common.sh@364 -- # decimal 1 00:05:02.565 20:06:07 -- scripts/common.sh@352 -- # local d=1 00:05:02.565 20:06:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:02.565 20:06:07 -- scripts/common.sh@354 -- # echo 1 00:05:02.565 20:06:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:02.565 20:06:07 -- scripts/common.sh@365 -- # decimal 2 00:05:02.565 20:06:07 -- scripts/common.sh@352 -- # local d=2 00:05:02.565 20:06:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:02.565 20:06:07 -- scripts/common.sh@354 -- # echo 2 00:05:02.565 20:06:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:02.565 20:06:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:02.565 20:06:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:02.565 20:06:07 -- scripts/common.sh@367 -- # return 0 00:05:02.565 20:06:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:02.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.565 --rc genhtml_branch_coverage=1 00:05:02.565 --rc genhtml_function_coverage=1 00:05:02.565 --rc genhtml_legend=1 00:05:02.565 --rc geninfo_all_blocks=1 00:05:02.565 --rc geninfo_unexecuted_blocks=1 00:05:02.565 00:05:02.565 ' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:02.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.565 --rc genhtml_branch_coverage=1 00:05:02.565 --rc genhtml_function_coverage=1 00:05:02.565 --rc genhtml_legend=1 00:05:02.565 --rc geninfo_all_blocks=1 00:05:02.565 --rc geninfo_unexecuted_blocks=1 00:05:02.565 00:05:02.565 ' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:02.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.565 --rc genhtml_branch_coverage=1 00:05:02.565 --rc genhtml_function_coverage=1 00:05:02.565 --rc genhtml_legend=1 00:05:02.565 --rc geninfo_all_blocks=1 00:05:02.565 --rc geninfo_unexecuted_blocks=1 00:05:02.565 00:05:02.565 ' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:02.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.565 --rc genhtml_branch_coverage=1 00:05:02.565 --rc genhtml_function_coverage=1 00:05:02.565 --rc genhtml_legend=1 00:05:02.565 --rc geninfo_all_blocks=1 00:05:02.565 --rc geninfo_unexecuted_blocks=1 00:05:02.565 00:05:02.565 ' 00:05:02.565 20:06:07 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:02.565 20:06:07 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:02.565 20:06:07 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:02.565 20:06:07 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:02.565 20:06:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.565 20:06:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.565 20:06:07 -- common/autotest_common.sh@10 -- # set +x 00:05:02.565 ************************************ 00:05:02.565 START TEST default_locks 00:05:02.565 ************************************ 00:05:02.565 20:06:07 -- common/autotest_common.sh@1114 -- # default_locks 00:05:02.565 20:06:07 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3041642 00:05:02.565 20:06:07 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:02.565 20:06:07 -- event/cpu_locks.sh@47 -- # waitforlisten 3041642 00:05:02.565 20:06:07 -- common/autotest_common.sh@829 -- # '[' -z 3041642 ']' 00:05:02.565 20:06:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:02.565 20:06:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.565 20:06:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:02.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:02.565 20:06:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.565 20:06:07 -- common/autotest_common.sh@10 -- # set +x 00:05:02.824 [2024-11-20 20:06:07.624780] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.824 [2024-11-20 20:06:07.624865] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3041642 ] 00:05:02.824 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.824 [2024-11-20 20:06:07.682402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.824 [2024-11-20 20:06:07.789431] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:02.824 [2024-11-20 20:06:07.789609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.759 20:06:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.759 20:06:08 -- common/autotest_common.sh@862 -- # return 0 00:05:03.759 20:06:08 -- event/cpu_locks.sh@49 -- # locks_exist 3041642 00:05:03.759 20:06:08 -- event/cpu_locks.sh@22 -- # lslocks -p 3041642 00:05:03.759 20:06:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:04.017 lslocks: write error 00:05:04.017 20:06:08 -- event/cpu_locks.sh@50 -- # killprocess 3041642 00:05:04.017 20:06:08 -- common/autotest_common.sh@936 -- # '[' -z 3041642 ']' 00:05:04.017 20:06:08 -- common/autotest_common.sh@940 -- # kill -0 3041642 00:05:04.017 20:06:08 -- common/autotest_common.sh@941 -- # uname 00:05:04.017 20:06:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.017 20:06:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3041642 00:05:04.017 20:06:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.017 20:06:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.017 20:06:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3041642' 00:05:04.017 killing process with pid 3041642 00:05:04.017 20:06:08 -- common/autotest_common.sh@955 -- # kill 3041642 00:05:04.017 20:06:08 -- common/autotest_common.sh@960 -- # wait 3041642 00:05:04.287 20:06:09 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3041642 00:05:04.287 20:06:09 -- common/autotest_common.sh@650 -- # local es=0 00:05:04.287 20:06:09 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3041642 00:05:04.287 20:06:09 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:04.287 20:06:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:04.287 20:06:09 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:04.287 20:06:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:04.287 20:06:09 -- common/autotest_common.sh@653 -- # waitforlisten 3041642 00:05:04.287 20:06:09 -- common/autotest_common.sh@829 -- # '[' -z 3041642 ']' 00:05:04.287 20:06:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.288 20:06:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.288 20:06:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.288 20:06:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.288 20:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:04.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3041642) - No such process 00:05:04.288 ERROR: process (pid: 3041642) is no longer running 00:05:04.288 20:06:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.288 20:06:09 -- common/autotest_common.sh@862 -- # return 1 00:05:04.288 20:06:09 -- common/autotest_common.sh@653 -- # es=1 00:05:04.288 20:06:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:04.288 20:06:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:04.288 20:06:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:04.288 20:06:09 -- event/cpu_locks.sh@54 -- # no_locks 00:05:04.288 20:06:09 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:04.288 20:06:09 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:04.288 20:06:09 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:04.288 00:05:04.288 real 0m1.698s 00:05:04.288 user 0m1.850s 00:05:04.288 sys 0m0.538s 00:05:04.288 20:06:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.288 20:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:04.288 ************************************ 00:05:04.288 END TEST default_locks 00:05:04.288 ************************************ 00:05:04.288 20:06:09 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:04.288 20:06:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.288 20:06:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.288 20:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:04.288 ************************************ 00:05:04.288 START TEST default_locks_via_rpc 00:05:04.288 ************************************ 00:05:04.288 20:06:09 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:04.288 20:06:09 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3042137 00:05:04.288 20:06:09 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:04.288 20:06:09 -- event/cpu_locks.sh@63 -- # waitforlisten 3042137 00:05:04.288 20:06:09 -- common/autotest_common.sh@829 -- # '[' -z 3042137 ']' 00:05:04.288 20:06:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.288 20:06:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.288 20:06:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.288 20:06:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.288 20:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:04.549 [2024-11-20 20:06:09.352322] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:04.549 [2024-11-20 20:06:09.352415] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3042137 ] 00:05:04.549 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.549 [2024-11-20 20:06:09.415548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.549 [2024-11-20 20:06:09.528687] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:04.549 [2024-11-20 20:06:09.528870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.482 20:06:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:05.482 20:06:10 -- common/autotest_common.sh@862 -- # return 0 00:05:05.482 20:06:10 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:05.482 20:06:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:05.482 20:06:10 -- common/autotest_common.sh@10 -- # set +x 00:05:05.482 20:06:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:05.482 20:06:10 -- event/cpu_locks.sh@67 -- # no_locks 00:05:05.482 20:06:10 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:05.482 20:06:10 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:05.482 20:06:10 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:05.482 20:06:10 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:05.482 20:06:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:05.482 20:06:10 -- common/autotest_common.sh@10 -- # set +x 00:05:05.482 20:06:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:05.482 20:06:10 -- event/cpu_locks.sh@71 -- # locks_exist 3042137 00:05:05.482 20:06:10 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:05.482 20:06:10 -- event/cpu_locks.sh@22 -- # lslocks -p 3042137 00:05:05.741 20:06:10 -- event/cpu_locks.sh@73 -- # killprocess 3042137 00:05:05.741 20:06:10 -- common/autotest_common.sh@936 -- # '[' -z 3042137 ']' 00:05:05.741 20:06:10 -- common/autotest_common.sh@940 -- # kill -0 3042137 00:05:05.741 20:06:10 -- common/autotest_common.sh@941 -- # uname 00:05:05.741 20:06:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:05.741 20:06:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3042137 00:05:05.741 20:06:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:05.741 20:06:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:05.741 20:06:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3042137' 00:05:05.741 killing process with pid 3042137 00:05:05.741 20:06:10 -- common/autotest_common.sh@955 -- # kill 3042137 00:05:05.741 20:06:10 -- common/autotest_common.sh@960 -- # wait 3042137 00:05:06.308 00:05:06.308 real 0m1.779s 00:05:06.308 user 0m1.946s 00:05:06.308 sys 0m0.543s 00:05:06.308 20:06:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.308 20:06:11 -- common/autotest_common.sh@10 -- # set +x 00:05:06.308 ************************************ 00:05:06.308 END TEST default_locks_via_rpc 00:05:06.308 ************************************ 00:05:06.308 20:06:11 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:06.308 20:06:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.308 20:06:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.308 20:06:11 -- common/autotest_common.sh@10 -- # set +x 00:05:06.308 ************************************ 00:05:06.308 START TEST non_locking_app_on_locked_coremask 00:05:06.308 ************************************ 00:05:06.308 20:06:11 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:06.308 20:06:11 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3042381 00:05:06.308 20:06:11 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:06.308 20:06:11 -- event/cpu_locks.sh@81 -- # waitforlisten 3042381 /var/tmp/spdk.sock 00:05:06.308 20:06:11 -- common/autotest_common.sh@829 -- # '[' -z 3042381 ']' 00:05:06.308 20:06:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:06.308 20:06:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:06.308 20:06:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:06.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:06.308 20:06:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:06.308 20:06:11 -- common/autotest_common.sh@10 -- # set +x 00:05:06.308 [2024-11-20 20:06:11.158631] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.308 [2024-11-20 20:06:11.158737] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3042381 ] 00:05:06.308 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.308 [2024-11-20 20:06:11.216302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.308 [2024-11-20 20:06:11.325543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:06.308 [2024-11-20 20:06:11.325708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.243 20:06:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:07.243 20:06:12 -- common/autotest_common.sh@862 -- # return 0 00:05:07.243 20:06:12 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3042521 00:05:07.243 20:06:12 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:07.243 20:06:12 -- event/cpu_locks.sh@85 -- # waitforlisten 3042521 /var/tmp/spdk2.sock 00:05:07.243 20:06:12 -- common/autotest_common.sh@829 -- # '[' -z 3042521 ']' 00:05:07.243 20:06:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:07.243 20:06:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:07.243 20:06:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:07.243 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:07.243 20:06:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:07.243 20:06:12 -- common/autotest_common.sh@10 -- # set +x 00:05:07.243 [2024-11-20 20:06:12.155268] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:07.243 [2024-11-20 20:06:12.155355] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3042521 ] 00:05:07.243 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.243 [2024-11-20 20:06:12.244557] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:07.243 [2024-11-20 20:06:12.244589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.501 [2024-11-20 20:06:12.481166] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:07.502 [2024-11-20 20:06:12.481339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.067 20:06:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.067 20:06:13 -- common/autotest_common.sh@862 -- # return 0 00:05:08.067 20:06:13 -- event/cpu_locks.sh@87 -- # locks_exist 3042381 00:05:08.067 20:06:13 -- event/cpu_locks.sh@22 -- # lslocks -p 3042381 00:05:08.067 20:06:13 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:08.633 lslocks: write error 00:05:08.633 20:06:13 -- event/cpu_locks.sh@89 -- # killprocess 3042381 00:05:08.633 20:06:13 -- common/autotest_common.sh@936 -- # '[' -z 3042381 ']' 00:05:08.633 20:06:13 -- common/autotest_common.sh@940 -- # kill -0 3042381 00:05:08.633 20:06:13 -- common/autotest_common.sh@941 -- # uname 00:05:08.633 20:06:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:08.633 20:06:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3042381 00:05:08.633 20:06:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:08.633 20:06:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:08.633 20:06:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3042381' 00:05:08.633 killing process with pid 3042381 00:05:08.633 20:06:13 -- common/autotest_common.sh@955 -- # kill 3042381 00:05:08.633 20:06:13 -- common/autotest_common.sh@960 -- # wait 3042381 00:05:09.567 20:06:14 -- event/cpu_locks.sh@90 -- # killprocess 3042521 00:05:09.567 20:06:14 -- common/autotest_common.sh@936 -- # '[' -z 3042521 ']' 00:05:09.567 20:06:14 -- common/autotest_common.sh@940 -- # kill -0 3042521 00:05:09.567 20:06:14 -- common/autotest_common.sh@941 -- # uname 00:05:09.567 20:06:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:09.567 20:06:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3042521 00:05:09.567 20:06:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:09.567 20:06:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:09.567 20:06:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3042521' 00:05:09.567 killing process with pid 3042521 00:05:09.567 20:06:14 -- common/autotest_common.sh@955 -- # kill 3042521 00:05:09.567 20:06:14 -- common/autotest_common.sh@960 -- # wait 3042521 00:05:10.133 00:05:10.133 real 0m3.880s 00:05:10.133 user 0m4.232s 00:05:10.133 sys 0m1.047s 00:05:10.133 20:06:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.133 20:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:10.133 ************************************ 00:05:10.133 END TEST non_locking_app_on_locked_coremask 00:05:10.133 ************************************ 00:05:10.133 20:06:15 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:10.133 20:06:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.133 20:06:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.133 20:06:15 -- common/autotest_common.sh@10 -- # set +x 00:05:10.133 ************************************ 00:05:10.133 START TEST locking_app_on_unlocked_coremask 00:05:10.133 ************************************ 00:05:10.133 20:06:15 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:10.133 20:06:15 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3042953 00:05:10.133 20:06:15 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:10.133 20:06:15 -- event/cpu_locks.sh@99 -- # waitforlisten 3042953 /var/tmp/spdk.sock 00:05:10.133 20:06:15 -- common/autotest_common.sh@829 -- # '[' -z 3042953 ']' 00:05:10.133 20:06:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.133 20:06:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.133 20:06:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.133 20:06:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.133 20:06:15 -- common/autotest_common.sh@10 -- # set +x 00:05:10.133 [2024-11-20 20:06:15.067747] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.133 [2024-11-20 20:06:15.067832] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3042953 ] 00:05:10.133 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.133 [2024-11-20 20:06:15.128802] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:10.133 [2024-11-20 20:06:15.128846] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.392 [2024-11-20 20:06:15.241560] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:10.392 [2024-11-20 20:06:15.241734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.324 20:06:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.324 20:06:16 -- common/autotest_common.sh@862 -- # return 0 00:05:11.324 20:06:16 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3042977 00:05:11.325 20:06:16 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:11.325 20:06:16 -- event/cpu_locks.sh@103 -- # waitforlisten 3042977 /var/tmp/spdk2.sock 00:05:11.325 20:06:16 -- common/autotest_common.sh@829 -- # '[' -z 3042977 ']' 00:05:11.325 20:06:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:11.325 20:06:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.325 20:06:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:11.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:11.325 20:06:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.325 20:06:16 -- common/autotest_common.sh@10 -- # set +x 00:05:11.325 [2024-11-20 20:06:16.057016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.325 [2024-11-20 20:06:16.057127] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3042977 ] 00:05:11.325 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.325 [2024-11-20 20:06:16.149744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.582 [2024-11-20 20:06:16.374780] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.582 [2024-11-20 20:06:16.374958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.148 20:06:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.148 20:06:17 -- common/autotest_common.sh@862 -- # return 0 00:05:12.148 20:06:17 -- event/cpu_locks.sh@105 -- # locks_exist 3042977 00:05:12.148 20:06:17 -- event/cpu_locks.sh@22 -- # lslocks -p 3042977 00:05:12.148 20:06:17 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:12.713 lslocks: write error 00:05:12.713 20:06:17 -- event/cpu_locks.sh@107 -- # killprocess 3042953 00:05:12.713 20:06:17 -- common/autotest_common.sh@936 -- # '[' -z 3042953 ']' 00:05:12.713 20:06:17 -- common/autotest_common.sh@940 -- # kill -0 3042953 00:05:12.713 20:06:17 -- common/autotest_common.sh@941 -- # uname 00:05:12.713 20:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.713 20:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3042953 00:05:12.713 20:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.713 20:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.713 20:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3042953' 00:05:12.713 killing process with pid 3042953 00:05:12.713 20:06:17 -- common/autotest_common.sh@955 -- # kill 3042953 00:05:12.713 20:06:17 -- common/autotest_common.sh@960 -- # wait 3042953 00:05:13.646 20:06:18 -- event/cpu_locks.sh@108 -- # killprocess 3042977 00:05:13.646 20:06:18 -- common/autotest_common.sh@936 -- # '[' -z 3042977 ']' 00:05:13.646 20:06:18 -- common/autotest_common.sh@940 -- # kill -0 3042977 00:05:13.646 20:06:18 -- common/autotest_common.sh@941 -- # uname 00:05:13.647 20:06:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.647 20:06:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3042977 00:05:13.647 20:06:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.647 20:06:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.647 20:06:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3042977' 00:05:13.647 killing process with pid 3042977 00:05:13.647 20:06:18 -- common/autotest_common.sh@955 -- # kill 3042977 00:05:13.647 20:06:18 -- common/autotest_common.sh@960 -- # wait 3042977 00:05:14.212 00:05:14.212 real 0m3.950s 00:05:14.212 user 0m4.311s 00:05:14.212 sys 0m1.084s 00:05:14.212 20:06:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.212 20:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:14.212 ************************************ 00:05:14.212 END TEST locking_app_on_unlocked_coremask 00:05:14.212 ************************************ 00:05:14.212 20:06:18 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:14.212 20:06:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.212 20:06:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.212 20:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:14.212 ************************************ 00:05:14.212 START TEST locking_app_on_locked_coremask 00:05:14.212 ************************************ 00:05:14.212 20:06:18 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:14.212 20:06:18 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3043416 00:05:14.212 20:06:18 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.212 20:06:18 -- event/cpu_locks.sh@116 -- # waitforlisten 3043416 /var/tmp/spdk.sock 00:05:14.212 20:06:18 -- common/autotest_common.sh@829 -- # '[' -z 3043416 ']' 00:05:14.212 20:06:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.212 20:06:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.212 20:06:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.212 20:06:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.212 20:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:14.212 [2024-11-20 20:06:19.041204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.212 [2024-11-20 20:06:19.041298] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3043416 ] 00:05:14.213 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.213 [2024-11-20 20:06:19.098744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.213 [2024-11-20 20:06:19.208308] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.213 [2024-11-20 20:06:19.208488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.144 20:06:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.144 20:06:20 -- common/autotest_common.sh@862 -- # return 0 00:05:15.144 20:06:20 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3043556 00:05:15.144 20:06:20 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3043556 /var/tmp/spdk2.sock 00:05:15.144 20:06:20 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:15.144 20:06:20 -- common/autotest_common.sh@650 -- # local es=0 00:05:15.144 20:06:20 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3043556 /var/tmp/spdk2.sock 00:05:15.144 20:06:20 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:15.144 20:06:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.144 20:06:20 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:15.144 20:06:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.144 20:06:20 -- common/autotest_common.sh@653 -- # waitforlisten 3043556 /var/tmp/spdk2.sock 00:05:15.144 20:06:20 -- common/autotest_common.sh@829 -- # '[' -z 3043556 ']' 00:05:15.144 20:06:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.144 20:06:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.144 20:06:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.144 20:06:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.144 20:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:15.144 [2024-11-20 20:06:20.051105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.144 [2024-11-20 20:06:20.051188] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3043556 ] 00:05:15.144 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.144 [2024-11-20 20:06:20.141113] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3043416 has claimed it. 00:05:15.144 [2024-11-20 20:06:20.141211] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:16.078 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3043556) - No such process 00:05:16.078 ERROR: process (pid: 3043556) is no longer running 00:05:16.078 20:06:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.078 20:06:20 -- common/autotest_common.sh@862 -- # return 1 00:05:16.078 20:06:20 -- common/autotest_common.sh@653 -- # es=1 00:05:16.078 20:06:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:16.078 20:06:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:16.078 20:06:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:16.078 20:06:20 -- event/cpu_locks.sh@122 -- # locks_exist 3043416 00:05:16.078 20:06:20 -- event/cpu_locks.sh@22 -- # lslocks -p 3043416 00:05:16.078 20:06:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:16.336 lslocks: write error 00:05:16.336 20:06:21 -- event/cpu_locks.sh@124 -- # killprocess 3043416 00:05:16.336 20:06:21 -- common/autotest_common.sh@936 -- # '[' -z 3043416 ']' 00:05:16.336 20:06:21 -- common/autotest_common.sh@940 -- # kill -0 3043416 00:05:16.336 20:06:21 -- common/autotest_common.sh@941 -- # uname 00:05:16.336 20:06:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.336 20:06:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3043416 00:05:16.336 20:06:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.336 20:06:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.336 20:06:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3043416' 00:05:16.336 killing process with pid 3043416 00:05:16.336 20:06:21 -- common/autotest_common.sh@955 -- # kill 3043416 00:05:16.336 20:06:21 -- common/autotest_common.sh@960 -- # wait 3043416 00:05:16.902 00:05:16.902 real 0m2.732s 00:05:16.902 user 0m3.148s 00:05:16.902 sys 0m0.676s 00:05:16.902 20:06:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.902 20:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:16.902 ************************************ 00:05:16.902 END TEST locking_app_on_locked_coremask 00:05:16.902 ************************************ 00:05:16.902 20:06:21 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:16.902 20:06:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:16.902 20:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.902 20:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:16.902 ************************************ 00:05:16.902 START TEST locking_overlapped_coremask 00:05:16.902 ************************************ 00:05:16.902 20:06:21 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:16.902 20:06:21 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3043847 00:05:16.902 20:06:21 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:16.902 20:06:21 -- event/cpu_locks.sh@133 -- # waitforlisten 3043847 /var/tmp/spdk.sock 00:05:16.902 20:06:21 -- common/autotest_common.sh@829 -- # '[' -z 3043847 ']' 00:05:16.902 20:06:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.902 20:06:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.902 20:06:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.902 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.902 20:06:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.902 20:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:16.902 [2024-11-20 20:06:21.798501] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.902 [2024-11-20 20:06:21.798581] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3043847 ] 00:05:16.902 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.902 [2024-11-20 20:06:21.861759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:17.161 [2024-11-20 20:06:21.983961] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.161 [2024-11-20 20:06:21.984193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:17.161 [2024-11-20 20:06:21.984224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:17.161 [2024-11-20 20:06:21.984228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.093 20:06:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.093 20:06:22 -- common/autotest_common.sh@862 -- # return 0 00:05:18.093 20:06:22 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3043896 00:05:18.093 20:06:22 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3043896 /var/tmp/spdk2.sock 00:05:18.093 20:06:22 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:18.093 20:06:22 -- common/autotest_common.sh@650 -- # local es=0 00:05:18.093 20:06:22 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3043896 /var/tmp/spdk2.sock 00:05:18.093 20:06:22 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:18.093 20:06:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:18.093 20:06:22 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:18.093 20:06:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:18.093 20:06:22 -- common/autotest_common.sh@653 -- # waitforlisten 3043896 /var/tmp/spdk2.sock 00:05:18.093 20:06:22 -- common/autotest_common.sh@829 -- # '[' -z 3043896 ']' 00:05:18.093 20:06:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:18.093 20:06:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.093 20:06:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:18.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:18.093 20:06:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.093 20:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:18.093 [2024-11-20 20:06:22.841974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.093 [2024-11-20 20:06:22.842053] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3043896 ] 00:05:18.093 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.093 [2024-11-20 20:06:22.936763] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3043847 has claimed it. 00:05:18.093 [2024-11-20 20:06:22.936830] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:18.659 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3043896) - No such process 00:05:18.659 ERROR: process (pid: 3043896) is no longer running 00:05:18.659 20:06:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.659 20:06:23 -- common/autotest_common.sh@862 -- # return 1 00:05:18.659 20:06:23 -- common/autotest_common.sh@653 -- # es=1 00:05:18.659 20:06:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:18.659 20:06:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:18.659 20:06:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:18.659 20:06:23 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:18.659 20:06:23 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:18.659 20:06:23 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:18.659 20:06:23 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:18.659 20:06:23 -- event/cpu_locks.sh@141 -- # killprocess 3043847 00:05:18.659 20:06:23 -- common/autotest_common.sh@936 -- # '[' -z 3043847 ']' 00:05:18.659 20:06:23 -- common/autotest_common.sh@940 -- # kill -0 3043847 00:05:18.659 20:06:23 -- common/autotest_common.sh@941 -- # uname 00:05:18.659 20:06:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.659 20:06:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3043847 00:05:18.659 20:06:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.659 20:06:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.659 20:06:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3043847' 00:05:18.659 killing process with pid 3043847 00:05:18.659 20:06:23 -- common/autotest_common.sh@955 -- # kill 3043847 00:05:18.659 20:06:23 -- common/autotest_common.sh@960 -- # wait 3043847 00:05:19.226 00:05:19.226 real 0m2.293s 00:05:19.226 user 0m6.501s 00:05:19.226 sys 0m0.514s 00:05:19.226 20:06:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.226 20:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:19.226 ************************************ 00:05:19.226 END TEST locking_overlapped_coremask 00:05:19.226 ************************************ 00:05:19.226 20:06:24 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:19.226 20:06:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.226 20:06:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.226 20:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:19.226 ************************************ 00:05:19.226 START TEST locking_overlapped_coremask_via_rpc 00:05:19.226 ************************************ 00:05:19.226 20:06:24 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:19.226 20:06:24 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3044157 00:05:19.226 20:06:24 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:19.227 20:06:24 -- event/cpu_locks.sh@149 -- # waitforlisten 3044157 /var/tmp/spdk.sock 00:05:19.227 20:06:24 -- common/autotest_common.sh@829 -- # '[' -z 3044157 ']' 00:05:19.227 20:06:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.227 20:06:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.227 20:06:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.227 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.227 20:06:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.227 20:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:19.227 [2024-11-20 20:06:24.119731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.227 [2024-11-20 20:06:24.119838] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3044157 ] 00:05:19.227 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.227 [2024-11-20 20:06:24.176485] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:19.227 [2024-11-20 20:06:24.176527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:19.485 [2024-11-20 20:06:24.288081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.485 [2024-11-20 20:06:24.288272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:19.485 [2024-11-20 20:06:24.288334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:19.485 [2024-11-20 20:06:24.288338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.052 20:06:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.052 20:06:25 -- common/autotest_common.sh@862 -- # return 0 00:05:20.052 20:06:25 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3044247 00:05:20.052 20:06:25 -- event/cpu_locks.sh@153 -- # waitforlisten 3044247 /var/tmp/spdk2.sock 00:05:20.052 20:06:25 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:20.052 20:06:25 -- common/autotest_common.sh@829 -- # '[' -z 3044247 ']' 00:05:20.052 20:06:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:20.052 20:06:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.052 20:06:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:20.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:20.052 20:06:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.052 20:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:20.310 [2024-11-20 20:06:25.133701] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.310 [2024-11-20 20:06:25.133780] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3044247 ] 00:05:20.310 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.310 [2024-11-20 20:06:25.223728] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:20.310 [2024-11-20 20:06:25.223763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:20.568 [2024-11-20 20:06:25.441148] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.568 [2024-11-20 20:06:25.441463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:20.568 [2024-11-20 20:06:25.445127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:20.568 [2024-11-20 20:06:25.445129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:21.134 20:06:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.134 20:06:26 -- common/autotest_common.sh@862 -- # return 0 00:05:21.134 20:06:26 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:21.134 20:06:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.134 20:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:21.134 20:06:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:21.134 20:06:26 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:21.134 20:06:26 -- common/autotest_common.sh@650 -- # local es=0 00:05:21.134 20:06:26 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:21.134 20:06:26 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:21.134 20:06:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.134 20:06:26 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:21.134 20:06:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.134 20:06:26 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:21.134 20:06:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.134 20:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:21.134 [2024-11-20 20:06:26.096171] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3044157 has claimed it. 00:05:21.134 request: 00:05:21.134 { 00:05:21.134 "method": "framework_enable_cpumask_locks", 00:05:21.134 "req_id": 1 00:05:21.134 } 00:05:21.134 Got JSON-RPC error response 00:05:21.134 response: 00:05:21.134 { 00:05:21.134 "code": -32603, 00:05:21.134 "message": "Failed to claim CPU core: 2" 00:05:21.134 } 00:05:21.134 20:06:26 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:21.134 20:06:26 -- common/autotest_common.sh@653 -- # es=1 00:05:21.134 20:06:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:21.135 20:06:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:21.135 20:06:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:21.135 20:06:26 -- event/cpu_locks.sh@158 -- # waitforlisten 3044157 /var/tmp/spdk.sock 00:05:21.135 20:06:26 -- common/autotest_common.sh@829 -- # '[' -z 3044157 ']' 00:05:21.135 20:06:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.135 20:06:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.135 20:06:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.135 20:06:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.135 20:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:21.392 20:06:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.392 20:06:26 -- common/autotest_common.sh@862 -- # return 0 00:05:21.392 20:06:26 -- event/cpu_locks.sh@159 -- # waitforlisten 3044247 /var/tmp/spdk2.sock 00:05:21.392 20:06:26 -- common/autotest_common.sh@829 -- # '[' -z 3044247 ']' 00:05:21.392 20:06:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:21.392 20:06:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.392 20:06:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:21.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:21.392 20:06:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.392 20:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:21.650 20:06:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.650 20:06:26 -- common/autotest_common.sh@862 -- # return 0 00:05:21.650 20:06:26 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:21.650 20:06:26 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:21.650 20:06:26 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:21.650 20:06:26 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:21.650 00:05:21.650 real 0m2.574s 00:05:21.650 user 0m1.273s 00:05:21.650 sys 0m0.224s 00:05:21.650 20:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.650 20:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:21.650 ************************************ 00:05:21.650 END TEST locking_overlapped_coremask_via_rpc 00:05:21.650 ************************************ 00:05:21.650 20:06:26 -- event/cpu_locks.sh@174 -- # cleanup 00:05:21.650 20:06:26 -- event/cpu_locks.sh@15 -- # [[ -z 3044157 ]] 00:05:21.650 20:06:26 -- event/cpu_locks.sh@15 -- # killprocess 3044157 00:05:21.650 20:06:26 -- common/autotest_common.sh@936 -- # '[' -z 3044157 ']' 00:05:21.650 20:06:26 -- common/autotest_common.sh@940 -- # kill -0 3044157 00:05:21.650 20:06:26 -- common/autotest_common.sh@941 -- # uname 00:05:21.650 20:06:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.650 20:06:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3044157 00:05:21.908 20:06:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.908 20:06:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.908 20:06:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3044157' 00:05:21.908 killing process with pid 3044157 00:05:21.908 20:06:26 -- common/autotest_common.sh@955 -- # kill 3044157 00:05:21.908 20:06:26 -- common/autotest_common.sh@960 -- # wait 3044157 00:05:22.166 20:06:27 -- event/cpu_locks.sh@16 -- # [[ -z 3044247 ]] 00:05:22.166 20:06:27 -- event/cpu_locks.sh@16 -- # killprocess 3044247 00:05:22.166 20:06:27 -- common/autotest_common.sh@936 -- # '[' -z 3044247 ']' 00:05:22.166 20:06:27 -- common/autotest_common.sh@940 -- # kill -0 3044247 00:05:22.166 20:06:27 -- common/autotest_common.sh@941 -- # uname 00:05:22.166 20:06:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:22.166 20:06:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3044247 00:05:22.166 20:06:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:22.166 20:06:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:22.166 20:06:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3044247' 00:05:22.166 killing process with pid 3044247 00:05:22.166 20:06:27 -- common/autotest_common.sh@955 -- # kill 3044247 00:05:22.166 20:06:27 -- common/autotest_common.sh@960 -- # wait 3044247 00:05:22.731 20:06:27 -- event/cpu_locks.sh@18 -- # rm -f 00:05:22.731 20:06:27 -- event/cpu_locks.sh@1 -- # cleanup 00:05:22.731 20:06:27 -- event/cpu_locks.sh@15 -- # [[ -z 3044157 ]] 00:05:22.731 20:06:27 -- event/cpu_locks.sh@15 -- # killprocess 3044157 00:05:22.731 20:06:27 -- common/autotest_common.sh@936 -- # '[' -z 3044157 ']' 00:05:22.731 20:06:27 -- common/autotest_common.sh@940 -- # kill -0 3044157 00:05:22.731 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3044157) - No such process 00:05:22.731 20:06:27 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3044157 is not found' 00:05:22.731 Process with pid 3044157 is not found 00:05:22.731 20:06:27 -- event/cpu_locks.sh@16 -- # [[ -z 3044247 ]] 00:05:22.731 20:06:27 -- event/cpu_locks.sh@16 -- # killprocess 3044247 00:05:22.731 20:06:27 -- common/autotest_common.sh@936 -- # '[' -z 3044247 ']' 00:05:22.731 20:06:27 -- common/autotest_common.sh@940 -- # kill -0 3044247 00:05:22.731 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3044247) - No such process 00:05:22.731 20:06:27 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3044247 is not found' 00:05:22.731 Process with pid 3044247 is not found 00:05:22.731 20:06:27 -- event/cpu_locks.sh@18 -- # rm -f 00:05:22.731 00:05:22.731 real 0m20.192s 00:05:22.731 user 0m36.165s 00:05:22.731 sys 0m5.442s 00:05:22.731 20:06:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.731 20:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:22.731 ************************************ 00:05:22.731 END TEST cpu_locks 00:05:22.731 ************************************ 00:05:22.731 00:05:22.731 real 0m46.514s 00:05:22.731 user 1m28.455s 00:05:22.731 sys 0m9.402s 00:05:22.731 20:06:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.731 20:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:22.731 ************************************ 00:05:22.731 END TEST event 00:05:22.731 ************************************ 00:05:22.731 20:06:27 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:22.731 20:06:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:22.731 20:06:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.731 20:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:22.731 ************************************ 00:05:22.731 START TEST thread 00:05:22.731 ************************************ 00:05:22.732 20:06:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:22.732 * Looking for test storage... 00:05:22.732 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:22.732 20:06:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:22.732 20:06:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:22.732 20:06:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:22.990 20:06:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:22.990 20:06:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:22.990 20:06:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:22.990 20:06:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:22.990 20:06:27 -- scripts/common.sh@335 -- # IFS=.-: 00:05:22.990 20:06:27 -- scripts/common.sh@335 -- # read -ra ver1 00:05:22.990 20:06:27 -- scripts/common.sh@336 -- # IFS=.-: 00:05:22.990 20:06:27 -- scripts/common.sh@336 -- # read -ra ver2 00:05:22.990 20:06:27 -- scripts/common.sh@337 -- # local 'op=<' 00:05:22.990 20:06:27 -- scripts/common.sh@339 -- # ver1_l=2 00:05:22.990 20:06:27 -- scripts/common.sh@340 -- # ver2_l=1 00:05:22.990 20:06:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:22.990 20:06:27 -- scripts/common.sh@343 -- # case "$op" in 00:05:22.990 20:06:27 -- scripts/common.sh@344 -- # : 1 00:05:22.991 20:06:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:22.991 20:06:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:22.991 20:06:27 -- scripts/common.sh@364 -- # decimal 1 00:05:22.991 20:06:27 -- scripts/common.sh@352 -- # local d=1 00:05:22.991 20:06:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:22.991 20:06:27 -- scripts/common.sh@354 -- # echo 1 00:05:22.991 20:06:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:22.991 20:06:27 -- scripts/common.sh@365 -- # decimal 2 00:05:22.991 20:06:27 -- scripts/common.sh@352 -- # local d=2 00:05:22.991 20:06:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:22.991 20:06:27 -- scripts/common.sh@354 -- # echo 2 00:05:22.991 20:06:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:22.991 20:06:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:22.991 20:06:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:22.991 20:06:27 -- scripts/common.sh@367 -- # return 0 00:05:22.991 20:06:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:22.991 20:06:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:22.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:22.991 --rc genhtml_branch_coverage=1 00:05:22.991 --rc genhtml_function_coverage=1 00:05:22.991 --rc genhtml_legend=1 00:05:22.991 --rc geninfo_all_blocks=1 00:05:22.991 --rc geninfo_unexecuted_blocks=1 00:05:22.991 00:05:22.991 ' 00:05:22.991 20:06:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:22.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:22.991 --rc genhtml_branch_coverage=1 00:05:22.991 --rc genhtml_function_coverage=1 00:05:22.991 --rc genhtml_legend=1 00:05:22.991 --rc geninfo_all_blocks=1 00:05:22.991 --rc geninfo_unexecuted_blocks=1 00:05:22.991 00:05:22.991 ' 00:05:22.991 20:06:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:22.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:22.991 --rc genhtml_branch_coverage=1 00:05:22.991 --rc genhtml_function_coverage=1 00:05:22.991 --rc genhtml_legend=1 00:05:22.991 --rc geninfo_all_blocks=1 00:05:22.991 --rc geninfo_unexecuted_blocks=1 00:05:22.991 00:05:22.991 ' 00:05:22.991 20:06:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:22.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:22.991 --rc genhtml_branch_coverage=1 00:05:22.991 --rc genhtml_function_coverage=1 00:05:22.991 --rc genhtml_legend=1 00:05:22.991 --rc geninfo_all_blocks=1 00:05:22.991 --rc geninfo_unexecuted_blocks=1 00:05:22.991 00:05:22.991 ' 00:05:22.991 20:06:27 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:22.991 20:06:27 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:22.991 20:06:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.991 20:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:22.991 ************************************ 00:05:22.991 START TEST thread_poller_perf 00:05:22.991 ************************************ 00:05:22.991 20:06:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:22.991 [2024-11-20 20:06:27.829023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.991 [2024-11-20 20:06:27.829151] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3044686 ] 00:05:22.991 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.991 [2024-11-20 20:06:27.894935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.991 [2024-11-20 20:06:28.006320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.991 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:24.363 [2024-11-20T19:06:29.402Z] ====================================== 00:05:24.363 [2024-11-20T19:06:29.402Z] busy:2715310496 (cyc) 00:05:24.363 [2024-11-20T19:06:29.402Z] total_run_count: 280000 00:05:24.363 [2024-11-20T19:06:29.402Z] tsc_hz: 2700000000 (cyc) 00:05:24.363 [2024-11-20T19:06:29.402Z] ====================================== 00:05:24.363 [2024-11-20T19:06:29.402Z] poller_cost: 9697 (cyc), 3591 (nsec) 00:05:24.363 00:05:24.363 real 0m1.324s 00:05:24.363 user 0m1.231s 00:05:24.363 sys 0m0.080s 00:05:24.363 20:06:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.363 20:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:24.363 ************************************ 00:05:24.363 END TEST thread_poller_perf 00:05:24.363 ************************************ 00:05:24.363 20:06:29 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:24.363 20:06:29 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:24.363 20:06:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.363 20:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:24.363 ************************************ 00:05:24.363 START TEST thread_poller_perf 00:05:24.363 ************************************ 00:05:24.363 20:06:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:24.363 [2024-11-20 20:06:29.178495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.363 [2024-11-20 20:06:29.178580] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3044841 ] 00:05:24.363 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.363 [2024-11-20 20:06:29.239977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.363 [2024-11-20 20:06:29.356270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.363 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:25.864 [2024-11-20T19:06:30.904Z] ====================================== 00:05:25.865 [2024-11-20T19:06:30.904Z] busy:2703578245 (cyc) 00:05:25.865 [2024-11-20T19:06:30.904Z] total_run_count: 3816000 00:05:25.865 [2024-11-20T19:06:30.904Z] tsc_hz: 2700000000 (cyc) 00:05:25.865 [2024-11-20T19:06:30.904Z] ====================================== 00:05:25.865 [2024-11-20T19:06:30.904Z] poller_cost: 708 (cyc), 262 (nsec) 00:05:25.865 00:05:25.865 real 0m1.316s 00:05:25.865 user 0m1.220s 00:05:25.865 sys 0m0.088s 00:05:25.865 20:06:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.865 20:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:25.865 ************************************ 00:05:25.865 END TEST thread_poller_perf 00:05:25.865 ************************************ 00:05:25.865 20:06:30 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:25.865 00:05:25.865 real 0m2.825s 00:05:25.865 user 0m2.571s 00:05:25.865 sys 0m0.248s 00:05:25.865 20:06:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.865 20:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:25.865 ************************************ 00:05:25.865 END TEST thread 00:05:25.865 ************************************ 00:05:25.865 20:06:30 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:25.865 20:06:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.865 20:06:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.865 20:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:25.865 ************************************ 00:05:25.865 START TEST accel 00:05:25.865 ************************************ 00:05:25.865 20:06:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:25.865 * Looking for test storage... 00:05:25.865 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:25.865 20:06:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:25.865 20:06:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:25.865 20:06:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:25.865 20:06:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:25.865 20:06:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:25.865 20:06:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:25.865 20:06:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:25.865 20:06:30 -- scripts/common.sh@335 -- # IFS=.-: 00:05:25.865 20:06:30 -- scripts/common.sh@335 -- # read -ra ver1 00:05:25.865 20:06:30 -- scripts/common.sh@336 -- # IFS=.-: 00:05:25.865 20:06:30 -- scripts/common.sh@336 -- # read -ra ver2 00:05:25.865 20:06:30 -- scripts/common.sh@337 -- # local 'op=<' 00:05:25.865 20:06:30 -- scripts/common.sh@339 -- # ver1_l=2 00:05:25.865 20:06:30 -- scripts/common.sh@340 -- # ver2_l=1 00:05:25.865 20:06:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:25.865 20:06:30 -- scripts/common.sh@343 -- # case "$op" in 00:05:25.865 20:06:30 -- scripts/common.sh@344 -- # : 1 00:05:25.865 20:06:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:25.865 20:06:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:25.865 20:06:30 -- scripts/common.sh@364 -- # decimal 1 00:05:25.865 20:06:30 -- scripts/common.sh@352 -- # local d=1 00:05:25.865 20:06:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:25.865 20:06:30 -- scripts/common.sh@354 -- # echo 1 00:05:25.865 20:06:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:25.865 20:06:30 -- scripts/common.sh@365 -- # decimal 2 00:05:25.865 20:06:30 -- scripts/common.sh@352 -- # local d=2 00:05:25.865 20:06:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:25.865 20:06:30 -- scripts/common.sh@354 -- # echo 2 00:05:25.865 20:06:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:25.865 20:06:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:25.865 20:06:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:25.865 20:06:30 -- scripts/common.sh@367 -- # return 0 00:05:25.865 20:06:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:25.865 20:06:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:25.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.865 --rc genhtml_branch_coverage=1 00:05:25.865 --rc genhtml_function_coverage=1 00:05:25.865 --rc genhtml_legend=1 00:05:25.865 --rc geninfo_all_blocks=1 00:05:25.865 --rc geninfo_unexecuted_blocks=1 00:05:25.865 00:05:25.865 ' 00:05:25.865 20:06:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:25.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.865 --rc genhtml_branch_coverage=1 00:05:25.865 --rc genhtml_function_coverage=1 00:05:25.865 --rc genhtml_legend=1 00:05:25.865 --rc geninfo_all_blocks=1 00:05:25.865 --rc geninfo_unexecuted_blocks=1 00:05:25.865 00:05:25.865 ' 00:05:25.865 20:06:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:25.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.865 --rc genhtml_branch_coverage=1 00:05:25.865 --rc genhtml_function_coverage=1 00:05:25.865 --rc genhtml_legend=1 00:05:25.865 --rc geninfo_all_blocks=1 00:05:25.865 --rc geninfo_unexecuted_blocks=1 00:05:25.865 00:05:25.865 ' 00:05:25.865 20:06:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:25.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.865 --rc genhtml_branch_coverage=1 00:05:25.865 --rc genhtml_function_coverage=1 00:05:25.865 --rc genhtml_legend=1 00:05:25.865 --rc geninfo_all_blocks=1 00:05:25.865 --rc geninfo_unexecuted_blocks=1 00:05:25.865 00:05:25.865 ' 00:05:25.865 20:06:30 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:25.865 20:06:30 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:25.865 20:06:30 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:25.865 20:06:30 -- accel/accel.sh@59 -- # spdk_tgt_pid=3045070 00:05:25.865 20:06:30 -- accel/accel.sh@60 -- # waitforlisten 3045070 00:05:25.865 20:06:30 -- common/autotest_common.sh@829 -- # '[' -z 3045070 ']' 00:05:25.865 20:06:30 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:25.865 20:06:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:25.865 20:06:30 -- accel/accel.sh@58 -- # build_accel_config 00:05:25.865 20:06:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.865 20:06:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:25.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:25.865 20:06:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.865 20:06:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.865 20:06:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.865 20:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:25.865 20:06:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.865 20:06:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.865 20:06:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.865 20:06:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.865 20:06:30 -- accel/accel.sh@42 -- # jq -r . 00:05:25.865 [2024-11-20 20:06:30.715210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.865 [2024-11-20 20:06:30.715297] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3045070 ] 00:05:25.865 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.865 [2024-11-20 20:06:30.778244] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.123 [2024-11-20 20:06:30.894473] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.123 [2024-11-20 20:06:30.894629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.687 20:06:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.687 20:06:31 -- common/autotest_common.sh@862 -- # return 0 00:05:26.687 20:06:31 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:26.687 20:06:31 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:26.687 20:06:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.687 20:06:31 -- common/autotest_common.sh@10 -- # set +x 00:05:26.687 20:06:31 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:26.687 20:06:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # IFS== 00:05:26.687 20:06:31 -- accel/accel.sh@64 -- # read -r opc module 00:05:26.687 20:06:31 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:26.687 20:06:31 -- accel/accel.sh@67 -- # killprocess 3045070 00:05:26.687 20:06:31 -- common/autotest_common.sh@936 -- # '[' -z 3045070 ']' 00:05:26.687 20:06:31 -- common/autotest_common.sh@940 -- # kill -0 3045070 00:05:26.687 20:06:31 -- common/autotest_common.sh@941 -- # uname 00:05:26.687 20:06:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:26.687 20:06:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3045070 00:05:26.944 20:06:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:26.944 20:06:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:26.944 20:06:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3045070' 00:05:26.944 killing process with pid 3045070 00:05:26.944 20:06:31 -- common/autotest_common.sh@955 -- # kill 3045070 00:05:26.944 20:06:31 -- common/autotest_common.sh@960 -- # wait 3045070 00:05:27.201 20:06:32 -- accel/accel.sh@68 -- # trap - ERR 00:05:27.201 20:06:32 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:27.201 20:06:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:27.201 20:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.201 20:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:27.201 20:06:32 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:27.201 20:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:27.201 20:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.201 20:06:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.201 20:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.201 20:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.201 20:06:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.201 20:06:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.201 20:06:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.201 20:06:32 -- accel/accel.sh@42 -- # jq -r . 00:05:27.201 20:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.201 20:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:27.201 20:06:32 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:27.201 20:06:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:27.201 20:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.201 20:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:27.201 ************************************ 00:05:27.201 START TEST accel_missing_filename 00:05:27.201 ************************************ 00:05:27.201 20:06:32 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:27.201 20:06:32 -- common/autotest_common.sh@650 -- # local es=0 00:05:27.201 20:06:32 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:27.201 20:06:32 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:27.201 20:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.201 20:06:32 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:27.201 20:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.201 20:06:32 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:27.201 20:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:27.201 20:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.201 20:06:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.201 20:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.201 20:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.201 20:06:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.201 20:06:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.201 20:06:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.201 20:06:32 -- accel/accel.sh@42 -- # jq -r . 00:05:27.458 [2024-11-20 20:06:32.250167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.458 [2024-11-20 20:06:32.250242] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3045351 ] 00:05:27.458 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.458 [2024-11-20 20:06:32.313620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.458 [2024-11-20 20:06:32.429043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.458 [2024-11-20 20:06:32.490983] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:27.715 [2024-11-20 20:06:32.575431] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:27.715 A filename is required. 00:05:27.715 20:06:32 -- common/autotest_common.sh@653 -- # es=234 00:05:27.715 20:06:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.715 20:06:32 -- common/autotest_common.sh@662 -- # es=106 00:05:27.715 20:06:32 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:27.715 20:06:32 -- common/autotest_common.sh@670 -- # es=1 00:05:27.715 20:06:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.715 00:05:27.715 real 0m0.462s 00:05:27.715 user 0m0.344s 00:05:27.715 sys 0m0.150s 00:05:27.715 20:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.715 20:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:27.715 ************************************ 00:05:27.715 END TEST accel_missing_filename 00:05:27.715 ************************************ 00:05:27.715 20:06:32 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:27.715 20:06:32 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:27.715 20:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.715 20:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:27.715 ************************************ 00:05:27.715 START TEST accel_compress_verify 00:05:27.715 ************************************ 00:05:27.715 20:06:32 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:27.715 20:06:32 -- common/autotest_common.sh@650 -- # local es=0 00:05:27.715 20:06:32 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:27.715 20:06:32 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:27.715 20:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.715 20:06:32 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:27.715 20:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.715 20:06:32 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:27.715 20:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:27.715 20:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.715 20:06:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.716 20:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.716 20:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.716 20:06:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.716 20:06:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.716 20:06:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.716 20:06:32 -- accel/accel.sh@42 -- # jq -r . 00:05:27.716 [2024-11-20 20:06:32.741827] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.716 [2024-11-20 20:06:32.741910] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3045377 ] 00:05:27.972 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.972 [2024-11-20 20:06:32.805403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.972 [2024-11-20 20:06:32.920145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.972 [2024-11-20 20:06:32.978531] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:28.231 [2024-11-20 20:06:33.058020] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:28.232 00:05:28.232 Compression does not support the verify option, aborting. 00:05:28.232 20:06:33 -- common/autotest_common.sh@653 -- # es=161 00:05:28.232 20:06:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.232 20:06:33 -- common/autotest_common.sh@662 -- # es=33 00:05:28.232 20:06:33 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:28.232 20:06:33 -- common/autotest_common.sh@670 -- # es=1 00:05:28.232 20:06:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.232 00:05:28.232 real 0m0.455s 00:05:28.232 user 0m0.337s 00:05:28.232 sys 0m0.153s 00:05:28.232 20:06:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.232 20:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.232 ************************************ 00:05:28.232 END TEST accel_compress_verify 00:05:28.232 ************************************ 00:05:28.232 20:06:33 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:28.232 20:06:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:28.232 20:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.232 20:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.232 ************************************ 00:05:28.232 START TEST accel_wrong_workload 00:05:28.232 ************************************ 00:05:28.232 20:06:33 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:28.232 20:06:33 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.232 20:06:33 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:28.232 20:06:33 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:28.232 20:06:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.232 20:06:33 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:28.232 20:06:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.232 20:06:33 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:28.232 20:06:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:28.232 20:06:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.232 20:06:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.232 20:06:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.232 20:06:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.232 20:06:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.232 20:06:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.232 20:06:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.232 20:06:33 -- accel/accel.sh@42 -- # jq -r . 00:05:28.232 Unsupported workload type: foobar 00:05:28.232 [2024-11-20 20:06:33.217901] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:28.232 accel_perf options: 00:05:28.232 [-h help message] 00:05:28.232 [-q queue depth per core] 00:05:28.232 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:28.232 [-T number of threads per core 00:05:28.232 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:28.232 [-t time in seconds] 00:05:28.232 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:28.232 [ dif_verify, , dif_generate, dif_generate_copy 00:05:28.232 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:28.232 [-l for compress/decompress workloads, name of uncompressed input file 00:05:28.232 [-S for crc32c workload, use this seed value (default 0) 00:05:28.232 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:28.232 [-f for fill workload, use this BYTE value (default 255) 00:05:28.232 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:28.232 [-y verify result if this switch is on] 00:05:28.232 [-a tasks to allocate per core (default: same value as -q)] 00:05:28.232 Can be used to spread operations across a wider range of memory. 00:05:28.232 20:06:33 -- common/autotest_common.sh@653 -- # es=1 00:05:28.232 20:06:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.232 20:06:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:28.232 20:06:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.232 00:05:28.232 real 0m0.024s 00:05:28.232 user 0m0.012s 00:05:28.232 sys 0m0.012s 00:05:28.232 20:06:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.232 20:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.232 ************************************ 00:05:28.232 END TEST accel_wrong_workload 00:05:28.232 ************************************ 00:05:28.232 Error: writing output failed: Broken pipe 00:05:28.232 20:06:33 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:28.232 20:06:33 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:28.232 20:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.232 20:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.232 ************************************ 00:05:28.232 START TEST accel_negative_buffers 00:05:28.232 ************************************ 00:05:28.232 20:06:33 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:28.232 20:06:33 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.232 20:06:33 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:28.232 20:06:33 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:28.232 20:06:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.232 20:06:33 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:28.232 20:06:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.232 20:06:33 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:28.232 20:06:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:28.232 20:06:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.232 20:06:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.232 20:06:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.232 20:06:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.232 20:06:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.232 20:06:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.232 20:06:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.232 20:06:33 -- accel/accel.sh@42 -- # jq -r . 00:05:28.232 -x option must be non-negative. 00:05:28.232 [2024-11-20 20:06:33.266180] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:28.491 accel_perf options: 00:05:28.491 [-h help message] 00:05:28.491 [-q queue depth per core] 00:05:28.491 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:28.491 [-T number of threads per core 00:05:28.491 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:28.491 [-t time in seconds] 00:05:28.491 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:28.491 [ dif_verify, , dif_generate, dif_generate_copy 00:05:28.491 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:28.491 [-l for compress/decompress workloads, name of uncompressed input file 00:05:28.491 [-S for crc32c workload, use this seed value (default 0) 00:05:28.491 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:28.491 [-f for fill workload, use this BYTE value (default 255) 00:05:28.491 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:28.491 [-y verify result if this switch is on] 00:05:28.491 [-a tasks to allocate per core (default: same value as -q)] 00:05:28.491 Can be used to spread operations across a wider range of memory. 00:05:28.491 20:06:33 -- common/autotest_common.sh@653 -- # es=1 00:05:28.491 20:06:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.491 20:06:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:28.491 20:06:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.491 00:05:28.491 real 0m0.025s 00:05:28.491 user 0m0.014s 00:05:28.491 sys 0m0.010s 00:05:28.491 20:06:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.491 20:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.491 ************************************ 00:05:28.492 END TEST accel_negative_buffers 00:05:28.492 ************************************ 00:05:28.492 Error: writing output failed: Broken pipe 00:05:28.492 20:06:33 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:28.492 20:06:33 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:28.492 20:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.492 20:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.492 ************************************ 00:05:28.492 START TEST accel_crc32c 00:05:28.492 ************************************ 00:05:28.492 20:06:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:28.492 20:06:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.492 20:06:33 -- accel/accel.sh@17 -- # local accel_module 00:05:28.492 20:06:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:28.492 20:06:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:28.492 20:06:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.492 20:06:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.492 20:06:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.492 20:06:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.492 20:06:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.492 20:06:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.492 20:06:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.492 20:06:33 -- accel/accel.sh@42 -- # jq -r . 00:05:28.492 [2024-11-20 20:06:33.313181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.492 [2024-11-20 20:06:33.313249] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3045554 ] 00:05:28.492 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.492 [2024-11-20 20:06:33.378638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.492 [2024-11-20 20:06:33.493686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.866 20:06:34 -- accel/accel.sh@18 -- # out=' 00:05:29.866 SPDK Configuration: 00:05:29.866 Core mask: 0x1 00:05:29.866 00:05:29.866 Accel Perf Configuration: 00:05:29.866 Workload Type: crc32c 00:05:29.866 CRC-32C seed: 32 00:05:29.866 Transfer size: 4096 bytes 00:05:29.866 Vector count 1 00:05:29.866 Module: software 00:05:29.866 Queue depth: 32 00:05:29.866 Allocate depth: 32 00:05:29.866 # threads/core: 1 00:05:29.866 Run time: 1 seconds 00:05:29.866 Verify: Yes 00:05:29.866 00:05:29.866 Running for 1 seconds... 00:05:29.866 00:05:29.866 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:29.866 ------------------------------------------------------------------------------------ 00:05:29.866 0,0 408352/s 1595 MiB/s 0 0 00:05:29.866 ==================================================================================== 00:05:29.866 Total 408352/s 1595 MiB/s 0 0' 00:05:29.866 20:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:29.866 20:06:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:29.866 20:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:29.866 20:06:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:29.866 20:06:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.866 20:06:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.866 20:06:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.866 20:06:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.866 20:06:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.866 20:06:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.866 20:06:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.866 20:06:34 -- accel/accel.sh@42 -- # jq -r . 00:05:29.866 [2024-11-20 20:06:34.782729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.866 [2024-11-20 20:06:34.782822] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3045705 ] 00:05:29.866 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.866 [2024-11-20 20:06:34.845127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.125 [2024-11-20 20:06:34.961580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=0x1 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=crc32c 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=32 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=software 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=32 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=32 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=1 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val=Yes 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:30.125 20:06:35 -- accel/accel.sh@21 -- # val= 00:05:30.125 20:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:30.125 20:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@21 -- # val= 00:05:31.496 20:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@21 -- # val= 00:05:31.496 20:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@21 -- # val= 00:05:31.496 20:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@21 -- # val= 00:05:31.496 20:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@21 -- # val= 00:05:31.496 20:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@21 -- # val= 00:05:31.496 20:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:31.496 20:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:31.496 20:06:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.496 20:06:36 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:31.496 20:06:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.496 00:05:31.496 real 0m2.944s 00:05:31.496 user 0m2.648s 00:05:31.496 sys 0m0.288s 00:05:31.496 20:06:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.496 20:06:36 -- common/autotest_common.sh@10 -- # set +x 00:05:31.496 ************************************ 00:05:31.496 END TEST accel_crc32c 00:05:31.496 ************************************ 00:05:31.496 20:06:36 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:31.496 20:06:36 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:31.496 20:06:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.496 20:06:36 -- common/autotest_common.sh@10 -- # set +x 00:05:31.496 ************************************ 00:05:31.496 START TEST accel_crc32c_C2 00:05:31.496 ************************************ 00:05:31.496 20:06:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:31.496 20:06:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.496 20:06:36 -- accel/accel.sh@17 -- # local accel_module 00:05:31.496 20:06:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:31.496 20:06:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:31.496 20:06:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.496 20:06:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.496 20:06:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.496 20:06:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.496 20:06:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.496 20:06:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.496 20:06:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.496 20:06:36 -- accel/accel.sh@42 -- # jq -r . 00:05:31.496 [2024-11-20 20:06:36.282755] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.496 [2024-11-20 20:06:36.282841] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3045858 ] 00:05:31.496 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.496 [2024-11-20 20:06:36.344319] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.496 [2024-11-20 20:06:36.461250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.870 20:06:37 -- accel/accel.sh@18 -- # out=' 00:05:32.870 SPDK Configuration: 00:05:32.870 Core mask: 0x1 00:05:32.870 00:05:32.870 Accel Perf Configuration: 00:05:32.870 Workload Type: crc32c 00:05:32.870 CRC-32C seed: 0 00:05:32.870 Transfer size: 4096 bytes 00:05:32.870 Vector count 2 00:05:32.870 Module: software 00:05:32.870 Queue depth: 32 00:05:32.870 Allocate depth: 32 00:05:32.870 # threads/core: 1 00:05:32.870 Run time: 1 seconds 00:05:32.870 Verify: Yes 00:05:32.870 00:05:32.870 Running for 1 seconds... 00:05:32.870 00:05:32.870 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:32.870 ------------------------------------------------------------------------------------ 00:05:32.870 0,0 315808/s 2467 MiB/s 0 0 00:05:32.870 ==================================================================================== 00:05:32.870 Total 315808/s 1233 MiB/s 0 0' 00:05:32.870 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:32.870 20:06:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:32.870 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:32.870 20:06:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:32.870 20:06:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.870 20:06:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.870 20:06:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.870 20:06:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.870 20:06:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.871 20:06:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.871 20:06:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.871 20:06:37 -- accel/accel.sh@42 -- # jq -r . 00:05:32.871 [2024-11-20 20:06:37.748247] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.871 [2024-11-20 20:06:37.748339] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3046120 ] 00:05:32.871 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.871 [2024-11-20 20:06:37.809476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.129 [2024-11-20 20:06:37.925766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=0x1 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=crc32c 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=0 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=software 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=32 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=32 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=1 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val=Yes 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:33.129 20:06:37 -- accel/accel.sh@21 -- # val= 00:05:33.129 20:06:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # IFS=: 00:05:33.129 20:06:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@21 -- # val= 00:05:34.503 20:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@21 -- # val= 00:05:34.503 20:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@21 -- # val= 00:05:34.503 20:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@21 -- # val= 00:05:34.503 20:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@21 -- # val= 00:05:34.503 20:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@21 -- # val= 00:05:34.503 20:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:34.503 20:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:34.503 20:06:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.503 20:06:39 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:34.503 20:06:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.503 00:05:34.503 real 0m2.928s 00:05:34.503 user 0m2.632s 00:05:34.503 sys 0m0.288s 00:05:34.503 20:06:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.503 20:06:39 -- common/autotest_common.sh@10 -- # set +x 00:05:34.503 ************************************ 00:05:34.503 END TEST accel_crc32c_C2 00:05:34.503 ************************************ 00:05:34.503 20:06:39 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:34.503 20:06:39 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:34.503 20:06:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.503 20:06:39 -- common/autotest_common.sh@10 -- # set +x 00:05:34.503 ************************************ 00:05:34.503 START TEST accel_copy 00:05:34.503 ************************************ 00:05:34.503 20:06:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:34.503 20:06:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.503 20:06:39 -- accel/accel.sh@17 -- # local accel_module 00:05:34.503 20:06:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:34.503 20:06:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:34.503 20:06:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.503 20:06:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.503 20:06:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.503 20:06:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.503 20:06:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.503 20:06:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.503 20:06:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.503 20:06:39 -- accel/accel.sh@42 -- # jq -r . 00:05:34.503 [2024-11-20 20:06:39.236496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.503 [2024-11-20 20:06:39.236585] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3046286 ] 00:05:34.503 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.503 [2024-11-20 20:06:39.298186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.503 [2024-11-20 20:06:39.414580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.876 20:06:40 -- accel/accel.sh@18 -- # out=' 00:05:35.876 SPDK Configuration: 00:05:35.876 Core mask: 0x1 00:05:35.876 00:05:35.876 Accel Perf Configuration: 00:05:35.876 Workload Type: copy 00:05:35.876 Transfer size: 4096 bytes 00:05:35.876 Vector count 1 00:05:35.876 Module: software 00:05:35.876 Queue depth: 32 00:05:35.876 Allocate depth: 32 00:05:35.876 # threads/core: 1 00:05:35.876 Run time: 1 seconds 00:05:35.876 Verify: Yes 00:05:35.876 00:05:35.876 Running for 1 seconds... 00:05:35.876 00:05:35.876 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:35.876 ------------------------------------------------------------------------------------ 00:05:35.876 0,0 277696/s 1084 MiB/s 0 0 00:05:35.876 ==================================================================================== 00:05:35.876 Total 277696/s 1084 MiB/s 0 0' 00:05:35.876 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:35.876 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:35.876 20:06:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:35.876 20:06:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:35.876 20:06:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.876 20:06:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.876 20:06:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.876 20:06:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.876 20:06:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.876 20:06:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.876 20:06:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.876 20:06:40 -- accel/accel.sh@42 -- # jq -r . 00:05:35.876 [2024-11-20 20:06:40.707561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.876 [2024-11-20 20:06:40.707652] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3046426 ] 00:05:35.876 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.876 [2024-11-20 20:06:40.772401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.876 [2024-11-20 20:06:40.887168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=0x1 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=copy 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=software 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=32 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=32 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=1 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val=Yes 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:36.135 20:06:40 -- accel/accel.sh@21 -- # val= 00:05:36.135 20:06:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # IFS=: 00:05:36.135 20:06:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@21 -- # val= 00:05:37.509 20:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@21 -- # val= 00:05:37.509 20:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@21 -- # val= 00:05:37.509 20:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@21 -- # val= 00:05:37.509 20:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@21 -- # val= 00:05:37.509 20:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@21 -- # val= 00:05:37.509 20:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:37.509 20:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:37.509 20:06:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.509 20:06:42 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:37.509 20:06:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.509 00:05:37.509 real 0m2.936s 00:05:37.509 user 0m2.641s 00:05:37.509 sys 0m0.285s 00:05:37.509 20:06:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.509 20:06:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.509 ************************************ 00:05:37.509 END TEST accel_copy 00:05:37.509 ************************************ 00:05:37.509 20:06:42 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.509 20:06:42 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:37.509 20:06:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.509 20:06:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.509 ************************************ 00:05:37.509 START TEST accel_fill 00:05:37.509 ************************************ 00:05:37.509 20:06:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.509 20:06:42 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.509 20:06:42 -- accel/accel.sh@17 -- # local accel_module 00:05:37.509 20:06:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.509 20:06:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.509 20:06:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.509 20:06:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.509 20:06:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.509 20:06:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.509 20:06:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.509 20:06:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.509 20:06:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.509 20:06:42 -- accel/accel.sh@42 -- # jq -r . 00:05:37.509 [2024-11-20 20:06:42.194376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.509 [2024-11-20 20:06:42.194474] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3046704 ] 00:05:37.509 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.509 [2024-11-20 20:06:42.257696] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.509 [2024-11-20 20:06:42.374188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.882 20:06:43 -- accel/accel.sh@18 -- # out=' 00:05:38.882 SPDK Configuration: 00:05:38.882 Core mask: 0x1 00:05:38.882 00:05:38.882 Accel Perf Configuration: 00:05:38.882 Workload Type: fill 00:05:38.882 Fill pattern: 0x80 00:05:38.882 Transfer size: 4096 bytes 00:05:38.882 Vector count 1 00:05:38.882 Module: software 00:05:38.882 Queue depth: 64 00:05:38.882 Allocate depth: 64 00:05:38.882 # threads/core: 1 00:05:38.882 Run time: 1 seconds 00:05:38.882 Verify: Yes 00:05:38.882 00:05:38.882 Running for 1 seconds... 00:05:38.882 00:05:38.882 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.882 ------------------------------------------------------------------------------------ 00:05:38.882 0,0 404224/s 1579 MiB/s 0 0 00:05:38.882 ==================================================================================== 00:05:38.882 Total 404224/s 1579 MiB/s 0 0' 00:05:38.882 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.882 20:06:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:38.882 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.882 20:06:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:38.882 20:06:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.882 20:06:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.882 20:06:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.882 20:06:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.882 20:06:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.882 20:06:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.882 20:06:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.882 20:06:43 -- accel/accel.sh@42 -- # jq -r . 00:05:38.882 [2024-11-20 20:06:43.649375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.882 [2024-11-20 20:06:43.649463] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3046853 ] 00:05:38.882 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.882 [2024-11-20 20:06:43.710841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.882 [2024-11-20 20:06:43.827007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.882 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=0x1 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=fill 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=0x80 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=software 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=64 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=64 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=1 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val=Yes 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:38.883 20:06:43 -- accel/accel.sh@21 -- # val= 00:05:38.883 20:06:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # IFS=: 00:05:38.883 20:06:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@21 -- # val= 00:05:40.256 20:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@21 -- # val= 00:05:40.256 20:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@21 -- # val= 00:05:40.256 20:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@21 -- # val= 00:05:40.256 20:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@21 -- # val= 00:05:40.256 20:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@21 -- # val= 00:05:40.256 20:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:40.256 20:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:40.256 20:06:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.256 20:06:45 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:40.256 20:06:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.256 00:05:40.256 real 0m2.932s 00:05:40.256 user 0m2.632s 00:05:40.256 sys 0m0.292s 00:05:40.256 20:06:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.256 20:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:40.256 ************************************ 00:05:40.256 END TEST accel_fill 00:05:40.256 ************************************ 00:05:40.256 20:06:45 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:40.256 20:06:45 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:40.256 20:06:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.256 20:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:40.256 ************************************ 00:05:40.256 START TEST accel_copy_crc32c 00:05:40.256 ************************************ 00:05:40.256 20:06:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:40.256 20:06:45 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.256 20:06:45 -- accel/accel.sh@17 -- # local accel_module 00:05:40.256 20:06:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:40.256 20:06:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:40.256 20:06:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.256 20:06:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.256 20:06:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.256 20:06:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.256 20:06:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.256 20:06:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.256 20:06:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.256 20:06:45 -- accel/accel.sh@42 -- # jq -r . 00:05:40.256 [2024-11-20 20:06:45.150199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.256 [2024-11-20 20:06:45.150282] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3047013 ] 00:05:40.256 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.256 [2024-11-20 20:06:45.210988] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.516 [2024-11-20 20:06:45.328329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.892 20:06:46 -- accel/accel.sh@18 -- # out=' 00:05:41.892 SPDK Configuration: 00:05:41.892 Core mask: 0x1 00:05:41.892 00:05:41.892 Accel Perf Configuration: 00:05:41.892 Workload Type: copy_crc32c 00:05:41.892 CRC-32C seed: 0 00:05:41.892 Vector size: 4096 bytes 00:05:41.892 Transfer size: 4096 bytes 00:05:41.892 Vector count 1 00:05:41.892 Module: software 00:05:41.892 Queue depth: 32 00:05:41.892 Allocate depth: 32 00:05:41.892 # threads/core: 1 00:05:41.892 Run time: 1 seconds 00:05:41.892 Verify: Yes 00:05:41.892 00:05:41.892 Running for 1 seconds... 00:05:41.892 00:05:41.892 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.892 ------------------------------------------------------------------------------------ 00:05:41.892 0,0 217216/s 848 MiB/s 0 0 00:05:41.892 ==================================================================================== 00:05:41.892 Total 217216/s 848 MiB/s 0 0' 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:41.892 20:06:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.892 20:06:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.892 20:06:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.892 20:06:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.892 20:06:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.892 20:06:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.892 20:06:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.892 20:06:46 -- accel/accel.sh@42 -- # jq -r . 00:05:41.892 [2024-11-20 20:06:46.627165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.892 [2024-11-20 20:06:46.627255] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3047214 ] 00:05:41.892 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.892 [2024-11-20 20:06:46.690381] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.892 [2024-11-20 20:06:46.810703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=0x1 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=0 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=software 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=32 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=32 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=1 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val=Yes 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:41.892 20:06:46 -- accel/accel.sh@21 -- # val= 00:05:41.892 20:06:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # IFS=: 00:05:41.892 20:06:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@21 -- # val= 00:05:43.267 20:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@21 -- # val= 00:05:43.267 20:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@21 -- # val= 00:05:43.267 20:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@21 -- # val= 00:05:43.267 20:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@21 -- # val= 00:05:43.267 20:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@21 -- # val= 00:05:43.267 20:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:43.267 20:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:43.267 20:06:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.267 20:06:48 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:43.267 20:06:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.267 00:05:43.267 real 0m2.960s 00:05:43.267 user 0m2.662s 00:05:43.267 sys 0m0.288s 00:05:43.267 20:06:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.267 20:06:48 -- common/autotest_common.sh@10 -- # set +x 00:05:43.267 ************************************ 00:05:43.267 END TEST accel_copy_crc32c 00:05:43.267 ************************************ 00:05:43.267 20:06:48 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:43.267 20:06:48 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:43.267 20:06:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.267 20:06:48 -- common/autotest_common.sh@10 -- # set +x 00:05:43.267 ************************************ 00:05:43.267 START TEST accel_copy_crc32c_C2 00:05:43.267 ************************************ 00:05:43.267 20:06:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:43.267 20:06:48 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.267 20:06:48 -- accel/accel.sh@17 -- # local accel_module 00:05:43.267 20:06:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:43.267 20:06:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:43.267 20:06:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.267 20:06:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.267 20:06:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.267 20:06:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.267 20:06:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.267 20:06:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.267 20:06:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.267 20:06:48 -- accel/accel.sh@42 -- # jq -r . 00:05:43.267 [2024-11-20 20:06:48.134245] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.267 [2024-11-20 20:06:48.134331] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3047439 ] 00:05:43.267 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.267 [2024-11-20 20:06:48.196495] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.525 [2024-11-20 20:06:48.315926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.899 20:06:49 -- accel/accel.sh@18 -- # out=' 00:05:44.899 SPDK Configuration: 00:05:44.899 Core mask: 0x1 00:05:44.899 00:05:44.899 Accel Perf Configuration: 00:05:44.899 Workload Type: copy_crc32c 00:05:44.899 CRC-32C seed: 0 00:05:44.899 Vector size: 4096 bytes 00:05:44.899 Transfer size: 8192 bytes 00:05:44.899 Vector count 2 00:05:44.899 Module: software 00:05:44.899 Queue depth: 32 00:05:44.899 Allocate depth: 32 00:05:44.899 # threads/core: 1 00:05:44.899 Run time: 1 seconds 00:05:44.899 Verify: Yes 00:05:44.899 00:05:44.899 Running for 1 seconds... 00:05:44.899 00:05:44.899 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.899 ------------------------------------------------------------------------------------ 00:05:44.899 0,0 154912/s 1210 MiB/s 0 0 00:05:44.899 ==================================================================================== 00:05:44.899 Total 154912/s 605 MiB/s 0 0' 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:44.899 20:06:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.899 20:06:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.899 20:06:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.899 20:06:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.899 20:06:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.899 20:06:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.899 20:06:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.899 20:06:49 -- accel/accel.sh@42 -- # jq -r . 00:05:44.899 [2024-11-20 20:06:49.618697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.899 [2024-11-20 20:06:49.618782] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3047581 ] 00:05:44.899 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.899 [2024-11-20 20:06:49.685224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.899 [2024-11-20 20:06:49.804800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val=0x1 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val=0 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.899 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.899 20:06:49 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:44.899 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val=software 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val=32 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val=32 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val=1 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val=Yes 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:44.900 20:06:49 -- accel/accel.sh@21 -- # val= 00:05:44.900 20:06:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # IFS=: 00:05:44.900 20:06:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@21 -- # val= 00:05:46.275 20:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@21 -- # val= 00:05:46.275 20:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@21 -- # val= 00:05:46.275 20:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@21 -- # val= 00:05:46.275 20:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@21 -- # val= 00:05:46.275 20:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@21 -- # val= 00:05:46.275 20:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:46.275 20:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:46.275 20:06:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.275 20:06:51 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:46.275 20:06:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.275 00:05:46.275 real 0m2.974s 00:05:46.275 user 0m2.678s 00:05:46.275 sys 0m0.294s 00:05:46.275 20:06:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.275 20:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:46.275 ************************************ 00:05:46.275 END TEST accel_copy_crc32c_C2 00:05:46.275 ************************************ 00:05:46.275 20:06:51 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:46.275 20:06:51 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:46.275 20:06:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.275 20:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:46.275 ************************************ 00:05:46.275 START TEST accel_dualcast 00:05:46.275 ************************************ 00:05:46.275 20:06:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:46.275 20:06:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.275 20:06:51 -- accel/accel.sh@17 -- # local accel_module 00:05:46.275 20:06:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:46.275 20:06:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:46.275 20:06:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.275 20:06:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.275 20:06:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.275 20:06:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.275 20:06:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.275 20:06:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.275 20:06:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.275 20:06:51 -- accel/accel.sh@42 -- # jq -r . 00:05:46.275 [2024-11-20 20:06:51.132903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.275 [2024-11-20 20:06:51.132990] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3047757 ] 00:05:46.275 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.275 [2024-11-20 20:06:51.195899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.534 [2024-11-20 20:06:51.317159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.909 20:06:52 -- accel/accel.sh@18 -- # out=' 00:05:47.909 SPDK Configuration: 00:05:47.909 Core mask: 0x1 00:05:47.909 00:05:47.909 Accel Perf Configuration: 00:05:47.909 Workload Type: dualcast 00:05:47.909 Transfer size: 4096 bytes 00:05:47.909 Vector count 1 00:05:47.909 Module: software 00:05:47.910 Queue depth: 32 00:05:47.910 Allocate depth: 32 00:05:47.910 # threads/core: 1 00:05:47.910 Run time: 1 seconds 00:05:47.910 Verify: Yes 00:05:47.910 00:05:47.910 Running for 1 seconds... 00:05:47.910 00:05:47.910 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.910 ------------------------------------------------------------------------------------ 00:05:47.910 0,0 298848/s 1167 MiB/s 0 0 00:05:47.910 ==================================================================================== 00:05:47.910 Total 298848/s 1167 MiB/s 0 0' 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:47.910 20:06:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:47.910 20:06:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.910 20:06:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.910 20:06:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.910 20:06:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.910 20:06:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.910 20:06:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.910 20:06:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.910 20:06:52 -- accel/accel.sh@42 -- # jq -r . 00:05:47.910 [2024-11-20 20:06:52.622098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.910 [2024-11-20 20:06:52.622179] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3048000 ] 00:05:47.910 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.910 [2024-11-20 20:06:52.685915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.910 [2024-11-20 20:06:52.803933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=0x1 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=dualcast 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=software 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=32 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=32 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=1 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val=Yes 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:47.910 20:06:52 -- accel/accel.sh@21 -- # val= 00:05:47.910 20:06:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # IFS=: 00:05:47.910 20:06:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@21 -- # val= 00:05:49.283 20:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@21 -- # val= 00:05:49.283 20:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@21 -- # val= 00:05:49.283 20:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@21 -- # val= 00:05:49.283 20:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@21 -- # val= 00:05:49.283 20:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@21 -- # val= 00:05:49.283 20:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:49.283 20:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:49.283 20:06:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.283 20:06:54 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:49.283 20:06:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.283 00:05:49.283 real 0m2.976s 00:05:49.283 user 0m2.687s 00:05:49.283 sys 0m0.285s 00:05:49.283 20:06:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.283 20:06:54 -- common/autotest_common.sh@10 -- # set +x 00:05:49.283 ************************************ 00:05:49.283 END TEST accel_dualcast 00:05:49.283 ************************************ 00:05:49.283 20:06:54 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:49.283 20:06:54 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:49.283 20:06:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.283 20:06:54 -- common/autotest_common.sh@10 -- # set +x 00:05:49.283 ************************************ 00:05:49.283 START TEST accel_compare 00:05:49.283 ************************************ 00:05:49.283 20:06:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:49.283 20:06:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.283 20:06:54 -- accel/accel.sh@17 -- # local accel_module 00:05:49.283 20:06:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:49.283 20:06:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:49.283 20:06:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.283 20:06:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.283 20:06:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.283 20:06:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.283 20:06:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.283 20:06:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.283 20:06:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.283 20:06:54 -- accel/accel.sh@42 -- # jq -r . 00:05:49.283 [2024-11-20 20:06:54.130853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.283 [2024-11-20 20:06:54.130943] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3048168 ] 00:05:49.283 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.283 [2024-11-20 20:06:54.196318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.284 [2024-11-20 20:06:54.316556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.656 20:06:55 -- accel/accel.sh@18 -- # out=' 00:05:50.656 SPDK Configuration: 00:05:50.656 Core mask: 0x1 00:05:50.656 00:05:50.656 Accel Perf Configuration: 00:05:50.656 Workload Type: compare 00:05:50.656 Transfer size: 4096 bytes 00:05:50.656 Vector count 1 00:05:50.656 Module: software 00:05:50.656 Queue depth: 32 00:05:50.656 Allocate depth: 32 00:05:50.656 # threads/core: 1 00:05:50.656 Run time: 1 seconds 00:05:50.656 Verify: Yes 00:05:50.656 00:05:50.656 Running for 1 seconds... 00:05:50.656 00:05:50.656 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.656 ------------------------------------------------------------------------------------ 00:05:50.656 0,0 398560/s 1556 MiB/s 0 0 00:05:50.656 ==================================================================================== 00:05:50.656 Total 398560/s 1556 MiB/s 0 0' 00:05:50.656 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.656 20:06:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:50.656 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.656 20:06:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:50.656 20:06:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.656 20:06:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.656 20:06:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.656 20:06:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.656 20:06:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.656 20:06:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.656 20:06:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.656 20:06:55 -- accel/accel.sh@42 -- # jq -r . 00:05:50.656 [2024-11-20 20:06:55.620310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.656 [2024-11-20 20:06:55.620407] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3048308 ] 00:05:50.656 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.656 [2024-11-20 20:06:55.682683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.915 [2024-11-20 20:06:55.803822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val=0x1 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val=compare 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val=software 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val=32 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val=32 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val=1 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.915 20:06:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.915 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.915 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.916 20:06:55 -- accel/accel.sh@21 -- # val=Yes 00:05:50.916 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.916 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.916 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.916 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.916 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.916 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.916 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:50.916 20:06:55 -- accel/accel.sh@21 -- # val= 00:05:50.916 20:06:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.916 20:06:55 -- accel/accel.sh@20 -- # IFS=: 00:05:50.916 20:06:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@21 -- # val= 00:05:52.289 20:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@21 -- # val= 00:05:52.289 20:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@21 -- # val= 00:05:52.289 20:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@21 -- # val= 00:05:52.289 20:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@21 -- # val= 00:05:52.289 20:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@21 -- # val= 00:05:52.289 20:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:52.289 20:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:52.289 20:06:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.289 20:06:57 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:52.289 20:06:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.289 00:05:52.289 real 0m2.975s 00:05:52.289 user 0m2.686s 00:05:52.289 sys 0m0.286s 00:05:52.289 20:06:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.289 20:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:52.289 ************************************ 00:05:52.289 END TEST accel_compare 00:05:52.289 ************************************ 00:05:52.289 20:06:57 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:52.289 20:06:57 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:52.289 20:06:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.289 20:06:57 -- common/autotest_common.sh@10 -- # set +x 00:05:52.289 ************************************ 00:05:52.289 START TEST accel_xor 00:05:52.289 ************************************ 00:05:52.289 20:06:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:52.289 20:06:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.289 20:06:57 -- accel/accel.sh@17 -- # local accel_module 00:05:52.289 20:06:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:52.289 20:06:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:52.289 20:06:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.289 20:06:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.289 20:06:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.289 20:06:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.289 20:06:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.289 20:06:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.289 20:06:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.289 20:06:57 -- accel/accel.sh@42 -- # jq -r . 00:05:52.289 [2024-11-20 20:06:57.129484] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.289 [2024-11-20 20:06:57.129573] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3048586 ] 00:05:52.289 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.289 [2024-11-20 20:06:57.190433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.289 [2024-11-20 20:06:57.308388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.661 20:06:58 -- accel/accel.sh@18 -- # out=' 00:05:53.661 SPDK Configuration: 00:05:53.661 Core mask: 0x1 00:05:53.661 00:05:53.661 Accel Perf Configuration: 00:05:53.661 Workload Type: xor 00:05:53.661 Source buffers: 2 00:05:53.661 Transfer size: 4096 bytes 00:05:53.661 Vector count 1 00:05:53.661 Module: software 00:05:53.661 Queue depth: 32 00:05:53.661 Allocate depth: 32 00:05:53.661 # threads/core: 1 00:05:53.661 Run time: 1 seconds 00:05:53.661 Verify: Yes 00:05:53.661 00:05:53.661 Running for 1 seconds... 00:05:53.661 00:05:53.661 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.661 ------------------------------------------------------------------------------------ 00:05:53.661 0,0 191808/s 749 MiB/s 0 0 00:05:53.661 ==================================================================================== 00:05:53.661 Total 191808/s 749 MiB/s 0 0' 00:05:53.661 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.661 20:06:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:53.661 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.661 20:06:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:53.661 20:06:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.661 20:06:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.661 20:06:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.661 20:06:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.661 20:06:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.661 20:06:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.661 20:06:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.661 20:06:58 -- accel/accel.sh@42 -- # jq -r . 00:05:53.661 [2024-11-20 20:06:58.592234] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.661 [2024-11-20 20:06:58.592325] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3048736 ] 00:05:53.661 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.661 [2024-11-20 20:06:58.652949] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.919 [2024-11-20 20:06:58.773191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val=0x1 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val=xor 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val=2 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.919 20:06:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.919 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.919 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val=software 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val=32 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val=32 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val=1 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val=Yes 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:53.920 20:06:58 -- accel/accel.sh@21 -- # val= 00:05:53.920 20:06:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # IFS=: 00:05:53.920 20:06:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@21 -- # val= 00:05:55.293 20:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # IFS=: 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@21 -- # val= 00:05:55.293 20:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # IFS=: 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@21 -- # val= 00:05:55.293 20:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # IFS=: 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@21 -- # val= 00:05:55.293 20:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # IFS=: 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@21 -- # val= 00:05:55.293 20:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # IFS=: 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@21 -- # val= 00:05:55.293 20:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # IFS=: 00:05:55.293 20:07:00 -- accel/accel.sh@20 -- # read -r var val 00:05:55.293 20:07:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.293 20:07:00 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:55.293 20:07:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.293 00:05:55.293 real 0m2.949s 00:05:55.293 user 0m2.662s 00:05:55.293 sys 0m0.285s 00:05:55.293 20:07:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.293 20:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:55.293 ************************************ 00:05:55.293 END TEST accel_xor 00:05:55.293 ************************************ 00:05:55.293 20:07:00 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:55.293 20:07:00 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:55.293 20:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.293 20:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:55.293 ************************************ 00:05:55.293 START TEST accel_xor 00:05:55.293 ************************************ 00:05:55.293 20:07:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:55.293 20:07:00 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.293 20:07:00 -- accel/accel.sh@17 -- # local accel_module 00:05:55.293 20:07:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:55.293 20:07:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:55.293 20:07:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.293 20:07:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.293 20:07:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.293 20:07:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.293 20:07:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.293 20:07:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.293 20:07:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.293 20:07:00 -- accel/accel.sh@42 -- # jq -r . 00:05:55.293 [2024-11-20 20:07:00.102270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.293 [2024-11-20 20:07:00.102361] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3048895 ] 00:05:55.293 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.293 [2024-11-20 20:07:00.165099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.293 [2024-11-20 20:07:00.283723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.666 20:07:01 -- accel/accel.sh@18 -- # out=' 00:05:56.666 SPDK Configuration: 00:05:56.666 Core mask: 0x1 00:05:56.666 00:05:56.666 Accel Perf Configuration: 00:05:56.666 Workload Type: xor 00:05:56.666 Source buffers: 3 00:05:56.666 Transfer size: 4096 bytes 00:05:56.666 Vector count 1 00:05:56.666 Module: software 00:05:56.666 Queue depth: 32 00:05:56.666 Allocate depth: 32 00:05:56.666 # threads/core: 1 00:05:56.666 Run time: 1 seconds 00:05:56.666 Verify: Yes 00:05:56.666 00:05:56.666 Running for 1 seconds... 00:05:56.666 00:05:56.666 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.666 ------------------------------------------------------------------------------------ 00:05:56.666 0,0 182112/s 711 MiB/s 0 0 00:05:56.666 ==================================================================================== 00:05:56.666 Total 182112/s 711 MiB/s 0 0' 00:05:56.666 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.666 20:07:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:56.666 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.666 20:07:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:56.666 20:07:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.666 20:07:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.666 20:07:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.666 20:07:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.666 20:07:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.666 20:07:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.666 20:07:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.667 20:07:01 -- accel/accel.sh@42 -- # jq -r . 00:05:56.667 [2024-11-20 20:07:01.578098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.667 [2024-11-20 20:07:01.578188] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3049154 ] 00:05:56.667 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.667 [2024-11-20 20:07:01.641154] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.925 [2024-11-20 20:07:01.761320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.925 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.925 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.925 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.925 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.925 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.925 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.925 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.925 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.925 20:07:01 -- accel/accel.sh@21 -- # val=0x1 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=xor 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=3 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=software 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=32 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=32 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=1 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val=Yes 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:56.926 20:07:01 -- accel/accel.sh@21 -- # val= 00:05:56.926 20:07:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # IFS=: 00:05:56.926 20:07:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@21 -- # val= 00:05:58.302 20:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # IFS=: 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@21 -- # val= 00:05:58.302 20:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # IFS=: 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@21 -- # val= 00:05:58.302 20:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # IFS=: 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@21 -- # val= 00:05:58.302 20:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # IFS=: 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@21 -- # val= 00:05:58.302 20:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # IFS=: 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@21 -- # val= 00:05:58.302 20:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # IFS=: 00:05:58.302 20:07:03 -- accel/accel.sh@20 -- # read -r var val 00:05:58.302 20:07:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.302 20:07:03 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:58.302 20:07:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.302 00:05:58.302 real 0m2.955s 00:05:58.302 user 0m2.660s 00:05:58.302 sys 0m0.293s 00:05:58.302 20:07:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.302 20:07:03 -- common/autotest_common.sh@10 -- # set +x 00:05:58.302 ************************************ 00:05:58.302 END TEST accel_xor 00:05:58.302 ************************************ 00:05:58.302 20:07:03 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:58.302 20:07:03 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:58.302 20:07:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.302 20:07:03 -- common/autotest_common.sh@10 -- # set +x 00:05:58.302 ************************************ 00:05:58.302 START TEST accel_dif_verify 00:05:58.302 ************************************ 00:05:58.302 20:07:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:58.302 20:07:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.302 20:07:03 -- accel/accel.sh@17 -- # local accel_module 00:05:58.302 20:07:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:58.302 20:07:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:58.302 20:07:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.302 20:07:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.302 20:07:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.302 20:07:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.302 20:07:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.302 20:07:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.302 20:07:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.302 20:07:03 -- accel/accel.sh@42 -- # jq -r . 00:05:58.302 [2024-11-20 20:07:03.084538] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.302 [2024-11-20 20:07:03.084620] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3049316 ] 00:05:58.302 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.302 [2024-11-20 20:07:03.148515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.302 [2024-11-20 20:07:03.268604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.794 20:07:04 -- accel/accel.sh@18 -- # out=' 00:05:59.794 SPDK Configuration: 00:05:59.794 Core mask: 0x1 00:05:59.794 00:05:59.794 Accel Perf Configuration: 00:05:59.794 Workload Type: dif_verify 00:05:59.794 Vector size: 4096 bytes 00:05:59.794 Transfer size: 4096 bytes 00:05:59.794 Block size: 512 bytes 00:05:59.794 Metadata size: 8 bytes 00:05:59.794 Vector count 1 00:05:59.794 Module: software 00:05:59.794 Queue depth: 32 00:05:59.794 Allocate depth: 32 00:05:59.794 # threads/core: 1 00:05:59.794 Run time: 1 seconds 00:05:59.794 Verify: No 00:05:59.794 00:05:59.794 Running for 1 seconds... 00:05:59.794 00:05:59.794 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.794 ------------------------------------------------------------------------------------ 00:05:59.794 0,0 81952/s 325 MiB/s 0 0 00:05:59.794 ==================================================================================== 00:05:59.794 Total 81952/s 320 MiB/s 0 0' 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:59.794 20:07:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.794 20:07:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.794 20:07:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.794 20:07:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.794 20:07:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.794 20:07:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.794 20:07:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.794 20:07:04 -- accel/accel.sh@42 -- # jq -r . 00:05:59.794 [2024-11-20 20:07:04.572877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.794 [2024-11-20 20:07:04.572969] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3049468 ] 00:05:59.794 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.794 [2024-11-20 20:07:04.639134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.794 [2024-11-20 20:07:04.759478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val= 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val= 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val=0x1 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val= 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val= 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val=dif_verify 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.794 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.794 20:07:04 -- accel/accel.sh@21 -- # val= 00:05:59.794 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.795 20:07:04 -- accel/accel.sh@21 -- # val=software 00:05:59.795 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.795 20:07:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.795 20:07:04 -- accel/accel.sh@21 -- # val=32 00:05:59.795 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.795 20:07:04 -- accel/accel.sh@21 -- # val=32 00:05:59.795 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.795 20:07:04 -- accel/accel.sh@21 -- # val=1 00:05:59.795 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.795 20:07:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.795 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:05:59.795 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:05:59.795 20:07:04 -- accel/accel.sh@21 -- # val=No 00:06:00.052 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.052 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:06:00.052 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:06:00.052 20:07:04 -- accel/accel.sh@21 -- # val= 00:06:00.052 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.052 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:06:00.052 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:06:00.052 20:07:04 -- accel/accel.sh@21 -- # val= 00:06:00.052 20:07:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.052 20:07:04 -- accel/accel.sh@20 -- # IFS=: 00:06:00.052 20:07:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@21 -- # val= 00:06:01.427 20:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@21 -- # val= 00:06:01.427 20:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@21 -- # val= 00:06:01.427 20:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@21 -- # val= 00:06:01.427 20:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@21 -- # val= 00:06:01.427 20:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@21 -- # val= 00:06:01.427 20:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:01.427 20:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:01.427 20:07:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.427 20:07:06 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:01.427 20:07:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.427 00:06:01.427 real 0m2.973s 00:06:01.427 user 0m2.676s 00:06:01.427 sys 0m0.296s 00:06:01.428 20:07:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.428 20:07:06 -- common/autotest_common.sh@10 -- # set +x 00:06:01.428 ************************************ 00:06:01.428 END TEST accel_dif_verify 00:06:01.428 ************************************ 00:06:01.428 20:07:06 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:01.428 20:07:06 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:01.428 20:07:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.428 20:07:06 -- common/autotest_common.sh@10 -- # set +x 00:06:01.428 ************************************ 00:06:01.428 START TEST accel_dif_generate 00:06:01.428 ************************************ 00:06:01.428 20:07:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:01.428 20:07:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.428 20:07:06 -- accel/accel.sh@17 -- # local accel_module 00:06:01.428 20:07:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:01.428 20:07:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:01.428 20:07:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.428 20:07:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.428 20:07:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.428 20:07:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.428 20:07:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.428 20:07:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.428 20:07:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.428 20:07:06 -- accel/accel.sh@42 -- # jq -r . 00:06:01.428 [2024-11-20 20:07:06.079813] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.428 [2024-11-20 20:07:06.079902] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3049740 ] 00:06:01.428 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.428 [2024-11-20 20:07:06.140279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.428 [2024-11-20 20:07:06.261178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.803 20:07:07 -- accel/accel.sh@18 -- # out=' 00:06:02.803 SPDK Configuration: 00:06:02.803 Core mask: 0x1 00:06:02.803 00:06:02.803 Accel Perf Configuration: 00:06:02.803 Workload Type: dif_generate 00:06:02.803 Vector size: 4096 bytes 00:06:02.803 Transfer size: 4096 bytes 00:06:02.803 Block size: 512 bytes 00:06:02.803 Metadata size: 8 bytes 00:06:02.803 Vector count 1 00:06:02.803 Module: software 00:06:02.803 Queue depth: 32 00:06:02.803 Allocate depth: 32 00:06:02.803 # threads/core: 1 00:06:02.803 Run time: 1 seconds 00:06:02.803 Verify: No 00:06:02.803 00:06:02.803 Running for 1 seconds... 00:06:02.803 00:06:02.803 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.803 ------------------------------------------------------------------------------------ 00:06:02.803 0,0 96256/s 381 MiB/s 0 0 00:06:02.803 ==================================================================================== 00:06:02.803 Total 96256/s 376 MiB/s 0 0' 00:06:02.803 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:02.804 20:07:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.804 20:07:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.804 20:07:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.804 20:07:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.804 20:07:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.804 20:07:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.804 20:07:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.804 20:07:07 -- accel/accel.sh@42 -- # jq -r . 00:06:02.804 [2024-11-20 20:07:07.564624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.804 [2024-11-20 20:07:07.564715] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3049888 ] 00:06:02.804 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.804 [2024-11-20 20:07:07.626658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.804 [2024-11-20 20:07:07.745477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=0x1 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=dif_generate 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=software 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=32 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=32 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=1 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val=No 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:02.804 20:07:07 -- accel/accel.sh@21 -- # val= 00:06:02.804 20:07:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # IFS=: 00:06:02.804 20:07:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@21 -- # val= 00:06:04.180 20:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@21 -- # val= 00:06:04.180 20:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@21 -- # val= 00:06:04.180 20:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@21 -- # val= 00:06:04.180 20:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@21 -- # val= 00:06:04.180 20:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@21 -- # val= 00:06:04.180 20:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:04.180 20:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:04.180 20:07:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.180 20:07:09 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:04.180 20:07:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.180 00:06:04.180 real 0m2.955s 00:06:04.180 user 0m2.671s 00:06:04.180 sys 0m0.282s 00:06:04.180 20:07:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.180 20:07:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.181 ************************************ 00:06:04.181 END TEST accel_dif_generate 00:06:04.181 ************************************ 00:06:04.181 20:07:09 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:04.181 20:07:09 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:04.181 20:07:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.181 20:07:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.181 ************************************ 00:06:04.181 START TEST accel_dif_generate_copy 00:06:04.181 ************************************ 00:06:04.181 20:07:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:04.181 20:07:09 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.181 20:07:09 -- accel/accel.sh@17 -- # local accel_module 00:06:04.181 20:07:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:04.181 20:07:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:04.181 20:07:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.181 20:07:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.181 20:07:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.181 20:07:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.181 20:07:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.181 20:07:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.181 20:07:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.181 20:07:09 -- accel/accel.sh@42 -- # jq -r . 00:06:04.181 [2024-11-20 20:07:09.062435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.181 [2024-11-20 20:07:09.062529] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3050050 ] 00:06:04.181 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.181 [2024-11-20 20:07:09.124631] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.438 [2024-11-20 20:07:09.247086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.811 20:07:10 -- accel/accel.sh@18 -- # out=' 00:06:05.811 SPDK Configuration: 00:06:05.811 Core mask: 0x1 00:06:05.811 00:06:05.811 Accel Perf Configuration: 00:06:05.811 Workload Type: dif_generate_copy 00:06:05.811 Vector size: 4096 bytes 00:06:05.811 Transfer size: 4096 bytes 00:06:05.811 Vector count 1 00:06:05.811 Module: software 00:06:05.811 Queue depth: 32 00:06:05.811 Allocate depth: 32 00:06:05.811 # threads/core: 1 00:06:05.811 Run time: 1 seconds 00:06:05.811 Verify: No 00:06:05.811 00:06:05.811 Running for 1 seconds... 00:06:05.811 00:06:05.811 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.811 ------------------------------------------------------------------------------------ 00:06:05.811 0,0 76160/s 302 MiB/s 0 0 00:06:05.811 ==================================================================================== 00:06:05.811 Total 76160/s 297 MiB/s 0 0' 00:06:05.811 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.811 20:07:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:05.811 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.811 20:07:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:05.811 20:07:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.811 20:07:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.811 20:07:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.811 20:07:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.811 20:07:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.811 20:07:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.811 20:07:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.811 20:07:10 -- accel/accel.sh@42 -- # jq -r . 00:06:05.811 [2024-11-20 20:07:10.545842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.811 [2024-11-20 20:07:10.545930] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3050281 ] 00:06:05.811 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.811 [2024-11-20 20:07:10.611433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.811 [2024-11-20 20:07:10.732364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.811 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.811 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.811 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=0x1 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=software 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=32 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=32 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=1 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val=No 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:05.812 20:07:10 -- accel/accel.sh@21 -- # val= 00:06:05.812 20:07:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # IFS=: 00:06:05.812 20:07:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@21 -- # val= 00:06:07.185 20:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@21 -- # val= 00:06:07.185 20:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@21 -- # val= 00:06:07.185 20:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@21 -- # val= 00:06:07.185 20:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@21 -- # val= 00:06:07.185 20:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@21 -- # val= 00:06:07.185 20:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:07.185 20:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:07.185 20:07:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.185 20:07:12 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:07.185 20:07:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.185 00:06:07.185 real 0m2.976s 00:06:07.185 user 0m2.673s 00:06:07.185 sys 0m0.298s 00:06:07.185 20:07:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.185 20:07:12 -- common/autotest_common.sh@10 -- # set +x 00:06:07.185 ************************************ 00:06:07.185 END TEST accel_dif_generate_copy 00:06:07.185 ************************************ 00:06:07.185 20:07:12 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:07.185 20:07:12 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.185 20:07:12 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:07.185 20:07:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.185 20:07:12 -- common/autotest_common.sh@10 -- # set +x 00:06:07.185 ************************************ 00:06:07.185 START TEST accel_comp 00:06:07.185 ************************************ 00:06:07.185 20:07:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.185 20:07:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.185 20:07:12 -- accel/accel.sh@17 -- # local accel_module 00:06:07.185 20:07:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.185 20:07:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.185 20:07:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.185 20:07:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.185 20:07:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.185 20:07:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.185 20:07:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.185 20:07:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.185 20:07:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.185 20:07:12 -- accel/accel.sh@42 -- # jq -r . 00:06:07.185 [2024-11-20 20:07:12.062686] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.185 [2024-11-20 20:07:12.062779] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3050468 ] 00:06:07.185 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.185 [2024-11-20 20:07:12.127084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.442 [2024-11-20 20:07:12.247590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.815 20:07:13 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:08.815 00:06:08.815 SPDK Configuration: 00:06:08.815 Core mask: 0x1 00:06:08.815 00:06:08.815 Accel Perf Configuration: 00:06:08.815 Workload Type: compress 00:06:08.815 Transfer size: 4096 bytes 00:06:08.815 Vector count 1 00:06:08.815 Module: software 00:06:08.815 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.815 Queue depth: 32 00:06:08.815 Allocate depth: 32 00:06:08.815 # threads/core: 1 00:06:08.815 Run time: 1 seconds 00:06:08.815 Verify: No 00:06:08.815 00:06:08.815 Running for 1 seconds... 00:06:08.815 00:06:08.815 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.815 ------------------------------------------------------------------------------------ 00:06:08.815 0,0 31552/s 131 MiB/s 0 0 00:06:08.815 ==================================================================================== 00:06:08.815 Total 31552/s 123 MiB/s 0 0' 00:06:08.815 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.815 20:07:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.815 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.815 20:07:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.815 20:07:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.815 20:07:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.815 20:07:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.815 20:07:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.815 20:07:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.815 20:07:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.815 20:07:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.815 20:07:13 -- accel/accel.sh@42 -- # jq -r . 00:06:08.815 [2024-11-20 20:07:13.549290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.815 [2024-11-20 20:07:13.549379] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3050619 ] 00:06:08.815 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.815 [2024-11-20 20:07:13.614690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.816 [2024-11-20 20:07:13.731671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=0x1 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=compress 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=software 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=32 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=32 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=1 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val=No 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:08.816 20:07:13 -- accel/accel.sh@21 -- # val= 00:06:08.816 20:07:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # IFS=: 00:06:08.816 20:07:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@21 -- # val= 00:06:10.190 20:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@21 -- # val= 00:06:10.190 20:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@21 -- # val= 00:06:10.190 20:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@21 -- # val= 00:06:10.190 20:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@21 -- # val= 00:06:10.190 20:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@21 -- # val= 00:06:10.190 20:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:10.190 20:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:10.190 20:07:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.190 20:07:15 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:10.190 20:07:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.190 00:06:10.190 real 0m2.966s 00:06:10.190 user 0m2.671s 00:06:10.190 sys 0m0.292s 00:06:10.190 20:07:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.190 20:07:15 -- common/autotest_common.sh@10 -- # set +x 00:06:10.190 ************************************ 00:06:10.190 END TEST accel_comp 00:06:10.190 ************************************ 00:06:10.190 20:07:15 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:10.190 20:07:15 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:10.190 20:07:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.190 20:07:15 -- common/autotest_common.sh@10 -- # set +x 00:06:10.190 ************************************ 00:06:10.190 START TEST accel_decomp 00:06:10.190 ************************************ 00:06:10.190 20:07:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:10.190 20:07:15 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.190 20:07:15 -- accel/accel.sh@17 -- # local accel_module 00:06:10.190 20:07:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:10.190 20:07:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:10.190 20:07:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.190 20:07:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.190 20:07:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.190 20:07:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.190 20:07:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.190 20:07:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.190 20:07:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.190 20:07:15 -- accel/accel.sh@42 -- # jq -r . 00:06:10.190 [2024-11-20 20:07:15.055646] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.190 [2024-11-20 20:07:15.055735] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3050804 ] 00:06:10.190 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.190 [2024-11-20 20:07:15.117958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.448 [2024-11-20 20:07:15.238660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.821 20:07:16 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:11.821 00:06:11.821 SPDK Configuration: 00:06:11.821 Core mask: 0x1 00:06:11.821 00:06:11.821 Accel Perf Configuration: 00:06:11.821 Workload Type: decompress 00:06:11.821 Transfer size: 4096 bytes 00:06:11.821 Vector count 1 00:06:11.821 Module: software 00:06:11.821 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.821 Queue depth: 32 00:06:11.821 Allocate depth: 32 00:06:11.821 # threads/core: 1 00:06:11.821 Run time: 1 seconds 00:06:11.821 Verify: Yes 00:06:11.821 00:06:11.821 Running for 1 seconds... 00:06:11.821 00:06:11.821 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.821 ------------------------------------------------------------------------------------ 00:06:11.821 0,0 54944/s 101 MiB/s 0 0 00:06:11.821 ==================================================================================== 00:06:11.821 Total 54944/s 214 MiB/s 0 0' 00:06:11.821 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:11.822 20:07:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.822 20:07:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.822 20:07:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.822 20:07:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.822 20:07:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.822 20:07:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.822 20:07:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.822 20:07:16 -- accel/accel.sh@42 -- # jq -r . 00:06:11.822 [2024-11-20 20:07:16.544574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.822 [2024-11-20 20:07:16.544667] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3051043 ] 00:06:11.822 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.822 [2024-11-20 20:07:16.609116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.822 [2024-11-20 20:07:16.727720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=0x1 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=decompress 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=software 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=32 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=32 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=1 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val=Yes 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:11.822 20:07:16 -- accel/accel.sh@21 -- # val= 00:06:11.822 20:07:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # IFS=: 00:06:11.822 20:07:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@21 -- # val= 00:06:13.196 20:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@21 -- # val= 00:06:13.196 20:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@21 -- # val= 00:06:13.196 20:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@21 -- # val= 00:06:13.196 20:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@21 -- # val= 00:06:13.196 20:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@21 -- # val= 00:06:13.196 20:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:13.196 20:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:13.196 20:07:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.196 20:07:18 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:13.196 20:07:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.196 00:06:13.196 real 0m2.972s 00:06:13.196 user 0m2.680s 00:06:13.196 sys 0m0.290s 00:06:13.196 20:07:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.196 20:07:18 -- common/autotest_common.sh@10 -- # set +x 00:06:13.196 ************************************ 00:06:13.196 END TEST accel_decomp 00:06:13.196 ************************************ 00:06:13.196 20:07:18 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.196 20:07:18 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:13.196 20:07:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.196 20:07:18 -- common/autotest_common.sh@10 -- # set +x 00:06:13.196 ************************************ 00:06:13.196 START TEST accel_decmop_full 00:06:13.196 ************************************ 00:06:13.196 20:07:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.196 20:07:18 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.196 20:07:18 -- accel/accel.sh@17 -- # local accel_module 00:06:13.196 20:07:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.196 20:07:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.196 20:07:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.196 20:07:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.196 20:07:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.196 20:07:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.196 20:07:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.196 20:07:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.196 20:07:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.196 20:07:18 -- accel/accel.sh@42 -- # jq -r . 00:06:13.196 [2024-11-20 20:07:18.052907] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.196 [2024-11-20 20:07:18.053001] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3051201 ] 00:06:13.196 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.196 [2024-11-20 20:07:18.114757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.454 [2024-11-20 20:07:18.235227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.827 20:07:19 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:14.827 00:06:14.827 SPDK Configuration: 00:06:14.827 Core mask: 0x1 00:06:14.827 00:06:14.827 Accel Perf Configuration: 00:06:14.827 Workload Type: decompress 00:06:14.827 Transfer size: 111250 bytes 00:06:14.827 Vector count 1 00:06:14.827 Module: software 00:06:14.827 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.827 Queue depth: 32 00:06:14.827 Allocate depth: 32 00:06:14.827 # threads/core: 1 00:06:14.827 Run time: 1 seconds 00:06:14.827 Verify: Yes 00:06:14.827 00:06:14.827 Running for 1 seconds... 00:06:14.827 00:06:14.827 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:14.827 ------------------------------------------------------------------------------------ 00:06:14.827 0,0 3808/s 157 MiB/s 0 0 00:06:14.827 ==================================================================================== 00:06:14.827 Total 3808/s 404 MiB/s 0 0' 00:06:14.827 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.827 20:07:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:14.827 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.827 20:07:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:14.827 20:07:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.827 20:07:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.827 20:07:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.827 20:07:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.827 20:07:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.827 20:07:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.827 20:07:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.827 20:07:19 -- accel/accel.sh@42 -- # jq -r . 00:06:14.827 [2024-11-20 20:07:19.544194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.827 [2024-11-20 20:07:19.544281] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3051351 ] 00:06:14.827 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.827 [2024-11-20 20:07:19.609437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.827 [2024-11-20 20:07:19.729416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.827 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.827 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.827 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.827 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.827 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=0x1 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=decompress 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=software 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=32 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=32 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=1 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val=Yes 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:14.828 20:07:19 -- accel/accel.sh@21 -- # val= 00:06:14.828 20:07:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # IFS=: 00:06:14.828 20:07:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@21 -- # val= 00:06:16.202 20:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@21 -- # val= 00:06:16.202 20:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@21 -- # val= 00:06:16.202 20:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@21 -- # val= 00:06:16.202 20:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@21 -- # val= 00:06:16.202 20:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@21 -- # val= 00:06:16.202 20:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:16.202 20:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:16.202 20:07:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.202 20:07:21 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:16.202 20:07:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.202 00:06:16.202 real 0m3.003s 00:06:16.202 user 0m2.697s 00:06:16.202 sys 0m0.301s 00:06:16.202 20:07:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.202 20:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:16.202 ************************************ 00:06:16.202 END TEST accel_decmop_full 00:06:16.202 ************************************ 00:06:16.202 20:07:21 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.202 20:07:21 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:16.202 20:07:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.202 20:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:16.202 ************************************ 00:06:16.202 START TEST accel_decomp_mcore 00:06:16.202 ************************************ 00:06:16.202 20:07:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.202 20:07:21 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.202 20:07:21 -- accel/accel.sh@17 -- # local accel_module 00:06:16.202 20:07:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.202 20:07:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.202 20:07:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.202 20:07:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.202 20:07:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.202 20:07:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.202 20:07:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.202 20:07:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.202 20:07:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.202 20:07:21 -- accel/accel.sh@42 -- # jq -r . 00:06:16.202 [2024-11-20 20:07:21.079832] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.202 [2024-11-20 20:07:21.079924] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3051624 ] 00:06:16.202 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.202 [2024-11-20 20:07:21.148844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:16.461 [2024-11-20 20:07:21.273067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.461 [2024-11-20 20:07:21.273136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:16.461 [2024-11-20 20:07:21.273203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:16.461 [2024-11-20 20:07:21.273207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.834 20:07:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:17.834 00:06:17.834 SPDK Configuration: 00:06:17.834 Core mask: 0xf 00:06:17.834 00:06:17.834 Accel Perf Configuration: 00:06:17.834 Workload Type: decompress 00:06:17.834 Transfer size: 4096 bytes 00:06:17.834 Vector count 1 00:06:17.834 Module: software 00:06:17.834 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.834 Queue depth: 32 00:06:17.834 Allocate depth: 32 00:06:17.834 # threads/core: 1 00:06:17.834 Run time: 1 seconds 00:06:17.834 Verify: Yes 00:06:17.834 00:06:17.834 Running for 1 seconds... 00:06:17.834 00:06:17.834 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.834 ------------------------------------------------------------------------------------ 00:06:17.834 0,0 50016/s 92 MiB/s 0 0 00:06:17.834 3,0 50496/s 93 MiB/s 0 0 00:06:17.834 2,0 50464/s 92 MiB/s 0 0 00:06:17.834 1,0 50400/s 92 MiB/s 0 0 00:06:17.834 ==================================================================================== 00:06:17.834 Total 201376/s 786 MiB/s 0 0' 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:17.834 20:07:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.834 20:07:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.834 20:07:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.834 20:07:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.834 20:07:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.834 20:07:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.834 20:07:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.834 20:07:22 -- accel/accel.sh@42 -- # jq -r . 00:06:17.834 [2024-11-20 20:07:22.577180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.834 [2024-11-20 20:07:22.577273] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3051778 ] 00:06:17.834 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.834 [2024-11-20 20:07:22.643922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:17.834 [2024-11-20 20:07:22.767538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.834 [2024-11-20 20:07:22.767592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:17.834 [2024-11-20 20:07:22.767646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:17.834 [2024-11-20 20:07:22.767649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val=0xf 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val=decompress 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val=software 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.834 20:07:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.834 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.834 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val=32 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val=32 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val=1 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val=Yes 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:17.835 20:07:22 -- accel/accel.sh@21 -- # val= 00:06:17.835 20:07:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # IFS=: 00:06:17.835 20:07:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@21 -- # val= 00:06:19.208 20:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:19.208 20:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:19.208 20:07:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.208 20:07:24 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:19.208 20:07:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.208 00:06:19.208 real 0m3.003s 00:06:19.208 user 0m9.615s 00:06:19.208 sys 0m0.319s 00:06:19.208 20:07:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.208 20:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:19.208 ************************************ 00:06:19.208 END TEST accel_decomp_mcore 00:06:19.208 ************************************ 00:06:19.208 20:07:24 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.208 20:07:24 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:19.208 20:07:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.208 20:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:19.208 ************************************ 00:06:19.208 START TEST accel_decomp_full_mcore 00:06:19.208 ************************************ 00:06:19.208 20:07:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.208 20:07:24 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.208 20:07:24 -- accel/accel.sh@17 -- # local accel_module 00:06:19.208 20:07:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.208 20:07:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.208 20:07:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.208 20:07:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.208 20:07:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.208 20:07:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.208 20:07:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.208 20:07:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.208 20:07:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.208 20:07:24 -- accel/accel.sh@42 -- # jq -r . 00:06:19.208 [2024-11-20 20:07:24.109043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.208 [2024-11-20 20:07:24.109141] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3051982 ] 00:06:19.208 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.208 [2024-11-20 20:07:24.178026] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:19.466 [2024-11-20 20:07:24.299052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.466 [2024-11-20 20:07:24.299156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:19.466 [2024-11-20 20:07:24.299106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:19.466 [2024-11-20 20:07:24.299160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.841 20:07:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:20.841 00:06:20.841 SPDK Configuration: 00:06:20.841 Core mask: 0xf 00:06:20.841 00:06:20.841 Accel Perf Configuration: 00:06:20.841 Workload Type: decompress 00:06:20.841 Transfer size: 111250 bytes 00:06:20.841 Vector count 1 00:06:20.841 Module: software 00:06:20.841 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.841 Queue depth: 32 00:06:20.841 Allocate depth: 32 00:06:20.841 # threads/core: 1 00:06:20.841 Run time: 1 seconds 00:06:20.841 Verify: Yes 00:06:20.841 00:06:20.841 Running for 1 seconds... 00:06:20.841 00:06:20.841 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:20.841 ------------------------------------------------------------------------------------ 00:06:20.841 0,0 3776/s 155 MiB/s 0 0 00:06:20.841 3,0 3776/s 155 MiB/s 0 0 00:06:20.841 2,0 3776/s 155 MiB/s 0 0 00:06:20.841 1,0 3776/s 155 MiB/s 0 0 00:06:20.841 ==================================================================================== 00:06:20.841 Total 15104/s 1602 MiB/s 0 0' 00:06:20.841 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.841 20:07:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:20.841 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.841 20:07:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:20.841 20:07:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.841 20:07:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.841 20:07:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.841 20:07:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.841 20:07:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.841 20:07:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.841 20:07:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.841 20:07:25 -- accel/accel.sh@42 -- # jq -r . 00:06:20.841 [2024-11-20 20:07:25.617402] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.842 [2024-11-20 20:07:25.617496] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3052207 ] 00:06:20.842 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.842 [2024-11-20 20:07:25.681312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:20.842 [2024-11-20 20:07:25.804316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:20.842 [2024-11-20 20:07:25.804372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:20.842 [2024-11-20 20:07:25.804424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:20.842 [2024-11-20 20:07:25.804427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=0xf 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=decompress 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=software 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=32 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=32 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:20.842 20:07:25 -- accel/accel.sh@21 -- # val=1 00:06:20.842 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.842 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:21.100 20:07:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.100 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:21.100 20:07:25 -- accel/accel.sh@21 -- # val=Yes 00:06:21.100 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:21.100 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:21.100 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:21.100 20:07:25 -- accel/accel.sh@21 -- # val= 00:06:21.100 20:07:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # IFS=: 00:06:21.100 20:07:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@21 -- # val= 00:06:22.473 20:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:22.473 20:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:22.473 20:07:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.473 20:07:27 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.473 20:07:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.473 00:06:22.473 real 0m3.014s 00:06:22.473 user 0m9.690s 00:06:22.473 sys 0m0.295s 00:06:22.473 20:07:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.473 20:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:22.473 ************************************ 00:06:22.473 END TEST accel_decomp_full_mcore 00:06:22.473 ************************************ 00:06:22.473 20:07:27 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.473 20:07:27 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:22.473 20:07:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.473 20:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:22.473 ************************************ 00:06:22.473 START TEST accel_decomp_mthread 00:06:22.473 ************************************ 00:06:22.473 20:07:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.473 20:07:27 -- accel/accel.sh@16 -- # local accel_opc 00:06:22.473 20:07:27 -- accel/accel.sh@17 -- # local accel_module 00:06:22.473 20:07:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.473 20:07:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.473 20:07:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.473 20:07:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.473 20:07:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.473 20:07:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.473 20:07:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.473 20:07:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.473 20:07:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.473 20:07:27 -- accel/accel.sh@42 -- # jq -r . 00:06:22.473 [2024-11-20 20:07:27.148140] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.473 [2024-11-20 20:07:27.148233] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3052368 ] 00:06:22.473 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.473 [2024-11-20 20:07:27.211092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.473 [2024-11-20 20:07:27.331353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.847 20:07:28 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:23.847 00:06:23.847 SPDK Configuration: 00:06:23.847 Core mask: 0x1 00:06:23.847 00:06:23.847 Accel Perf Configuration: 00:06:23.847 Workload Type: decompress 00:06:23.847 Transfer size: 4096 bytes 00:06:23.847 Vector count 1 00:06:23.847 Module: software 00:06:23.847 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.847 Queue depth: 32 00:06:23.847 Allocate depth: 32 00:06:23.847 # threads/core: 2 00:06:23.847 Run time: 1 seconds 00:06:23.847 Verify: Yes 00:06:23.847 00:06:23.847 Running for 1 seconds... 00:06:23.847 00:06:23.847 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:23.847 ------------------------------------------------------------------------------------ 00:06:23.847 0,1 28000/s 51 MiB/s 0 0 00:06:23.848 0,0 27904/s 51 MiB/s 0 0 00:06:23.848 ==================================================================================== 00:06:23.848 Total 55904/s 218 MiB/s 0 0' 00:06:23.848 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:23.848 20:07:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:23.848 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:23.848 20:07:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:23.848 20:07:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.848 20:07:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.848 20:07:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.848 20:07:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.848 20:07:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.848 20:07:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.848 20:07:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.848 20:07:28 -- accel/accel.sh@42 -- # jq -r . 00:06:23.848 [2024-11-20 20:07:28.637553] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.848 [2024-11-20 20:07:28.637639] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3052533 ] 00:06:23.848 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.848 [2024-11-20 20:07:28.704839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.848 [2024-11-20 20:07:28.826388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=0x1 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=decompress 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=software 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=32 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=32 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=2 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val=Yes 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:24.105 20:07:28 -- accel/accel.sh@21 -- # val= 00:06:24.105 20:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # IFS=: 00:06:24.105 20:07:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@21 -- # val= 00:06:25.478 20:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:25.478 20:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:25.478 20:07:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:25.478 20:07:30 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:25.478 20:07:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:25.478 00:06:25.478 real 0m2.981s 00:06:25.478 user 0m2.681s 00:06:25.478 sys 0m0.296s 00:06:25.478 20:07:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.478 20:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:25.478 ************************************ 00:06:25.478 END TEST accel_decomp_mthread 00:06:25.478 ************************************ 00:06:25.478 20:07:30 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.478 20:07:30 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:25.478 20:07:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.478 20:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:25.478 ************************************ 00:06:25.478 START TEST accel_deomp_full_mthread 00:06:25.478 ************************************ 00:06:25.478 20:07:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.478 20:07:30 -- accel/accel.sh@16 -- # local accel_opc 00:06:25.478 20:07:30 -- accel/accel.sh@17 -- # local accel_module 00:06:25.478 20:07:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.478 20:07:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.478 20:07:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.478 20:07:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.478 20:07:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.478 20:07:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.478 20:07:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.478 20:07:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.478 20:07:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.478 20:07:30 -- accel/accel.sh@42 -- # jq -r . 00:06:25.478 [2024-11-20 20:07:30.153423] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.478 [2024-11-20 20:07:30.153508] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3052790 ] 00:06:25.478 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.478 [2024-11-20 20:07:30.219894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.478 [2024-11-20 20:07:30.340565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.851 20:07:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:26.851 00:06:26.851 SPDK Configuration: 00:06:26.851 Core mask: 0x1 00:06:26.851 00:06:26.851 Accel Perf Configuration: 00:06:26.851 Workload Type: decompress 00:06:26.851 Transfer size: 111250 bytes 00:06:26.851 Vector count 1 00:06:26.851 Module: software 00:06:26.851 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.851 Queue depth: 32 00:06:26.851 Allocate depth: 32 00:06:26.851 # threads/core: 2 00:06:26.851 Run time: 1 seconds 00:06:26.851 Verify: Yes 00:06:26.851 00:06:26.851 Running for 1 seconds... 00:06:26.851 00:06:26.851 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:26.851 ------------------------------------------------------------------------------------ 00:06:26.851 0,1 1952/s 80 MiB/s 0 0 00:06:26.851 0,0 1920/s 79 MiB/s 0 0 00:06:26.851 ==================================================================================== 00:06:26.851 Total 3872/s 410 MiB/s 0 0' 00:06:26.851 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:26.851 20:07:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:26.851 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:26.851 20:07:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:26.851 20:07:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.851 20:07:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.851 20:07:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.851 20:07:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.851 20:07:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.851 20:07:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.851 20:07:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.851 20:07:31 -- accel/accel.sh@42 -- # jq -r . 00:06:26.851 [2024-11-20 20:07:31.673509] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.851 [2024-11-20 20:07:31.673600] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3052941 ] 00:06:26.851 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.851 [2024-11-20 20:07:31.739873] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.851 [2024-11-20 20:07:31.859827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=0x1 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=decompress 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=software 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=32 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=32 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=2 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.109 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.109 20:07:31 -- accel/accel.sh@21 -- # val=Yes 00:06:27.109 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.110 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.110 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.110 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.110 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.110 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.110 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:27.110 20:07:31 -- accel/accel.sh@21 -- # val= 00:06:27.110 20:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.110 20:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:27.110 20:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@21 -- # val= 00:06:28.483 20:07:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # IFS=: 00:06:28.483 20:07:33 -- accel/accel.sh@20 -- # read -r var val 00:06:28.483 20:07:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:28.483 20:07:33 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:28.483 20:07:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:28.483 00:06:28.483 real 0m3.053s 00:06:28.483 user 0m2.757s 00:06:28.483 sys 0m0.294s 00:06:28.483 20:07:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.483 20:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:28.483 ************************************ 00:06:28.483 END TEST accel_deomp_full_mthread 00:06:28.483 ************************************ 00:06:28.483 20:07:33 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:28.483 20:07:33 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:28.483 20:07:33 -- accel/accel.sh@129 -- # build_accel_config 00:06:28.483 20:07:33 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:28.483 20:07:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.483 20:07:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.483 20:07:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.483 20:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:28.483 20:07:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.483 20:07:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.483 20:07:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.483 20:07:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.483 20:07:33 -- accel/accel.sh@42 -- # jq -r . 00:06:28.483 ************************************ 00:06:28.483 START TEST accel_dif_functional_tests 00:06:28.483 ************************************ 00:06:28.483 20:07:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:28.483 [2024-11-20 20:07:33.251899] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.483 [2024-11-20 20:07:33.251977] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3053154 ] 00:06:28.483 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.483 [2024-11-20 20:07:33.312913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:28.483 [2024-11-20 20:07:33.435249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.483 [2024-11-20 20:07:33.435303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.483 [2024-11-20 20:07:33.435306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.741 00:06:28.741 00:06:28.741 CUnit - A unit testing framework for C - Version 2.1-3 00:06:28.741 http://cunit.sourceforge.net/ 00:06:28.741 00:06:28.741 00:06:28.741 Suite: accel_dif 00:06:28.741 Test: verify: DIF generated, GUARD check ...passed 00:06:28.741 Test: verify: DIF generated, APPTAG check ...passed 00:06:28.741 Test: verify: DIF generated, REFTAG check ...passed 00:06:28.741 Test: verify: DIF not generated, GUARD check ...[2024-11-20 20:07:33.538170] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:28.741 [2024-11-20 20:07:33.538234] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:28.741 passed 00:06:28.741 Test: verify: DIF not generated, APPTAG check ...[2024-11-20 20:07:33.538276] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:28.741 [2024-11-20 20:07:33.538306] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:28.741 passed 00:06:28.741 Test: verify: DIF not generated, REFTAG check ...[2024-11-20 20:07:33.538344] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:28.741 [2024-11-20 20:07:33.538383] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:28.741 passed 00:06:28.741 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:28.741 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-20 20:07:33.538456] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:28.741 passed 00:06:28.741 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:28.741 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:28.741 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:28.741 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-20 20:07:33.538619] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:28.741 passed 00:06:28.741 Test: generate copy: DIF generated, GUARD check ...passed 00:06:28.741 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:28.741 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:28.741 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:28.741 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:28.741 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:28.741 Test: generate copy: iovecs-len validate ...[2024-11-20 20:07:33.538886] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:28.741 passed 00:06:28.741 Test: generate copy: buffer alignment validate ...passed 00:06:28.741 00:06:28.741 Run Summary: Type Total Ran Passed Failed Inactive 00:06:28.741 suites 1 1 n/a 0 0 00:06:28.741 tests 20 20 20 0 0 00:06:28.741 asserts 204 204 204 0 n/a 00:06:28.741 00:06:28.741 Elapsed time = 0.003 seconds 00:06:29.000 00:06:29.000 real 0m0.577s 00:06:29.000 user 0m0.867s 00:06:29.000 sys 0m0.181s 00:06:29.000 20:07:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.000 20:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.000 ************************************ 00:06:29.000 END TEST accel_dif_functional_tests 00:06:29.000 ************************************ 00:06:29.000 00:06:29.000 real 1m3.287s 00:06:29.000 user 1m11.104s 00:06:29.000 sys 0m7.315s 00:06:29.000 20:07:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.000 20:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.000 ************************************ 00:06:29.000 END TEST accel 00:06:29.000 ************************************ 00:06:29.000 20:07:33 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:29.000 20:07:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.000 20:07:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.000 20:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.000 ************************************ 00:06:29.000 START TEST accel_rpc 00:06:29.000 ************************************ 00:06:29.000 20:07:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:29.000 * Looking for test storage... 00:06:29.000 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:29.001 20:07:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:29.001 20:07:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:29.001 20:07:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:29.001 20:07:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:29.001 20:07:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:29.001 20:07:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:29.001 20:07:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:29.001 20:07:33 -- scripts/common.sh@335 -- # IFS=.-: 00:06:29.001 20:07:33 -- scripts/common.sh@335 -- # read -ra ver1 00:06:29.001 20:07:33 -- scripts/common.sh@336 -- # IFS=.-: 00:06:29.001 20:07:33 -- scripts/common.sh@336 -- # read -ra ver2 00:06:29.001 20:07:33 -- scripts/common.sh@337 -- # local 'op=<' 00:06:29.001 20:07:33 -- scripts/common.sh@339 -- # ver1_l=2 00:06:29.001 20:07:33 -- scripts/common.sh@340 -- # ver2_l=1 00:06:29.001 20:07:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:29.001 20:07:33 -- scripts/common.sh@343 -- # case "$op" in 00:06:29.001 20:07:33 -- scripts/common.sh@344 -- # : 1 00:06:29.001 20:07:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:29.001 20:07:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:29.001 20:07:33 -- scripts/common.sh@364 -- # decimal 1 00:06:29.001 20:07:33 -- scripts/common.sh@352 -- # local d=1 00:06:29.001 20:07:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:29.001 20:07:33 -- scripts/common.sh@354 -- # echo 1 00:06:29.001 20:07:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:29.001 20:07:33 -- scripts/common.sh@365 -- # decimal 2 00:06:29.001 20:07:33 -- scripts/common.sh@352 -- # local d=2 00:06:29.001 20:07:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:29.001 20:07:33 -- scripts/common.sh@354 -- # echo 2 00:06:29.001 20:07:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:29.001 20:07:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:29.001 20:07:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:29.001 20:07:33 -- scripts/common.sh@367 -- # return 0 00:06:29.001 20:07:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:29.001 20:07:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:29.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.001 --rc genhtml_branch_coverage=1 00:06:29.001 --rc genhtml_function_coverage=1 00:06:29.001 --rc genhtml_legend=1 00:06:29.001 --rc geninfo_all_blocks=1 00:06:29.001 --rc geninfo_unexecuted_blocks=1 00:06:29.001 00:06:29.001 ' 00:06:29.001 20:07:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:29.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.001 --rc genhtml_branch_coverage=1 00:06:29.001 --rc genhtml_function_coverage=1 00:06:29.001 --rc genhtml_legend=1 00:06:29.001 --rc geninfo_all_blocks=1 00:06:29.001 --rc geninfo_unexecuted_blocks=1 00:06:29.001 00:06:29.001 ' 00:06:29.001 20:07:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:29.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.001 --rc genhtml_branch_coverage=1 00:06:29.001 --rc genhtml_function_coverage=1 00:06:29.001 --rc genhtml_legend=1 00:06:29.001 --rc geninfo_all_blocks=1 00:06:29.001 --rc geninfo_unexecuted_blocks=1 00:06:29.001 00:06:29.001 ' 00:06:29.001 20:07:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:29.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.001 --rc genhtml_branch_coverage=1 00:06:29.001 --rc genhtml_function_coverage=1 00:06:29.001 --rc genhtml_legend=1 00:06:29.001 --rc geninfo_all_blocks=1 00:06:29.001 --rc geninfo_unexecuted_blocks=1 00:06:29.001 00:06:29.001 ' 00:06:29.001 20:07:33 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:29.001 20:07:33 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3053300 00:06:29.001 20:07:33 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:29.001 20:07:33 -- accel/accel_rpc.sh@15 -- # waitforlisten 3053300 00:06:29.001 20:07:33 -- common/autotest_common.sh@829 -- # '[' -z 3053300 ']' 00:06:29.001 20:07:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.001 20:07:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.001 20:07:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.001 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.001 20:07:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.001 20:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.001 [2024-11-20 20:07:34.026561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.001 [2024-11-20 20:07:34.026661] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3053300 ] 00:06:29.259 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.259 [2024-11-20 20:07:34.083470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.259 [2024-11-20 20:07:34.193525] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.259 [2024-11-20 20:07:34.193703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.259 20:07:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.259 20:07:34 -- common/autotest_common.sh@862 -- # return 0 00:06:29.259 20:07:34 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:29.259 20:07:34 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:29.259 20:07:34 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:29.259 20:07:34 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:29.259 20:07:34 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:29.259 20:07:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.259 20:07:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.259 20:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.517 ************************************ 00:06:29.517 START TEST accel_assign_opcode 00:06:29.517 ************************************ 00:06:29.517 20:07:34 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:29.517 20:07:34 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:29.517 20:07:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.517 20:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.517 [2024-11-20 20:07:34.302436] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:29.517 20:07:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.517 20:07:34 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:29.517 20:07:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.517 20:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.517 [2024-11-20 20:07:34.310449] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:29.517 20:07:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.517 20:07:34 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:29.517 20:07:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.517 20:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.775 20:07:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.775 20:07:34 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:29.775 20:07:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.775 20:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.775 20:07:34 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:29.775 20:07:34 -- accel/accel_rpc.sh@42 -- # grep software 00:06:29.775 20:07:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.775 software 00:06:29.775 00:06:29.775 real 0m0.308s 00:06:29.775 user 0m0.039s 00:06:29.775 sys 0m0.009s 00:06:29.775 20:07:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.775 20:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.775 ************************************ 00:06:29.775 END TEST accel_assign_opcode 00:06:29.775 ************************************ 00:06:29.775 20:07:34 -- accel/accel_rpc.sh@55 -- # killprocess 3053300 00:06:29.775 20:07:34 -- common/autotest_common.sh@936 -- # '[' -z 3053300 ']' 00:06:29.775 20:07:34 -- common/autotest_common.sh@940 -- # kill -0 3053300 00:06:29.775 20:07:34 -- common/autotest_common.sh@941 -- # uname 00:06:29.775 20:07:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.775 20:07:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3053300 00:06:29.775 20:07:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.775 20:07:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.775 20:07:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3053300' 00:06:29.775 killing process with pid 3053300 00:06:29.775 20:07:34 -- common/autotest_common.sh@955 -- # kill 3053300 00:06:29.775 20:07:34 -- common/autotest_common.sh@960 -- # wait 3053300 00:06:30.341 00:06:30.341 real 0m1.285s 00:06:30.341 user 0m1.240s 00:06:30.341 sys 0m0.454s 00:06:30.341 20:07:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.341 20:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:30.341 ************************************ 00:06:30.341 END TEST accel_rpc 00:06:30.341 ************************************ 00:06:30.341 20:07:35 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:30.341 20:07:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:30.341 20:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.341 20:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:30.341 ************************************ 00:06:30.341 START TEST app_cmdline 00:06:30.341 ************************************ 00:06:30.341 20:07:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:30.341 * Looking for test storage... 00:06:30.341 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:30.341 20:07:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:30.341 20:07:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:30.341 20:07:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:30.341 20:07:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:30.341 20:07:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:30.341 20:07:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:30.341 20:07:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:30.341 20:07:35 -- scripts/common.sh@335 -- # IFS=.-: 00:06:30.341 20:07:35 -- scripts/common.sh@335 -- # read -ra ver1 00:06:30.341 20:07:35 -- scripts/common.sh@336 -- # IFS=.-: 00:06:30.341 20:07:35 -- scripts/common.sh@336 -- # read -ra ver2 00:06:30.341 20:07:35 -- scripts/common.sh@337 -- # local 'op=<' 00:06:30.341 20:07:35 -- scripts/common.sh@339 -- # ver1_l=2 00:06:30.341 20:07:35 -- scripts/common.sh@340 -- # ver2_l=1 00:06:30.341 20:07:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:30.341 20:07:35 -- scripts/common.sh@343 -- # case "$op" in 00:06:30.341 20:07:35 -- scripts/common.sh@344 -- # : 1 00:06:30.341 20:07:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:30.341 20:07:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:30.341 20:07:35 -- scripts/common.sh@364 -- # decimal 1 00:06:30.341 20:07:35 -- scripts/common.sh@352 -- # local d=1 00:06:30.341 20:07:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:30.341 20:07:35 -- scripts/common.sh@354 -- # echo 1 00:06:30.341 20:07:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:30.341 20:07:35 -- scripts/common.sh@365 -- # decimal 2 00:06:30.341 20:07:35 -- scripts/common.sh@352 -- # local d=2 00:06:30.341 20:07:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:30.341 20:07:35 -- scripts/common.sh@354 -- # echo 2 00:06:30.341 20:07:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:30.341 20:07:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:30.341 20:07:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:30.341 20:07:35 -- scripts/common.sh@367 -- # return 0 00:06:30.341 20:07:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:30.341 20:07:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:30.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.341 --rc genhtml_branch_coverage=1 00:06:30.341 --rc genhtml_function_coverage=1 00:06:30.341 --rc genhtml_legend=1 00:06:30.341 --rc geninfo_all_blocks=1 00:06:30.341 --rc geninfo_unexecuted_blocks=1 00:06:30.341 00:06:30.341 ' 00:06:30.341 20:07:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:30.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.341 --rc genhtml_branch_coverage=1 00:06:30.341 --rc genhtml_function_coverage=1 00:06:30.341 --rc genhtml_legend=1 00:06:30.341 --rc geninfo_all_blocks=1 00:06:30.341 --rc geninfo_unexecuted_blocks=1 00:06:30.341 00:06:30.341 ' 00:06:30.341 20:07:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:30.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.341 --rc genhtml_branch_coverage=1 00:06:30.341 --rc genhtml_function_coverage=1 00:06:30.341 --rc genhtml_legend=1 00:06:30.341 --rc geninfo_all_blocks=1 00:06:30.341 --rc geninfo_unexecuted_blocks=1 00:06:30.341 00:06:30.341 ' 00:06:30.341 20:07:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:30.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.341 --rc genhtml_branch_coverage=1 00:06:30.341 --rc genhtml_function_coverage=1 00:06:30.341 --rc genhtml_legend=1 00:06:30.341 --rc geninfo_all_blocks=1 00:06:30.341 --rc geninfo_unexecuted_blocks=1 00:06:30.341 00:06:30.341 ' 00:06:30.341 20:07:35 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:30.341 20:07:35 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3053511 00:06:30.341 20:07:35 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:30.341 20:07:35 -- app/cmdline.sh@18 -- # waitforlisten 3053511 00:06:30.341 20:07:35 -- common/autotest_common.sh@829 -- # '[' -z 3053511 ']' 00:06:30.341 20:07:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.341 20:07:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.341 20:07:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.341 20:07:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.341 20:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:30.342 [2024-11-20 20:07:35.362371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.342 [2024-11-20 20:07:35.362471] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3053511 ] 00:06:30.600 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.600 [2024-11-20 20:07:35.430872] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.600 [2024-11-20 20:07:35.552684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:30.600 [2024-11-20 20:07:35.552859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.534 20:07:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.534 20:07:36 -- common/autotest_common.sh@862 -- # return 0 00:06:31.534 20:07:36 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:31.792 { 00:06:31.792 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:31.792 "fields": { 00:06:31.792 "major": 24, 00:06:31.792 "minor": 1, 00:06:31.792 "patch": 1, 00:06:31.792 "suffix": "-pre", 00:06:31.792 "commit": "c13c99a5e" 00:06:31.792 } 00:06:31.792 } 00:06:31.792 20:07:36 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:31.792 20:07:36 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:31.792 20:07:36 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:31.792 20:07:36 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:31.792 20:07:36 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:31.792 20:07:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:31.792 20:07:36 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:31.792 20:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:31.792 20:07:36 -- app/cmdline.sh@26 -- # sort 00:06:31.792 20:07:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:31.792 20:07:36 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:31.792 20:07:36 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:31.792 20:07:36 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:31.792 20:07:36 -- common/autotest_common.sh@650 -- # local es=0 00:06:31.792 20:07:36 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:31.792 20:07:36 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.792 20:07:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:31.792 20:07:36 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.792 20:07:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:31.792 20:07:36 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.792 20:07:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:31.792 20:07:36 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.792 20:07:36 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:31.792 20:07:36 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:32.049 request: 00:06:32.049 { 00:06:32.049 "method": "env_dpdk_get_mem_stats", 00:06:32.049 "req_id": 1 00:06:32.049 } 00:06:32.049 Got JSON-RPC error response 00:06:32.049 response: 00:06:32.049 { 00:06:32.049 "code": -32601, 00:06:32.049 "message": "Method not found" 00:06:32.049 } 00:06:32.049 20:07:37 -- common/autotest_common.sh@653 -- # es=1 00:06:32.049 20:07:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:32.049 20:07:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:32.049 20:07:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:32.049 20:07:37 -- app/cmdline.sh@1 -- # killprocess 3053511 00:06:32.049 20:07:37 -- common/autotest_common.sh@936 -- # '[' -z 3053511 ']' 00:06:32.050 20:07:37 -- common/autotest_common.sh@940 -- # kill -0 3053511 00:06:32.050 20:07:37 -- common/autotest_common.sh@941 -- # uname 00:06:32.050 20:07:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.050 20:07:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3053511 00:06:32.308 20:07:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.308 20:07:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.308 20:07:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3053511' 00:06:32.308 killing process with pid 3053511 00:06:32.308 20:07:37 -- common/autotest_common.sh@955 -- # kill 3053511 00:06:32.308 20:07:37 -- common/autotest_common.sh@960 -- # wait 3053511 00:06:32.567 00:06:32.567 real 0m2.401s 00:06:32.567 user 0m3.087s 00:06:32.567 sys 0m0.551s 00:06:32.567 20:07:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.567 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:32.567 ************************************ 00:06:32.567 END TEST app_cmdline 00:06:32.567 ************************************ 00:06:32.567 20:07:37 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:32.567 20:07:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:32.567 20:07:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.567 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:32.567 ************************************ 00:06:32.567 START TEST version 00:06:32.567 ************************************ 00:06:32.567 20:07:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:32.825 * Looking for test storage... 00:06:32.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:32.825 20:07:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:32.825 20:07:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:32.825 20:07:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:32.825 20:07:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:32.825 20:07:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:32.825 20:07:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:32.825 20:07:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:32.825 20:07:37 -- scripts/common.sh@335 -- # IFS=.-: 00:06:32.825 20:07:37 -- scripts/common.sh@335 -- # read -ra ver1 00:06:32.825 20:07:37 -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.826 20:07:37 -- scripts/common.sh@336 -- # read -ra ver2 00:06:32.826 20:07:37 -- scripts/common.sh@337 -- # local 'op=<' 00:06:32.826 20:07:37 -- scripts/common.sh@339 -- # ver1_l=2 00:06:32.826 20:07:37 -- scripts/common.sh@340 -- # ver2_l=1 00:06:32.826 20:07:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:32.826 20:07:37 -- scripts/common.sh@343 -- # case "$op" in 00:06:32.826 20:07:37 -- scripts/common.sh@344 -- # : 1 00:06:32.826 20:07:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:32.826 20:07:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.826 20:07:37 -- scripts/common.sh@364 -- # decimal 1 00:06:32.826 20:07:37 -- scripts/common.sh@352 -- # local d=1 00:06:32.826 20:07:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.826 20:07:37 -- scripts/common.sh@354 -- # echo 1 00:06:32.826 20:07:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:32.826 20:07:37 -- scripts/common.sh@365 -- # decimal 2 00:06:32.826 20:07:37 -- scripts/common.sh@352 -- # local d=2 00:06:32.826 20:07:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.826 20:07:37 -- scripts/common.sh@354 -- # echo 2 00:06:32.826 20:07:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:32.826 20:07:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:32.826 20:07:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:32.826 20:07:37 -- scripts/common.sh@367 -- # return 0 00:06:32.826 20:07:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.826 20:07:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:32.826 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.826 --rc genhtml_branch_coverage=1 00:06:32.826 --rc genhtml_function_coverage=1 00:06:32.826 --rc genhtml_legend=1 00:06:32.826 --rc geninfo_all_blocks=1 00:06:32.826 --rc geninfo_unexecuted_blocks=1 00:06:32.826 00:06:32.826 ' 00:06:32.826 20:07:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:32.826 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.826 --rc genhtml_branch_coverage=1 00:06:32.826 --rc genhtml_function_coverage=1 00:06:32.826 --rc genhtml_legend=1 00:06:32.826 --rc geninfo_all_blocks=1 00:06:32.826 --rc geninfo_unexecuted_blocks=1 00:06:32.826 00:06:32.826 ' 00:06:32.826 20:07:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:32.826 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.826 --rc genhtml_branch_coverage=1 00:06:32.826 --rc genhtml_function_coverage=1 00:06:32.826 --rc genhtml_legend=1 00:06:32.826 --rc geninfo_all_blocks=1 00:06:32.826 --rc geninfo_unexecuted_blocks=1 00:06:32.826 00:06:32.826 ' 00:06:32.826 20:07:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:32.826 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.826 --rc genhtml_branch_coverage=1 00:06:32.826 --rc genhtml_function_coverage=1 00:06:32.826 --rc genhtml_legend=1 00:06:32.826 --rc geninfo_all_blocks=1 00:06:32.826 --rc geninfo_unexecuted_blocks=1 00:06:32.826 00:06:32.826 ' 00:06:32.826 20:07:37 -- app/version.sh@17 -- # get_header_version major 00:06:32.826 20:07:37 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.826 20:07:37 -- app/version.sh@14 -- # cut -f2 00:06:32.826 20:07:37 -- app/version.sh@14 -- # tr -d '"' 00:06:32.826 20:07:37 -- app/version.sh@17 -- # major=24 00:06:32.826 20:07:37 -- app/version.sh@18 -- # get_header_version minor 00:06:32.826 20:07:37 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.826 20:07:37 -- app/version.sh@14 -- # cut -f2 00:06:32.826 20:07:37 -- app/version.sh@14 -- # tr -d '"' 00:06:32.826 20:07:37 -- app/version.sh@18 -- # minor=1 00:06:32.826 20:07:37 -- app/version.sh@19 -- # get_header_version patch 00:06:32.826 20:07:37 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.826 20:07:37 -- app/version.sh@14 -- # cut -f2 00:06:32.826 20:07:37 -- app/version.sh@14 -- # tr -d '"' 00:06:32.826 20:07:37 -- app/version.sh@19 -- # patch=1 00:06:32.826 20:07:37 -- app/version.sh@20 -- # get_header_version suffix 00:06:32.826 20:07:37 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.826 20:07:37 -- app/version.sh@14 -- # cut -f2 00:06:32.826 20:07:37 -- app/version.sh@14 -- # tr -d '"' 00:06:32.826 20:07:37 -- app/version.sh@20 -- # suffix=-pre 00:06:32.826 20:07:37 -- app/version.sh@22 -- # version=24.1 00:06:32.826 20:07:37 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:32.826 20:07:37 -- app/version.sh@25 -- # version=24.1.1 00:06:32.826 20:07:37 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:32.826 20:07:37 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:32.826 20:07:37 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:32.826 20:07:37 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:32.826 20:07:37 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:32.826 00:06:32.826 real 0m0.203s 00:06:32.826 user 0m0.132s 00:06:32.826 sys 0m0.097s 00:06:32.826 20:07:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.826 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:32.826 ************************************ 00:06:32.826 END TEST version 00:06:32.826 ************************************ 00:06:32.826 20:07:37 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@191 -- # uname -s 00:06:32.826 20:07:37 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:32.826 20:07:37 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:32.826 20:07:37 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:32.826 20:07:37 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:32.826 20:07:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:32.826 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:32.826 20:07:37 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:32.826 20:07:37 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:32.826 20:07:37 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:32.826 20:07:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:32.826 20:07:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.826 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:32.826 ************************************ 00:06:32.826 START TEST nvmf_tcp 00:06:32.826 ************************************ 00:06:32.826 20:07:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:33.087 * Looking for test storage... 00:06:33.087 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:33.087 20:07:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:33.087 20:07:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:33.087 20:07:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:33.087 20:07:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:33.087 20:07:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:33.087 20:07:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:33.087 20:07:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:33.087 20:07:37 -- scripts/common.sh@335 -- # IFS=.-: 00:06:33.087 20:07:37 -- scripts/common.sh@335 -- # read -ra ver1 00:06:33.087 20:07:37 -- scripts/common.sh@336 -- # IFS=.-: 00:06:33.087 20:07:37 -- scripts/common.sh@336 -- # read -ra ver2 00:06:33.087 20:07:37 -- scripts/common.sh@337 -- # local 'op=<' 00:06:33.087 20:07:37 -- scripts/common.sh@339 -- # ver1_l=2 00:06:33.087 20:07:37 -- scripts/common.sh@340 -- # ver2_l=1 00:06:33.087 20:07:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:33.087 20:07:37 -- scripts/common.sh@343 -- # case "$op" in 00:06:33.087 20:07:37 -- scripts/common.sh@344 -- # : 1 00:06:33.087 20:07:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:33.087 20:07:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:33.087 20:07:37 -- scripts/common.sh@364 -- # decimal 1 00:06:33.087 20:07:37 -- scripts/common.sh@352 -- # local d=1 00:06:33.087 20:07:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:33.087 20:07:37 -- scripts/common.sh@354 -- # echo 1 00:06:33.087 20:07:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:33.087 20:07:37 -- scripts/common.sh@365 -- # decimal 2 00:06:33.087 20:07:37 -- scripts/common.sh@352 -- # local d=2 00:06:33.087 20:07:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:33.087 20:07:37 -- scripts/common.sh@354 -- # echo 2 00:06:33.087 20:07:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:33.087 20:07:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:33.087 20:07:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:33.087 20:07:37 -- scripts/common.sh@367 -- # return 0 00:06:33.087 20:07:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:33.087 20:07:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:33.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.087 --rc genhtml_branch_coverage=1 00:06:33.087 --rc genhtml_function_coverage=1 00:06:33.087 --rc genhtml_legend=1 00:06:33.087 --rc geninfo_all_blocks=1 00:06:33.087 --rc geninfo_unexecuted_blocks=1 00:06:33.087 00:06:33.087 ' 00:06:33.087 20:07:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:33.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.087 --rc genhtml_branch_coverage=1 00:06:33.087 --rc genhtml_function_coverage=1 00:06:33.087 --rc genhtml_legend=1 00:06:33.087 --rc geninfo_all_blocks=1 00:06:33.087 --rc geninfo_unexecuted_blocks=1 00:06:33.087 00:06:33.087 ' 00:06:33.087 20:07:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:33.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.087 --rc genhtml_branch_coverage=1 00:06:33.087 --rc genhtml_function_coverage=1 00:06:33.087 --rc genhtml_legend=1 00:06:33.087 --rc geninfo_all_blocks=1 00:06:33.087 --rc geninfo_unexecuted_blocks=1 00:06:33.087 00:06:33.087 ' 00:06:33.087 20:07:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:33.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.087 --rc genhtml_branch_coverage=1 00:06:33.087 --rc genhtml_function_coverage=1 00:06:33.087 --rc genhtml_legend=1 00:06:33.087 --rc geninfo_all_blocks=1 00:06:33.087 --rc geninfo_unexecuted_blocks=1 00:06:33.087 00:06:33.087 ' 00:06:33.087 20:07:37 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:33.087 20:07:37 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:33.087 20:07:37 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:33.087 20:07:37 -- nvmf/common.sh@7 -- # uname -s 00:06:33.087 20:07:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:33.087 20:07:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:33.087 20:07:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:33.087 20:07:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:33.087 20:07:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:33.087 20:07:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:33.087 20:07:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:33.087 20:07:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:33.087 20:07:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:33.087 20:07:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:33.087 20:07:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.087 20:07:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.087 20:07:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:33.087 20:07:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:33.087 20:07:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:33.087 20:07:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:33.087 20:07:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:33.087 20:07:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:33.087 20:07:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:33.087 20:07:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.087 20:07:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.087 20:07:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.088 20:07:37 -- paths/export.sh@5 -- # export PATH 00:06:33.088 20:07:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.088 20:07:37 -- nvmf/common.sh@46 -- # : 0 00:06:33.088 20:07:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:33.088 20:07:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:33.088 20:07:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:33.088 20:07:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:33.088 20:07:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:33.088 20:07:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:33.088 20:07:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:33.088 20:07:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:33.088 20:07:37 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:33.088 20:07:37 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:33.088 20:07:37 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:33.088 20:07:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:33.088 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:33.088 20:07:37 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:33.088 20:07:37 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:33.088 20:07:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:33.088 20:07:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.088 20:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:33.088 ************************************ 00:06:33.088 START TEST nvmf_example 00:06:33.088 ************************************ 00:06:33.088 20:07:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:33.088 * Looking for test storage... 00:06:33.088 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:33.088 20:07:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:33.088 20:07:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:33.088 20:07:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:33.384 20:07:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:33.384 20:07:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:33.384 20:07:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:33.384 20:07:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:33.384 20:07:38 -- scripts/common.sh@335 -- # IFS=.-: 00:06:33.384 20:07:38 -- scripts/common.sh@335 -- # read -ra ver1 00:06:33.384 20:07:38 -- scripts/common.sh@336 -- # IFS=.-: 00:06:33.384 20:07:38 -- scripts/common.sh@336 -- # read -ra ver2 00:06:33.384 20:07:38 -- scripts/common.sh@337 -- # local 'op=<' 00:06:33.384 20:07:38 -- scripts/common.sh@339 -- # ver1_l=2 00:06:33.384 20:07:38 -- scripts/common.sh@340 -- # ver2_l=1 00:06:33.384 20:07:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:33.384 20:07:38 -- scripts/common.sh@343 -- # case "$op" in 00:06:33.384 20:07:38 -- scripts/common.sh@344 -- # : 1 00:06:33.384 20:07:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:33.384 20:07:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:33.384 20:07:38 -- scripts/common.sh@364 -- # decimal 1 00:06:33.384 20:07:38 -- scripts/common.sh@352 -- # local d=1 00:06:33.384 20:07:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:33.384 20:07:38 -- scripts/common.sh@354 -- # echo 1 00:06:33.384 20:07:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:33.384 20:07:38 -- scripts/common.sh@365 -- # decimal 2 00:06:33.384 20:07:38 -- scripts/common.sh@352 -- # local d=2 00:06:33.384 20:07:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:33.384 20:07:38 -- scripts/common.sh@354 -- # echo 2 00:06:33.384 20:07:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:33.384 20:07:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:33.384 20:07:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:33.384 20:07:38 -- scripts/common.sh@367 -- # return 0 00:06:33.384 20:07:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:33.384 20:07:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:33.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.384 --rc genhtml_branch_coverage=1 00:06:33.384 --rc genhtml_function_coverage=1 00:06:33.384 --rc genhtml_legend=1 00:06:33.384 --rc geninfo_all_blocks=1 00:06:33.384 --rc geninfo_unexecuted_blocks=1 00:06:33.384 00:06:33.384 ' 00:06:33.384 20:07:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:33.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.385 --rc genhtml_branch_coverage=1 00:06:33.385 --rc genhtml_function_coverage=1 00:06:33.385 --rc genhtml_legend=1 00:06:33.385 --rc geninfo_all_blocks=1 00:06:33.385 --rc geninfo_unexecuted_blocks=1 00:06:33.385 00:06:33.385 ' 00:06:33.385 20:07:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:33.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.385 --rc genhtml_branch_coverage=1 00:06:33.385 --rc genhtml_function_coverage=1 00:06:33.385 --rc genhtml_legend=1 00:06:33.385 --rc geninfo_all_blocks=1 00:06:33.385 --rc geninfo_unexecuted_blocks=1 00:06:33.385 00:06:33.385 ' 00:06:33.385 20:07:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:33.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.385 --rc genhtml_branch_coverage=1 00:06:33.385 --rc genhtml_function_coverage=1 00:06:33.385 --rc genhtml_legend=1 00:06:33.385 --rc geninfo_all_blocks=1 00:06:33.385 --rc geninfo_unexecuted_blocks=1 00:06:33.385 00:06:33.385 ' 00:06:33.385 20:07:38 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:33.385 20:07:38 -- nvmf/common.sh@7 -- # uname -s 00:06:33.385 20:07:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:33.385 20:07:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:33.385 20:07:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:33.385 20:07:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:33.385 20:07:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:33.385 20:07:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:33.385 20:07:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:33.385 20:07:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:33.385 20:07:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:33.385 20:07:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:33.385 20:07:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.385 20:07:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.385 20:07:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:33.385 20:07:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:33.385 20:07:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:33.385 20:07:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:33.385 20:07:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:33.385 20:07:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:33.385 20:07:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:33.385 20:07:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.385 20:07:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.385 20:07:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.385 20:07:38 -- paths/export.sh@5 -- # export PATH 00:06:33.385 20:07:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.385 20:07:38 -- nvmf/common.sh@46 -- # : 0 00:06:33.385 20:07:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:33.385 20:07:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:33.385 20:07:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:33.385 20:07:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:33.385 20:07:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:33.385 20:07:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:33.385 20:07:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:33.385 20:07:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:33.385 20:07:38 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:33.385 20:07:38 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:33.385 20:07:38 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:33.385 20:07:38 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:33.385 20:07:38 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:33.385 20:07:38 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:33.385 20:07:38 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:33.385 20:07:38 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:33.385 20:07:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:33.385 20:07:38 -- common/autotest_common.sh@10 -- # set +x 00:06:33.385 20:07:38 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:33.385 20:07:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:33.385 20:07:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:33.385 20:07:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:33.385 20:07:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:33.385 20:07:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:33.385 20:07:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:33.385 20:07:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:33.385 20:07:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:33.385 20:07:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:33.385 20:07:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:33.385 20:07:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:33.385 20:07:38 -- common/autotest_common.sh@10 -- # set +x 00:06:35.323 20:07:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:35.323 20:07:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:35.323 20:07:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:35.323 20:07:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:35.323 20:07:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:35.323 20:07:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:35.323 20:07:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:35.323 20:07:40 -- nvmf/common.sh@294 -- # net_devs=() 00:06:35.323 20:07:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:35.323 20:07:40 -- nvmf/common.sh@295 -- # e810=() 00:06:35.323 20:07:40 -- nvmf/common.sh@295 -- # local -ga e810 00:06:35.323 20:07:40 -- nvmf/common.sh@296 -- # x722=() 00:06:35.323 20:07:40 -- nvmf/common.sh@296 -- # local -ga x722 00:06:35.323 20:07:40 -- nvmf/common.sh@297 -- # mlx=() 00:06:35.323 20:07:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:35.323 20:07:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:35.323 20:07:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:35.323 20:07:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:35.323 20:07:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:35.323 20:07:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:35.323 20:07:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:35.323 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:35.323 20:07:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:35.323 20:07:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:35.323 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:35.323 20:07:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:35.323 20:07:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:35.324 20:07:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:35.324 20:07:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:35.324 20:07:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:35.324 20:07:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:35.324 20:07:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:35.324 20:07:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:35.324 20:07:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:35.324 20:07:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:35.324 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:35.324 20:07:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:35.324 20:07:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:35.324 20:07:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:35.324 20:07:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:35.324 20:07:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:35.324 20:07:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:35.324 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:35.324 20:07:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:35.324 20:07:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:35.324 20:07:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:35.324 20:07:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:35.324 20:07:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:35.324 20:07:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:35.324 20:07:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:35.324 20:07:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:35.324 20:07:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:35.324 20:07:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:35.324 20:07:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:35.324 20:07:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:35.324 20:07:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:35.324 20:07:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:35.324 20:07:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:35.324 20:07:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:35.324 20:07:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:35.324 20:07:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:35.324 20:07:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:35.324 20:07:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:35.324 20:07:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:35.324 20:07:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:35.582 20:07:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:35.582 20:07:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:35.582 20:07:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:35.582 20:07:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:35.582 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:35.582 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:06:35.582 00:06:35.582 --- 10.0.0.2 ping statistics --- 00:06:35.582 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:35.582 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:06:35.582 20:07:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:35.582 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:35.582 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:06:35.582 00:06:35.582 --- 10.0.0.1 ping statistics --- 00:06:35.582 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:35.582 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:06:35.582 20:07:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:35.582 20:07:40 -- nvmf/common.sh@410 -- # return 0 00:06:35.582 20:07:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:35.582 20:07:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:35.582 20:07:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:35.582 20:07:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:35.582 20:07:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:35.582 20:07:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:35.582 20:07:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:35.582 20:07:40 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:35.582 20:07:40 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:35.582 20:07:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:35.582 20:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:35.582 20:07:40 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:35.582 20:07:40 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:35.582 20:07:40 -- target/nvmf_example.sh@34 -- # nvmfpid=3055697 00:06:35.582 20:07:40 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:35.582 20:07:40 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:35.582 20:07:40 -- target/nvmf_example.sh@36 -- # waitforlisten 3055697 00:06:35.582 20:07:40 -- common/autotest_common.sh@829 -- # '[' -z 3055697 ']' 00:06:35.582 20:07:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.582 20:07:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:35.582 20:07:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.582 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.582 20:07:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:35.582 20:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:35.582 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.515 20:07:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.515 20:07:41 -- common/autotest_common.sh@862 -- # return 0 00:06:36.515 20:07:41 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:36.515 20:07:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:36.515 20:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:36.515 20:07:41 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:36.515 20:07:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.515 20:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:36.773 20:07:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.773 20:07:41 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:36.773 20:07:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.773 20:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:36.773 20:07:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.773 20:07:41 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:36.773 20:07:41 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:36.773 20:07:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.773 20:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:36.773 20:07:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.773 20:07:41 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:36.773 20:07:41 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:36.773 20:07:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.773 20:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:36.773 20:07:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.773 20:07:41 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:36.773 20:07:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.773 20:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:36.773 20:07:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.773 20:07:41 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:36.773 20:07:41 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:36.773 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.737 Initializing NVMe Controllers 00:06:46.737 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:46.737 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:46.737 Initialization complete. Launching workers. 00:06:46.737 ======================================================== 00:06:46.737 Latency(us) 00:06:46.737 Device Information : IOPS MiB/s Average min max 00:06:46.737 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15565.80 60.80 4112.49 742.02 15681.77 00:06:46.737 ======================================================== 00:06:46.737 Total : 15565.80 60.80 4112.49 742.02 15681.77 00:06:46.737 00:06:46.737 20:07:51 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:46.737 20:07:51 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:46.738 20:07:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:46.738 20:07:51 -- nvmf/common.sh@116 -- # sync 00:06:46.738 20:07:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:46.738 20:07:51 -- nvmf/common.sh@119 -- # set +e 00:06:46.738 20:07:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:46.738 20:07:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:46.738 rmmod nvme_tcp 00:06:46.995 rmmod nvme_fabrics 00:06:46.995 rmmod nvme_keyring 00:06:46.996 20:07:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:46.996 20:07:51 -- nvmf/common.sh@123 -- # set -e 00:06:46.996 20:07:51 -- nvmf/common.sh@124 -- # return 0 00:06:46.996 20:07:51 -- nvmf/common.sh@477 -- # '[' -n 3055697 ']' 00:06:46.996 20:07:51 -- nvmf/common.sh@478 -- # killprocess 3055697 00:06:46.996 20:07:51 -- common/autotest_common.sh@936 -- # '[' -z 3055697 ']' 00:06:46.996 20:07:51 -- common/autotest_common.sh@940 -- # kill -0 3055697 00:06:46.996 20:07:51 -- common/autotest_common.sh@941 -- # uname 00:06:46.996 20:07:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:46.996 20:07:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3055697 00:06:46.996 20:07:51 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:46.996 20:07:51 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:46.996 20:07:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3055697' 00:06:46.996 killing process with pid 3055697 00:06:46.996 20:07:51 -- common/autotest_common.sh@955 -- # kill 3055697 00:06:46.996 20:07:51 -- common/autotest_common.sh@960 -- # wait 3055697 00:06:47.255 nvmf threads initialize successfully 00:06:47.255 bdev subsystem init successfully 00:06:47.255 created a nvmf target service 00:06:47.255 create targets's poll groups done 00:06:47.255 all subsystems of target started 00:06:47.255 nvmf target is running 00:06:47.255 all subsystems of target stopped 00:06:47.255 destroy targets's poll groups done 00:06:47.255 destroyed the nvmf target service 00:06:47.255 bdev subsystem finish successfully 00:06:47.255 nvmf threads destroy successfully 00:06:47.255 20:07:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:47.255 20:07:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:47.255 20:07:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:47.255 20:07:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:47.255 20:07:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:47.255 20:07:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:47.255 20:07:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:47.255 20:07:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:49.162 20:07:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:49.162 20:07:54 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:49.162 20:07:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:49.162 20:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:49.162 00:06:49.162 real 0m16.180s 00:06:49.162 user 0m45.493s 00:06:49.162 sys 0m3.382s 00:06:49.162 20:07:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.162 20:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:49.162 ************************************ 00:06:49.162 END TEST nvmf_example 00:06:49.162 ************************************ 00:06:49.422 20:07:54 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:49.422 20:07:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:49.422 20:07:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.422 20:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:49.422 ************************************ 00:06:49.422 START TEST nvmf_filesystem 00:06:49.422 ************************************ 00:06:49.422 20:07:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:49.422 * Looking for test storage... 00:06:49.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.422 20:07:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:49.422 20:07:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:49.422 20:07:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:49.422 20:07:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:49.422 20:07:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:49.422 20:07:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:49.422 20:07:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:49.422 20:07:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:49.422 20:07:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:49.422 20:07:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:49.422 20:07:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:49.422 20:07:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:49.422 20:07:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:49.422 20:07:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:49.422 20:07:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:49.422 20:07:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:49.422 20:07:54 -- scripts/common.sh@344 -- # : 1 00:06:49.422 20:07:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:49.422 20:07:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:49.422 20:07:54 -- scripts/common.sh@364 -- # decimal 1 00:06:49.422 20:07:54 -- scripts/common.sh@352 -- # local d=1 00:06:49.422 20:07:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:49.422 20:07:54 -- scripts/common.sh@354 -- # echo 1 00:06:49.422 20:07:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:49.422 20:07:54 -- scripts/common.sh@365 -- # decimal 2 00:06:49.422 20:07:54 -- scripts/common.sh@352 -- # local d=2 00:06:49.422 20:07:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:49.422 20:07:54 -- scripts/common.sh@354 -- # echo 2 00:06:49.422 20:07:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:49.422 20:07:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:49.422 20:07:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:49.422 20:07:54 -- scripts/common.sh@367 -- # return 0 00:06:49.422 20:07:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:49.422 20:07:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:49.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.422 --rc genhtml_branch_coverage=1 00:06:49.422 --rc genhtml_function_coverage=1 00:06:49.422 --rc genhtml_legend=1 00:06:49.422 --rc geninfo_all_blocks=1 00:06:49.422 --rc geninfo_unexecuted_blocks=1 00:06:49.422 00:06:49.422 ' 00:06:49.422 20:07:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:49.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.422 --rc genhtml_branch_coverage=1 00:06:49.422 --rc genhtml_function_coverage=1 00:06:49.422 --rc genhtml_legend=1 00:06:49.422 --rc geninfo_all_blocks=1 00:06:49.422 --rc geninfo_unexecuted_blocks=1 00:06:49.422 00:06:49.422 ' 00:06:49.422 20:07:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:49.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.422 --rc genhtml_branch_coverage=1 00:06:49.422 --rc genhtml_function_coverage=1 00:06:49.422 --rc genhtml_legend=1 00:06:49.422 --rc geninfo_all_blocks=1 00:06:49.422 --rc geninfo_unexecuted_blocks=1 00:06:49.423 00:06:49.423 ' 00:06:49.423 20:07:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:49.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.423 --rc genhtml_branch_coverage=1 00:06:49.423 --rc genhtml_function_coverage=1 00:06:49.423 --rc genhtml_legend=1 00:06:49.423 --rc geninfo_all_blocks=1 00:06:49.423 --rc geninfo_unexecuted_blocks=1 00:06:49.423 00:06:49.423 ' 00:06:49.423 20:07:54 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:49.423 20:07:54 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:49.423 20:07:54 -- common/autotest_common.sh@34 -- # set -e 00:06:49.423 20:07:54 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:49.423 20:07:54 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:49.423 20:07:54 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:49.423 20:07:54 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:49.423 20:07:54 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:49.423 20:07:54 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:49.423 20:07:54 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:49.423 20:07:54 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:49.423 20:07:54 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:49.423 20:07:54 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:49.423 20:07:54 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:49.423 20:07:54 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:49.423 20:07:54 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:49.423 20:07:54 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:49.423 20:07:54 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:49.423 20:07:54 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:49.423 20:07:54 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:49.423 20:07:54 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:49.423 20:07:54 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:49.423 20:07:54 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:49.423 20:07:54 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:49.423 20:07:54 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:49.423 20:07:54 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:49.423 20:07:54 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:49.423 20:07:54 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:49.423 20:07:54 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:49.423 20:07:54 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:49.423 20:07:54 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:49.423 20:07:54 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:49.423 20:07:54 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:49.423 20:07:54 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:49.423 20:07:54 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:49.423 20:07:54 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:49.423 20:07:54 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:49.423 20:07:54 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:49.423 20:07:54 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:49.423 20:07:54 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:49.423 20:07:54 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:49.423 20:07:54 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:49.423 20:07:54 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:49.423 20:07:54 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:49.423 20:07:54 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:49.423 20:07:54 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:49.423 20:07:54 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:49.423 20:07:54 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:49.423 20:07:54 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:49.423 20:07:54 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:49.423 20:07:54 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:49.423 20:07:54 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:49.423 20:07:54 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:49.423 20:07:54 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:49.423 20:07:54 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:49.423 20:07:54 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:49.423 20:07:54 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:49.423 20:07:54 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:49.423 20:07:54 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:49.423 20:07:54 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:49.423 20:07:54 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:49.423 20:07:54 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:49.423 20:07:54 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:49.423 20:07:54 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:49.423 20:07:54 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:49.423 20:07:54 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:49.423 20:07:54 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:49.423 20:07:54 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:49.423 20:07:54 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:49.423 20:07:54 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:49.423 20:07:54 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:49.423 20:07:54 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:49.423 20:07:54 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:49.423 20:07:54 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:49.423 20:07:54 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:49.423 20:07:54 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:49.423 20:07:54 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:49.423 20:07:54 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:49.423 20:07:54 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:49.423 20:07:54 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:49.423 20:07:54 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:49.423 20:07:54 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:49.423 20:07:54 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:49.423 20:07:54 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:49.423 20:07:54 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:49.423 20:07:54 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:49.423 20:07:54 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:49.423 20:07:54 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:49.423 20:07:54 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:49.423 20:07:54 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:49.423 20:07:54 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:49.423 20:07:54 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:49.423 20:07:54 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:49.423 20:07:54 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:49.423 20:07:54 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:49.423 20:07:54 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:49.423 #define SPDK_CONFIG_H 00:06:49.423 #define SPDK_CONFIG_APPS 1 00:06:49.423 #define SPDK_CONFIG_ARCH native 00:06:49.423 #undef SPDK_CONFIG_ASAN 00:06:49.423 #undef SPDK_CONFIG_AVAHI 00:06:49.423 #undef SPDK_CONFIG_CET 00:06:49.423 #define SPDK_CONFIG_COVERAGE 1 00:06:49.423 #define SPDK_CONFIG_CROSS_PREFIX 00:06:49.423 #undef SPDK_CONFIG_CRYPTO 00:06:49.423 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:49.423 #undef SPDK_CONFIG_CUSTOMOCF 00:06:49.423 #undef SPDK_CONFIG_DAOS 00:06:49.423 #define SPDK_CONFIG_DAOS_DIR 00:06:49.423 #define SPDK_CONFIG_DEBUG 1 00:06:49.423 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:49.423 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:49.423 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:49.423 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:49.423 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:49.423 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:49.423 #define SPDK_CONFIG_EXAMPLES 1 00:06:49.423 #undef SPDK_CONFIG_FC 00:06:49.423 #define SPDK_CONFIG_FC_PATH 00:06:49.423 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:49.423 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:49.423 #undef SPDK_CONFIG_FUSE 00:06:49.423 #undef SPDK_CONFIG_FUZZER 00:06:49.423 #define SPDK_CONFIG_FUZZER_LIB 00:06:49.423 #undef SPDK_CONFIG_GOLANG 00:06:49.423 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:49.423 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:49.423 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:49.423 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:49.423 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:49.423 #define SPDK_CONFIG_IDXD 1 00:06:49.423 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:49.423 #undef SPDK_CONFIG_IPSEC_MB 00:06:49.423 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:49.423 #define SPDK_CONFIG_ISAL 1 00:06:49.423 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:49.423 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:49.423 #define SPDK_CONFIG_LIBDIR 00:06:49.423 #undef SPDK_CONFIG_LTO 00:06:49.423 #define SPDK_CONFIG_MAX_LCORES 00:06:49.423 #define SPDK_CONFIG_NVME_CUSE 1 00:06:49.423 #undef SPDK_CONFIG_OCF 00:06:49.423 #define SPDK_CONFIG_OCF_PATH 00:06:49.423 #define SPDK_CONFIG_OPENSSL_PATH 00:06:49.423 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:49.423 #undef SPDK_CONFIG_PGO_USE 00:06:49.424 #define SPDK_CONFIG_PREFIX /usr/local 00:06:49.424 #undef SPDK_CONFIG_RAID5F 00:06:49.424 #undef SPDK_CONFIG_RBD 00:06:49.424 #define SPDK_CONFIG_RDMA 1 00:06:49.424 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:49.424 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:49.424 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:49.424 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:49.424 #define SPDK_CONFIG_SHARED 1 00:06:49.424 #undef SPDK_CONFIG_SMA 00:06:49.424 #define SPDK_CONFIG_TESTS 1 00:06:49.424 #undef SPDK_CONFIG_TSAN 00:06:49.424 #define SPDK_CONFIG_UBLK 1 00:06:49.424 #define SPDK_CONFIG_UBSAN 1 00:06:49.424 #undef SPDK_CONFIG_UNIT_TESTS 00:06:49.424 #undef SPDK_CONFIG_URING 00:06:49.424 #define SPDK_CONFIG_URING_PATH 00:06:49.424 #undef SPDK_CONFIG_URING_ZNS 00:06:49.424 #undef SPDK_CONFIG_USDT 00:06:49.424 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:49.424 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:49.424 #undef SPDK_CONFIG_VFIO_USER 00:06:49.424 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:49.424 #define SPDK_CONFIG_VHOST 1 00:06:49.424 #define SPDK_CONFIG_VIRTIO 1 00:06:49.424 #undef SPDK_CONFIG_VTUNE 00:06:49.424 #define SPDK_CONFIG_VTUNE_DIR 00:06:49.424 #define SPDK_CONFIG_WERROR 1 00:06:49.424 #define SPDK_CONFIG_WPDK_DIR 00:06:49.424 #undef SPDK_CONFIG_XNVME 00:06:49.424 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:49.424 20:07:54 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:49.424 20:07:54 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:49.424 20:07:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:49.424 20:07:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:49.424 20:07:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:49.424 20:07:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.424 20:07:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.424 20:07:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.424 20:07:54 -- paths/export.sh@5 -- # export PATH 00:06:49.424 20:07:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.424 20:07:54 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:49.424 20:07:54 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:49.424 20:07:54 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:49.424 20:07:54 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:49.424 20:07:54 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:49.424 20:07:54 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:49.424 20:07:54 -- pm/common@16 -- # TEST_TAG=N/A 00:06:49.424 20:07:54 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:49.424 20:07:54 -- common/autotest_common.sh@52 -- # : 1 00:06:49.424 20:07:54 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:49.424 20:07:54 -- common/autotest_common.sh@56 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:49.424 20:07:54 -- common/autotest_common.sh@58 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:49.424 20:07:54 -- common/autotest_common.sh@60 -- # : 1 00:06:49.424 20:07:54 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:49.424 20:07:54 -- common/autotest_common.sh@62 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:49.424 20:07:54 -- common/autotest_common.sh@64 -- # : 00:06:49.424 20:07:54 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:49.424 20:07:54 -- common/autotest_common.sh@66 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:49.424 20:07:54 -- common/autotest_common.sh@68 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:49.424 20:07:54 -- common/autotest_common.sh@70 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:49.424 20:07:54 -- common/autotest_common.sh@72 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:49.424 20:07:54 -- common/autotest_common.sh@74 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:49.424 20:07:54 -- common/autotest_common.sh@76 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:49.424 20:07:54 -- common/autotest_common.sh@78 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:49.424 20:07:54 -- common/autotest_common.sh@80 -- # : 1 00:06:49.424 20:07:54 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:49.424 20:07:54 -- common/autotest_common.sh@82 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:49.424 20:07:54 -- common/autotest_common.sh@84 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:49.424 20:07:54 -- common/autotest_common.sh@86 -- # : 1 00:06:49.424 20:07:54 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:49.424 20:07:54 -- common/autotest_common.sh@88 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:49.424 20:07:54 -- common/autotest_common.sh@90 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:49.424 20:07:54 -- common/autotest_common.sh@92 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:49.424 20:07:54 -- common/autotest_common.sh@94 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:49.424 20:07:54 -- common/autotest_common.sh@96 -- # : tcp 00:06:49.424 20:07:54 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:49.424 20:07:54 -- common/autotest_common.sh@98 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:49.424 20:07:54 -- common/autotest_common.sh@100 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:49.424 20:07:54 -- common/autotest_common.sh@102 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:49.424 20:07:54 -- common/autotest_common.sh@104 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:49.424 20:07:54 -- common/autotest_common.sh@106 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:49.424 20:07:54 -- common/autotest_common.sh@108 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:49.424 20:07:54 -- common/autotest_common.sh@110 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:49.424 20:07:54 -- common/autotest_common.sh@112 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:49.424 20:07:54 -- common/autotest_common.sh@114 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:49.424 20:07:54 -- common/autotest_common.sh@116 -- # : 1 00:06:49.424 20:07:54 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:49.424 20:07:54 -- common/autotest_common.sh@118 -- # : 00:06:49.424 20:07:54 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:49.424 20:07:54 -- common/autotest_common.sh@120 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:49.424 20:07:54 -- common/autotest_common.sh@122 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:49.424 20:07:54 -- common/autotest_common.sh@124 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:49.424 20:07:54 -- common/autotest_common.sh@126 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:49.424 20:07:54 -- common/autotest_common.sh@128 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:49.424 20:07:54 -- common/autotest_common.sh@130 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:49.424 20:07:54 -- common/autotest_common.sh@132 -- # : 00:06:49.424 20:07:54 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:49.424 20:07:54 -- common/autotest_common.sh@134 -- # : true 00:06:49.424 20:07:54 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:49.424 20:07:54 -- common/autotest_common.sh@136 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:49.424 20:07:54 -- common/autotest_common.sh@138 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:49.424 20:07:54 -- common/autotest_common.sh@140 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:49.424 20:07:54 -- common/autotest_common.sh@142 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:49.424 20:07:54 -- common/autotest_common.sh@144 -- # : 0 00:06:49.424 20:07:54 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:49.425 20:07:54 -- common/autotest_common.sh@146 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:49.425 20:07:54 -- common/autotest_common.sh@148 -- # : e810 00:06:49.425 20:07:54 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:49.425 20:07:54 -- common/autotest_common.sh@150 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:49.425 20:07:54 -- common/autotest_common.sh@152 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:49.425 20:07:54 -- common/autotest_common.sh@154 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:49.425 20:07:54 -- common/autotest_common.sh@156 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:49.425 20:07:54 -- common/autotest_common.sh@158 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:49.425 20:07:54 -- common/autotest_common.sh@160 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:49.425 20:07:54 -- common/autotest_common.sh@163 -- # : 00:06:49.425 20:07:54 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:49.425 20:07:54 -- common/autotest_common.sh@165 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:49.425 20:07:54 -- common/autotest_common.sh@167 -- # : 0 00:06:49.425 20:07:54 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:49.425 20:07:54 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.425 20:07:54 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:49.425 20:07:54 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:49.425 20:07:54 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:49.425 20:07:54 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:49.425 20:07:54 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:49.425 20:07:54 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:49.425 20:07:54 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:49.425 20:07:54 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:49.425 20:07:54 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:49.425 20:07:54 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:49.425 20:07:54 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:49.425 20:07:54 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:49.425 20:07:54 -- common/autotest_common.sh@196 -- # cat 00:06:49.425 20:07:54 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:49.425 20:07:54 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:49.425 20:07:54 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:49.425 20:07:54 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:49.425 20:07:54 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:49.425 20:07:54 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:49.425 20:07:54 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:49.425 20:07:54 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:49.425 20:07:54 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:49.425 20:07:54 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:49.425 20:07:54 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:49.425 20:07:54 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:49.425 20:07:54 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:49.425 20:07:54 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:49.425 20:07:54 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:49.425 20:07:54 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:49.425 20:07:54 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:49.425 20:07:54 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:49.425 20:07:54 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:49.425 20:07:54 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:49.425 20:07:54 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:49.425 20:07:54 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:49.425 20:07:54 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:49.425 20:07:54 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:49.425 20:07:54 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:49.425 20:07:54 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:49.425 20:07:54 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:49.425 20:07:54 -- common/autotest_common.sh@259 -- # valgrind= 00:06:49.425 20:07:54 -- common/autotest_common.sh@265 -- # uname -s 00:06:49.425 20:07:54 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:49.425 20:07:54 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:49.425 20:07:54 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:49.425 20:07:54 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:49.425 20:07:54 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:49.425 20:07:54 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:49.425 20:07:54 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:49.425 20:07:54 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:49.425 20:07:54 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:49.425 20:07:54 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:49.425 20:07:54 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:49.425 20:07:54 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:49.425 20:07:54 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:49.425 20:07:54 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:49.425 20:07:54 -- common/autotest_common.sh@319 -- # [[ -z 3057451 ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@319 -- # kill -0 3057451 00:06:49.425 20:07:54 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:49.425 20:07:54 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:49.425 20:07:54 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:49.425 20:07:54 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:49.425 20:07:54 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:49.425 20:07:54 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:49.425 20:07:54 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:49.425 20:07:54 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.88NMsn 00:06:49.425 20:07:54 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:49.425 20:07:54 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:49.425 20:07:54 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.88NMsn/tests/target /tmp/spdk.88NMsn 00:06:49.425 20:07:54 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:49.425 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.425 20:07:54 -- common/autotest_common.sh@328 -- # df -T 00:06:49.425 20:07:54 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=55290368000 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=6698160128 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991671296 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993260544 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=1003520 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:49.426 20:07:54 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:49.426 20:07:54 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:49.426 20:07:54 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.426 20:07:54 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:49.426 * Looking for test storage... 00:06:49.426 20:07:54 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:49.426 20:07:54 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:49.426 20:07:54 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.426 20:07:54 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:49.426 20:07:54 -- common/autotest_common.sh@373 -- # mount=/ 00:06:49.426 20:07:54 -- common/autotest_common.sh@375 -- # target_space=55290368000 00:06:49.426 20:07:54 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:49.426 20:07:54 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:49.426 20:07:54 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:49.426 20:07:54 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:49.426 20:07:54 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:49.426 20:07:54 -- common/autotest_common.sh@382 -- # new_size=8912752640 00:06:49.426 20:07:54 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:49.426 20:07:54 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.426 20:07:54 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.426 20:07:54 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.426 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.426 20:07:54 -- common/autotest_common.sh@390 -- # return 0 00:06:49.426 20:07:54 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:49.426 20:07:54 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:49.426 20:07:54 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:49.426 20:07:54 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:49.426 20:07:54 -- common/autotest_common.sh@1682 -- # true 00:06:49.426 20:07:54 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:49.426 20:07:54 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:49.426 20:07:54 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:49.426 20:07:54 -- common/autotest_common.sh@27 -- # exec 00:06:49.426 20:07:54 -- common/autotest_common.sh@29 -- # exec 00:06:49.426 20:07:54 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:49.426 20:07:54 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:49.426 20:07:54 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:49.426 20:07:54 -- common/autotest_common.sh@18 -- # set -x 00:06:49.426 20:07:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:49.426 20:07:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:49.426 20:07:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:49.686 20:07:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:49.686 20:07:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:49.686 20:07:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:49.686 20:07:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:49.686 20:07:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:49.686 20:07:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:49.686 20:07:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:49.686 20:07:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:49.686 20:07:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:49.686 20:07:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:49.686 20:07:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:49.686 20:07:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:49.686 20:07:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:49.686 20:07:54 -- scripts/common.sh@344 -- # : 1 00:06:49.686 20:07:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:49.686 20:07:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:49.686 20:07:54 -- scripts/common.sh@364 -- # decimal 1 00:06:49.686 20:07:54 -- scripts/common.sh@352 -- # local d=1 00:06:49.686 20:07:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:49.686 20:07:54 -- scripts/common.sh@354 -- # echo 1 00:06:49.686 20:07:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:49.686 20:07:54 -- scripts/common.sh@365 -- # decimal 2 00:06:49.686 20:07:54 -- scripts/common.sh@352 -- # local d=2 00:06:49.686 20:07:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:49.686 20:07:54 -- scripts/common.sh@354 -- # echo 2 00:06:49.686 20:07:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:49.686 20:07:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:49.686 20:07:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:49.686 20:07:54 -- scripts/common.sh@367 -- # return 0 00:06:49.686 20:07:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:49.686 20:07:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:49.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.686 --rc genhtml_branch_coverage=1 00:06:49.686 --rc genhtml_function_coverage=1 00:06:49.686 --rc genhtml_legend=1 00:06:49.686 --rc geninfo_all_blocks=1 00:06:49.686 --rc geninfo_unexecuted_blocks=1 00:06:49.686 00:06:49.686 ' 00:06:49.686 20:07:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:49.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.686 --rc genhtml_branch_coverage=1 00:06:49.686 --rc genhtml_function_coverage=1 00:06:49.686 --rc genhtml_legend=1 00:06:49.686 --rc geninfo_all_blocks=1 00:06:49.686 --rc geninfo_unexecuted_blocks=1 00:06:49.686 00:06:49.686 ' 00:06:49.686 20:07:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:49.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.686 --rc genhtml_branch_coverage=1 00:06:49.686 --rc genhtml_function_coverage=1 00:06:49.686 --rc genhtml_legend=1 00:06:49.686 --rc geninfo_all_blocks=1 00:06:49.686 --rc geninfo_unexecuted_blocks=1 00:06:49.686 00:06:49.686 ' 00:06:49.686 20:07:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:49.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.686 --rc genhtml_branch_coverage=1 00:06:49.686 --rc genhtml_function_coverage=1 00:06:49.686 --rc genhtml_legend=1 00:06:49.686 --rc geninfo_all_blocks=1 00:06:49.686 --rc geninfo_unexecuted_blocks=1 00:06:49.686 00:06:49.686 ' 00:06:49.686 20:07:54 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:49.686 20:07:54 -- nvmf/common.sh@7 -- # uname -s 00:06:49.686 20:07:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:49.686 20:07:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:49.686 20:07:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:49.686 20:07:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:49.686 20:07:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:49.686 20:07:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:49.686 20:07:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:49.686 20:07:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:49.686 20:07:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:49.686 20:07:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:49.686 20:07:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:49.686 20:07:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:49.686 20:07:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:49.686 20:07:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:49.686 20:07:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:49.686 20:07:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:49.686 20:07:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:49.686 20:07:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:49.686 20:07:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:49.686 20:07:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.686 20:07:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.686 20:07:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.686 20:07:54 -- paths/export.sh@5 -- # export PATH 00:06:49.686 20:07:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.686 20:07:54 -- nvmf/common.sh@46 -- # : 0 00:06:49.686 20:07:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:49.686 20:07:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:49.686 20:07:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:49.686 20:07:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:49.686 20:07:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:49.686 20:07:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:49.686 20:07:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:49.686 20:07:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:49.687 20:07:54 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:49.687 20:07:54 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:49.687 20:07:54 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:49.687 20:07:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:49.687 20:07:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:49.687 20:07:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:49.687 20:07:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:49.687 20:07:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:49.687 20:07:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:49.687 20:07:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:49.687 20:07:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:49.687 20:07:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:49.687 20:07:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:49.687 20:07:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:49.687 20:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:51.587 20:07:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:51.588 20:07:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:51.588 20:07:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:51.588 20:07:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:51.588 20:07:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:51.588 20:07:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:51.588 20:07:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:51.588 20:07:56 -- nvmf/common.sh@294 -- # net_devs=() 00:06:51.588 20:07:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:51.588 20:07:56 -- nvmf/common.sh@295 -- # e810=() 00:06:51.588 20:07:56 -- nvmf/common.sh@295 -- # local -ga e810 00:06:51.588 20:07:56 -- nvmf/common.sh@296 -- # x722=() 00:06:51.588 20:07:56 -- nvmf/common.sh@296 -- # local -ga x722 00:06:51.588 20:07:56 -- nvmf/common.sh@297 -- # mlx=() 00:06:51.588 20:07:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:51.588 20:07:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:51.588 20:07:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:51.588 20:07:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:51.588 20:07:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:51.588 20:07:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:51.588 20:07:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:51.588 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:51.588 20:07:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:51.588 20:07:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:51.588 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:51.588 20:07:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:51.588 20:07:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:51.588 20:07:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:51.588 20:07:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:51.588 20:07:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:51.588 20:07:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:51.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:51.588 20:07:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:51.588 20:07:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:51.588 20:07:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:51.588 20:07:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:51.588 20:07:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:51.588 20:07:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:51.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:51.588 20:07:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:51.588 20:07:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:51.588 20:07:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:51.588 20:07:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:51.588 20:07:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:51.588 20:07:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:51.588 20:07:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:51.588 20:07:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:51.588 20:07:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:51.588 20:07:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:51.588 20:07:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:51.588 20:07:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:51.588 20:07:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:51.588 20:07:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:51.588 20:07:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:51.588 20:07:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:51.588 20:07:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:51.588 20:07:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:51.846 20:07:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:51.846 20:07:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:51.846 20:07:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:51.846 20:07:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:51.846 20:07:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:51.846 20:07:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:51.846 20:07:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:51.846 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:51.846 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:06:51.846 00:06:51.846 --- 10.0.0.2 ping statistics --- 00:06:51.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:51.846 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:06:51.846 20:07:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:51.846 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:51.846 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:06:51.846 00:06:51.846 --- 10.0.0.1 ping statistics --- 00:06:51.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:51.846 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:06:51.846 20:07:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:51.846 20:07:56 -- nvmf/common.sh@410 -- # return 0 00:06:51.846 20:07:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:51.846 20:07:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:51.846 20:07:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:51.846 20:07:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:51.846 20:07:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:51.846 20:07:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:51.846 20:07:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:51.846 20:07:56 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:51.846 20:07:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:51.846 20:07:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.846 20:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:51.846 ************************************ 00:06:51.846 START TEST nvmf_filesystem_no_in_capsule 00:06:51.846 ************************************ 00:06:51.846 20:07:56 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:51.846 20:07:56 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:51.846 20:07:56 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:51.846 20:07:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:51.846 20:07:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:51.846 20:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:51.846 20:07:56 -- nvmf/common.sh@469 -- # nvmfpid=3059093 00:06:51.846 20:07:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:51.846 20:07:56 -- nvmf/common.sh@470 -- # waitforlisten 3059093 00:06:51.846 20:07:56 -- common/autotest_common.sh@829 -- # '[' -z 3059093 ']' 00:06:51.847 20:07:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:51.847 20:07:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:51.847 20:07:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:51.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:51.847 20:07:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:51.847 20:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:51.847 [2024-11-20 20:07:56.818640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:51.847 [2024-11-20 20:07:56.818725] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:51.847 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.105 [2024-11-20 20:07:56.884226] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:52.105 [2024-11-20 20:07:56.995716] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:52.105 [2024-11-20 20:07:56.995887] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:52.105 [2024-11-20 20:07:56.995904] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:52.105 [2024-11-20 20:07:56.995916] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:52.105 [2024-11-20 20:07:56.996001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:52.105 [2024-11-20 20:07:56.996077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:52.105 [2024-11-20 20:07:56.996119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:52.105 [2024-11-20 20:07:56.996122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.037 20:07:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:53.037 20:07:57 -- common/autotest_common.sh@862 -- # return 0 00:06:53.037 20:07:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:53.037 20:07:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:53.037 20:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:53.037 20:07:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:53.037 20:07:57 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:53.037 20:07:57 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:53.037 20:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.037 20:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:53.037 [2024-11-20 20:07:57.870824] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:53.037 20:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.037 20:07:57 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:53.037 20:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.037 20:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:53.037 Malloc1 00:06:53.037 20:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.037 20:07:58 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:53.037 20:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.037 20:07:58 -- common/autotest_common.sh@10 -- # set +x 00:06:53.037 20:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.037 20:07:58 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:53.037 20:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.037 20:07:58 -- common/autotest_common.sh@10 -- # set +x 00:06:53.037 20:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.037 20:07:58 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:53.038 20:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.038 20:07:58 -- common/autotest_common.sh@10 -- # set +x 00:06:53.038 [2024-11-20 20:07:58.051626] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:53.038 20:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.038 20:07:58 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:53.038 20:07:58 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:53.038 20:07:58 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:53.038 20:07:58 -- common/autotest_common.sh@1369 -- # local bs 00:06:53.038 20:07:58 -- common/autotest_common.sh@1370 -- # local nb 00:06:53.038 20:07:58 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:53.038 20:07:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.038 20:07:58 -- common/autotest_common.sh@10 -- # set +x 00:06:53.038 20:07:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.038 20:07:58 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:53.038 { 00:06:53.038 "name": "Malloc1", 00:06:53.038 "aliases": [ 00:06:53.038 "1a773278-fc9d-4bfb-ab48-ac273892598d" 00:06:53.038 ], 00:06:53.038 "product_name": "Malloc disk", 00:06:53.038 "block_size": 512, 00:06:53.038 "num_blocks": 1048576, 00:06:53.038 "uuid": "1a773278-fc9d-4bfb-ab48-ac273892598d", 00:06:53.038 "assigned_rate_limits": { 00:06:53.038 "rw_ios_per_sec": 0, 00:06:53.038 "rw_mbytes_per_sec": 0, 00:06:53.038 "r_mbytes_per_sec": 0, 00:06:53.038 "w_mbytes_per_sec": 0 00:06:53.038 }, 00:06:53.038 "claimed": true, 00:06:53.038 "claim_type": "exclusive_write", 00:06:53.038 "zoned": false, 00:06:53.038 "supported_io_types": { 00:06:53.038 "read": true, 00:06:53.038 "write": true, 00:06:53.038 "unmap": true, 00:06:53.038 "write_zeroes": true, 00:06:53.038 "flush": true, 00:06:53.038 "reset": true, 00:06:53.038 "compare": false, 00:06:53.038 "compare_and_write": false, 00:06:53.038 "abort": true, 00:06:53.038 "nvme_admin": false, 00:06:53.038 "nvme_io": false 00:06:53.038 }, 00:06:53.038 "memory_domains": [ 00:06:53.038 { 00:06:53.038 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:53.038 "dma_device_type": 2 00:06:53.038 } 00:06:53.038 ], 00:06:53.038 "driver_specific": {} 00:06:53.038 } 00:06:53.038 ]' 00:06:53.038 20:07:58 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:53.295 20:07:58 -- common/autotest_common.sh@1372 -- # bs=512 00:06:53.295 20:07:58 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:53.295 20:07:58 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:53.295 20:07:58 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:53.295 20:07:58 -- common/autotest_common.sh@1377 -- # echo 512 00:06:53.295 20:07:58 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:53.295 20:07:58 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:53.861 20:07:58 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:53.861 20:07:58 -- common/autotest_common.sh@1187 -- # local i=0 00:06:53.861 20:07:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:53.861 20:07:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:53.861 20:07:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:55.755 20:08:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:55.755 20:08:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:55.756 20:08:00 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:55.756 20:08:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:55.756 20:08:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:55.756 20:08:00 -- common/autotest_common.sh@1197 -- # return 0 00:06:55.756 20:08:00 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:55.756 20:08:00 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:55.756 20:08:00 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:55.756 20:08:00 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:55.756 20:08:00 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:55.756 20:08:00 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:55.756 20:08:00 -- setup/common.sh@80 -- # echo 536870912 00:06:55.756 20:08:00 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:55.756 20:08:00 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:55.756 20:08:00 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:55.756 20:08:00 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:56.321 20:08:01 -- target/filesystem.sh@69 -- # partprobe 00:06:56.579 20:08:01 -- target/filesystem.sh@70 -- # sleep 1 00:06:57.527 20:08:02 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:57.527 20:08:02 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:57.527 20:08:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:57.527 20:08:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.527 20:08:02 -- common/autotest_common.sh@10 -- # set +x 00:06:57.527 ************************************ 00:06:57.527 START TEST filesystem_ext4 00:06:57.527 ************************************ 00:06:57.527 20:08:02 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:57.527 20:08:02 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:57.527 20:08:02 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:57.527 20:08:02 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:57.527 20:08:02 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:57.527 20:08:02 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:57.527 20:08:02 -- common/autotest_common.sh@914 -- # local i=0 00:06:57.527 20:08:02 -- common/autotest_common.sh@915 -- # local force 00:06:57.527 20:08:02 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:57.527 20:08:02 -- common/autotest_common.sh@918 -- # force=-F 00:06:57.527 20:08:02 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:57.527 mke2fs 1.47.0 (5-Feb-2023) 00:06:57.785 Discarding device blocks: 0/522240 done 00:06:57.785 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:57.785 Filesystem UUID: 9524df62-9117-497e-a293-e9f959fe2c66 00:06:57.785 Superblock backups stored on blocks: 00:06:57.785 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:57.785 00:06:57.785 Allocating group tables: 0/64 done 00:06:57.785 Writing inode tables: 0/64 done 00:06:59.155 Creating journal (8192 blocks): done 00:06:59.155 Writing superblocks and filesystem accounting information: 0/64 done 00:06:59.155 00:06:59.155 20:08:04 -- common/autotest_common.sh@931 -- # return 0 00:06:59.155 20:08:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:05.706 20:08:09 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:05.706 20:08:09 -- target/filesystem.sh@25 -- # sync 00:07:05.706 20:08:09 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:05.706 20:08:09 -- target/filesystem.sh@27 -- # sync 00:07:05.706 20:08:09 -- target/filesystem.sh@29 -- # i=0 00:07:05.706 20:08:09 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:05.706 20:08:09 -- target/filesystem.sh@37 -- # kill -0 3059093 00:07:05.706 20:08:09 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:05.706 20:08:09 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:05.706 20:08:09 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:05.706 20:08:09 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:05.706 00:07:05.706 real 0m7.121s 00:07:05.706 user 0m0.022s 00:07:05.706 sys 0m0.063s 00:07:05.706 20:08:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.706 20:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:05.706 ************************************ 00:07:05.706 END TEST filesystem_ext4 00:07:05.706 ************************************ 00:07:05.706 20:08:09 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:05.706 20:08:09 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:05.706 20:08:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.706 20:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:05.706 ************************************ 00:07:05.706 START TEST filesystem_btrfs 00:07:05.706 ************************************ 00:07:05.706 20:08:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:05.706 20:08:09 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:05.706 20:08:09 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.706 20:08:09 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:05.706 20:08:09 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:05.706 20:08:09 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:05.706 20:08:09 -- common/autotest_common.sh@914 -- # local i=0 00:07:05.706 20:08:09 -- common/autotest_common.sh@915 -- # local force 00:07:05.706 20:08:09 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:05.706 20:08:09 -- common/autotest_common.sh@920 -- # force=-f 00:07:05.706 20:08:09 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:05.706 btrfs-progs v6.8.1 00:07:05.706 See https://btrfs.readthedocs.io for more information. 00:07:05.706 00:07:05.706 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:05.706 NOTE: several default settings have changed in version 5.15, please make sure 00:07:05.706 this does not affect your deployments: 00:07:05.706 - DUP for metadata (-m dup) 00:07:05.706 - enabled no-holes (-O no-holes) 00:07:05.706 - enabled free-space-tree (-R free-space-tree) 00:07:05.706 00:07:05.706 Label: (null) 00:07:05.706 UUID: e9c322f3-557a-4fbb-a755-1d22f084f285 00:07:05.706 Node size: 16384 00:07:05.706 Sector size: 4096 (CPU page size: 4096) 00:07:05.706 Filesystem size: 510.00MiB 00:07:05.706 Block group profiles: 00:07:05.706 Data: single 8.00MiB 00:07:05.706 Metadata: DUP 32.00MiB 00:07:05.706 System: DUP 8.00MiB 00:07:05.706 SSD detected: yes 00:07:05.706 Zoned device: no 00:07:05.706 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:05.706 Checksum: crc32c 00:07:05.706 Number of devices: 1 00:07:05.706 Devices: 00:07:05.706 ID SIZE PATH 00:07:05.706 1 510.00MiB /dev/nvme0n1p1 00:07:05.706 00:07:05.706 20:08:09 -- common/autotest_common.sh@931 -- # return 0 00:07:05.706 20:08:09 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:05.706 20:08:10 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:05.706 20:08:10 -- target/filesystem.sh@25 -- # sync 00:07:05.706 20:08:10 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:05.706 20:08:10 -- target/filesystem.sh@27 -- # sync 00:07:05.706 20:08:10 -- target/filesystem.sh@29 -- # i=0 00:07:05.706 20:08:10 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:05.706 20:08:10 -- target/filesystem.sh@37 -- # kill -0 3059093 00:07:05.706 20:08:10 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:05.706 20:08:10 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:05.706 20:08:10 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:05.706 20:08:10 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:05.706 00:07:05.706 real 0m0.634s 00:07:05.706 user 0m0.023s 00:07:05.706 sys 0m0.096s 00:07:05.706 20:08:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.706 20:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:05.706 ************************************ 00:07:05.706 END TEST filesystem_btrfs 00:07:05.706 ************************************ 00:07:05.706 20:08:10 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:05.706 20:08:10 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:05.706 20:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.706 20:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:05.706 ************************************ 00:07:05.706 START TEST filesystem_xfs 00:07:05.706 ************************************ 00:07:05.706 20:08:10 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:05.706 20:08:10 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:05.706 20:08:10 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.706 20:08:10 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:05.706 20:08:10 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:05.706 20:08:10 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:05.706 20:08:10 -- common/autotest_common.sh@914 -- # local i=0 00:07:05.706 20:08:10 -- common/autotest_common.sh@915 -- # local force 00:07:05.706 20:08:10 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:05.706 20:08:10 -- common/autotest_common.sh@920 -- # force=-f 00:07:05.706 20:08:10 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:05.706 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:05.706 = sectsz=512 attr=2, projid32bit=1 00:07:05.706 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:05.706 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:05.706 data = bsize=4096 blocks=130560, imaxpct=25 00:07:05.706 = sunit=0 swidth=0 blks 00:07:05.706 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:05.706 log =internal log bsize=4096 blocks=16384, version=2 00:07:05.706 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:05.706 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:06.637 Discarding blocks...Done. 00:07:06.637 20:08:11 -- common/autotest_common.sh@931 -- # return 0 00:07:06.637 20:08:11 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:08.533 20:08:13 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:08.534 20:08:13 -- target/filesystem.sh@25 -- # sync 00:07:08.534 20:08:13 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:08.534 20:08:13 -- target/filesystem.sh@27 -- # sync 00:07:08.534 20:08:13 -- target/filesystem.sh@29 -- # i=0 00:07:08.534 20:08:13 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:08.534 20:08:13 -- target/filesystem.sh@37 -- # kill -0 3059093 00:07:08.534 20:08:13 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:08.534 20:08:13 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:08.534 20:08:13 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:08.534 20:08:13 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:08.534 00:07:08.534 real 0m2.930s 00:07:08.534 user 0m0.021s 00:07:08.534 sys 0m0.057s 00:07:08.534 20:08:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.534 20:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:08.534 ************************************ 00:07:08.534 END TEST filesystem_xfs 00:07:08.534 ************************************ 00:07:08.534 20:08:13 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:08.534 20:08:13 -- target/filesystem.sh@93 -- # sync 00:07:08.534 20:08:13 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:08.534 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:08.534 20:08:13 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:08.534 20:08:13 -- common/autotest_common.sh@1208 -- # local i=0 00:07:08.534 20:08:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:08.534 20:08:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:08.534 20:08:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:08.534 20:08:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:08.534 20:08:13 -- common/autotest_common.sh@1220 -- # return 0 00:07:08.534 20:08:13 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:08.534 20:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:08.534 20:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:08.534 20:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:08.534 20:08:13 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:08.534 20:08:13 -- target/filesystem.sh@101 -- # killprocess 3059093 00:07:08.534 20:08:13 -- common/autotest_common.sh@936 -- # '[' -z 3059093 ']' 00:07:08.534 20:08:13 -- common/autotest_common.sh@940 -- # kill -0 3059093 00:07:08.534 20:08:13 -- common/autotest_common.sh@941 -- # uname 00:07:08.534 20:08:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:08.534 20:08:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3059093 00:07:08.534 20:08:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:08.534 20:08:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:08.534 20:08:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3059093' 00:07:08.534 killing process with pid 3059093 00:07:08.534 20:08:13 -- common/autotest_common.sh@955 -- # kill 3059093 00:07:08.534 20:08:13 -- common/autotest_common.sh@960 -- # wait 3059093 00:07:09.099 20:08:13 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:09.099 00:07:09.099 real 0m17.156s 00:07:09.099 user 1m6.357s 00:07:09.099 sys 0m2.160s 00:07:09.099 20:08:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.099 20:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:09.099 ************************************ 00:07:09.099 END TEST nvmf_filesystem_no_in_capsule 00:07:09.099 ************************************ 00:07:09.099 20:08:13 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:09.099 20:08:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:09.099 20:08:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.099 20:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:09.099 ************************************ 00:07:09.099 START TEST nvmf_filesystem_in_capsule 00:07:09.099 ************************************ 00:07:09.099 20:08:13 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:09.099 20:08:13 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:09.099 20:08:13 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:09.099 20:08:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:09.099 20:08:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:09.099 20:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:09.100 20:08:13 -- nvmf/common.sh@469 -- # nvmfpid=3061383 00:07:09.100 20:08:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:09.100 20:08:13 -- nvmf/common.sh@470 -- # waitforlisten 3061383 00:07:09.100 20:08:13 -- common/autotest_common.sh@829 -- # '[' -z 3061383 ']' 00:07:09.100 20:08:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:09.100 20:08:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:09.100 20:08:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:09.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:09.100 20:08:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:09.100 20:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:09.100 [2024-11-20 20:08:14.000569] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.100 [2024-11-20 20:08:14.000671] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:09.100 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.100 [2024-11-20 20:08:14.071841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:09.358 [2024-11-20 20:08:14.192382] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:09.358 [2024-11-20 20:08:14.192551] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:09.358 [2024-11-20 20:08:14.192569] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:09.358 [2024-11-20 20:08:14.192584] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:09.358 [2024-11-20 20:08:14.192643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:09.358 [2024-11-20 20:08:14.192703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:09.358 [2024-11-20 20:08:14.192740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:09.358 [2024-11-20 20:08:14.192744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.290 20:08:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:10.290 20:08:15 -- common/autotest_common.sh@862 -- # return 0 00:07:10.290 20:08:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:10.290 20:08:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:10.290 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.290 20:08:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:10.290 20:08:15 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:10.290 20:08:15 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:10.290 20:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.290 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.290 [2024-11-20 20:08:15.061828] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:10.290 20:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.290 20:08:15 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:10.290 20:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.290 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.290 Malloc1 00:07:10.290 20:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.290 20:08:15 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:10.290 20:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.290 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.290 20:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.290 20:08:15 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:10.290 20:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.290 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.290 20:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.290 20:08:15 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:10.290 20:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.290 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.290 [2024-11-20 20:08:15.235675] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:10.290 20:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.290 20:08:15 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:10.290 20:08:15 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:10.291 20:08:15 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:10.291 20:08:15 -- common/autotest_common.sh@1369 -- # local bs 00:07:10.291 20:08:15 -- common/autotest_common.sh@1370 -- # local nb 00:07:10.291 20:08:15 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:10.291 20:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.291 20:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:10.291 20:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.291 20:08:15 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:10.291 { 00:07:10.291 "name": "Malloc1", 00:07:10.291 "aliases": [ 00:07:10.291 "2211a429-9747-4c0f-a2da-8b72cfdb67cc" 00:07:10.291 ], 00:07:10.291 "product_name": "Malloc disk", 00:07:10.291 "block_size": 512, 00:07:10.291 "num_blocks": 1048576, 00:07:10.291 "uuid": "2211a429-9747-4c0f-a2da-8b72cfdb67cc", 00:07:10.291 "assigned_rate_limits": { 00:07:10.291 "rw_ios_per_sec": 0, 00:07:10.291 "rw_mbytes_per_sec": 0, 00:07:10.291 "r_mbytes_per_sec": 0, 00:07:10.291 "w_mbytes_per_sec": 0 00:07:10.291 }, 00:07:10.291 "claimed": true, 00:07:10.291 "claim_type": "exclusive_write", 00:07:10.291 "zoned": false, 00:07:10.291 "supported_io_types": { 00:07:10.291 "read": true, 00:07:10.291 "write": true, 00:07:10.291 "unmap": true, 00:07:10.291 "write_zeroes": true, 00:07:10.291 "flush": true, 00:07:10.291 "reset": true, 00:07:10.291 "compare": false, 00:07:10.291 "compare_and_write": false, 00:07:10.291 "abort": true, 00:07:10.291 "nvme_admin": false, 00:07:10.291 "nvme_io": false 00:07:10.291 }, 00:07:10.291 "memory_domains": [ 00:07:10.291 { 00:07:10.291 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:10.291 "dma_device_type": 2 00:07:10.291 } 00:07:10.291 ], 00:07:10.291 "driver_specific": {} 00:07:10.291 } 00:07:10.291 ]' 00:07:10.291 20:08:15 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:10.291 20:08:15 -- common/autotest_common.sh@1372 -- # bs=512 00:07:10.291 20:08:15 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:10.548 20:08:15 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:10.548 20:08:15 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:10.548 20:08:15 -- common/autotest_common.sh@1377 -- # echo 512 00:07:10.548 20:08:15 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:10.548 20:08:15 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:11.114 20:08:15 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:11.114 20:08:15 -- common/autotest_common.sh@1187 -- # local i=0 00:07:11.114 20:08:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:11.114 20:08:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:11.114 20:08:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:13.011 20:08:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:13.011 20:08:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:13.011 20:08:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:13.011 20:08:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:13.011 20:08:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:13.011 20:08:17 -- common/autotest_common.sh@1197 -- # return 0 00:07:13.011 20:08:17 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:13.011 20:08:17 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:13.011 20:08:17 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:13.011 20:08:17 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:13.011 20:08:17 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:13.011 20:08:17 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:13.011 20:08:17 -- setup/common.sh@80 -- # echo 536870912 00:07:13.011 20:08:17 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:13.011 20:08:17 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:13.011 20:08:17 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:13.011 20:08:17 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:13.269 20:08:18 -- target/filesystem.sh@69 -- # partprobe 00:07:13.834 20:08:18 -- target/filesystem.sh@70 -- # sleep 1 00:07:15.205 20:08:19 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:15.205 20:08:19 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:15.205 20:08:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:15.205 20:08:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.205 20:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:15.205 ************************************ 00:07:15.205 START TEST filesystem_in_capsule_ext4 00:07:15.205 ************************************ 00:07:15.205 20:08:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:15.205 20:08:19 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:15.205 20:08:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:15.205 20:08:19 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:15.205 20:08:19 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:15.205 20:08:19 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:15.205 20:08:19 -- common/autotest_common.sh@914 -- # local i=0 00:07:15.205 20:08:19 -- common/autotest_common.sh@915 -- # local force 00:07:15.205 20:08:19 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:15.205 20:08:19 -- common/autotest_common.sh@918 -- # force=-F 00:07:15.205 20:08:19 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:15.205 mke2fs 1.47.0 (5-Feb-2023) 00:07:15.205 Discarding device blocks: 0/522240 done 00:07:15.205 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:15.205 Filesystem UUID: 0323c878-bc63-4f4d-9618-6c444c7b0f34 00:07:15.205 Superblock backups stored on blocks: 00:07:15.205 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:15.205 00:07:15.205 Allocating group tables: 0/64 done 00:07:15.205 Writing inode tables: 0/64 done 00:07:15.771 Creating journal (8192 blocks): done 00:07:15.771 Writing superblocks and filesystem accounting information: 0/64 done 00:07:15.771 00:07:15.771 20:08:20 -- common/autotest_common.sh@931 -- # return 0 00:07:15.771 20:08:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:21.090 20:08:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:21.090 20:08:25 -- target/filesystem.sh@25 -- # sync 00:07:21.090 20:08:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:21.090 20:08:25 -- target/filesystem.sh@27 -- # sync 00:07:21.090 20:08:25 -- target/filesystem.sh@29 -- # i=0 00:07:21.090 20:08:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:21.090 20:08:26 -- target/filesystem.sh@37 -- # kill -0 3061383 00:07:21.090 20:08:26 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:21.090 20:08:26 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:21.090 20:08:26 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:21.090 20:08:26 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:21.090 00:07:21.090 real 0m6.190s 00:07:21.090 user 0m0.026s 00:07:21.090 sys 0m0.057s 00:07:21.090 20:08:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.090 20:08:26 -- common/autotest_common.sh@10 -- # set +x 00:07:21.090 ************************************ 00:07:21.090 END TEST filesystem_in_capsule_ext4 00:07:21.090 ************************************ 00:07:21.090 20:08:26 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:21.090 20:08:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:21.090 20:08:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.090 20:08:26 -- common/autotest_common.sh@10 -- # set +x 00:07:21.090 ************************************ 00:07:21.090 START TEST filesystem_in_capsule_btrfs 00:07:21.090 ************************************ 00:07:21.090 20:08:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:21.090 20:08:26 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:21.090 20:08:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:21.090 20:08:26 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:21.090 20:08:26 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:21.090 20:08:26 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:21.090 20:08:26 -- common/autotest_common.sh@914 -- # local i=0 00:07:21.090 20:08:26 -- common/autotest_common.sh@915 -- # local force 00:07:21.090 20:08:26 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:21.090 20:08:26 -- common/autotest_common.sh@920 -- # force=-f 00:07:21.090 20:08:26 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:21.348 btrfs-progs v6.8.1 00:07:21.348 See https://btrfs.readthedocs.io for more information. 00:07:21.348 00:07:21.348 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:21.348 NOTE: several default settings have changed in version 5.15, please make sure 00:07:21.348 this does not affect your deployments: 00:07:21.348 - DUP for metadata (-m dup) 00:07:21.348 - enabled no-holes (-O no-holes) 00:07:21.348 - enabled free-space-tree (-R free-space-tree) 00:07:21.348 00:07:21.348 Label: (null) 00:07:21.348 UUID: 9d4dbc5d-125a-405b-b243-010890093d8e 00:07:21.348 Node size: 16384 00:07:21.348 Sector size: 4096 (CPU page size: 4096) 00:07:21.348 Filesystem size: 510.00MiB 00:07:21.348 Block group profiles: 00:07:21.348 Data: single 8.00MiB 00:07:21.348 Metadata: DUP 32.00MiB 00:07:21.348 System: DUP 8.00MiB 00:07:21.348 SSD detected: yes 00:07:21.348 Zoned device: no 00:07:21.348 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:21.348 Checksum: crc32c 00:07:21.348 Number of devices: 1 00:07:21.348 Devices: 00:07:21.348 ID SIZE PATH 00:07:21.348 1 510.00MiB /dev/nvme0n1p1 00:07:21.348 00:07:21.348 20:08:26 -- common/autotest_common.sh@931 -- # return 0 00:07:21.348 20:08:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:21.912 20:08:26 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:21.912 20:08:26 -- target/filesystem.sh@25 -- # sync 00:07:21.912 20:08:26 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:21.912 20:08:26 -- target/filesystem.sh@27 -- # sync 00:07:21.912 20:08:26 -- target/filesystem.sh@29 -- # i=0 00:07:21.912 20:08:26 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:21.912 20:08:26 -- target/filesystem.sh@37 -- # kill -0 3061383 00:07:21.912 20:08:26 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:21.912 20:08:26 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:21.912 20:08:26 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:21.912 20:08:26 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:21.912 00:07:21.912 real 0m0.721s 00:07:21.912 user 0m0.010s 00:07:21.912 sys 0m0.118s 00:07:21.912 20:08:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.912 20:08:26 -- common/autotest_common.sh@10 -- # set +x 00:07:21.912 ************************************ 00:07:21.912 END TEST filesystem_in_capsule_btrfs 00:07:21.912 ************************************ 00:07:21.912 20:08:26 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:21.912 20:08:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:21.912 20:08:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.912 20:08:26 -- common/autotest_common.sh@10 -- # set +x 00:07:21.912 ************************************ 00:07:21.912 START TEST filesystem_in_capsule_xfs 00:07:21.912 ************************************ 00:07:21.912 20:08:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:21.912 20:08:26 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:21.912 20:08:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:21.912 20:08:26 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:21.912 20:08:26 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:21.912 20:08:26 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:21.912 20:08:26 -- common/autotest_common.sh@914 -- # local i=0 00:07:21.912 20:08:26 -- common/autotest_common.sh@915 -- # local force 00:07:21.912 20:08:26 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:21.912 20:08:26 -- common/autotest_common.sh@920 -- # force=-f 00:07:21.912 20:08:26 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:22.170 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:22.170 = sectsz=512 attr=2, projid32bit=1 00:07:22.170 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:22.170 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:22.170 data = bsize=4096 blocks=130560, imaxpct=25 00:07:22.170 = sunit=0 swidth=0 blks 00:07:22.170 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:22.170 log =internal log bsize=4096 blocks=16384, version=2 00:07:22.170 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:22.170 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:23.102 Discarding blocks...Done. 00:07:23.102 20:08:27 -- common/autotest_common.sh@931 -- # return 0 00:07:23.102 20:08:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:24.997 20:08:29 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:24.997 20:08:29 -- target/filesystem.sh@25 -- # sync 00:07:24.997 20:08:29 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:24.997 20:08:29 -- target/filesystem.sh@27 -- # sync 00:07:24.997 20:08:29 -- target/filesystem.sh@29 -- # i=0 00:07:24.997 20:08:29 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:24.997 20:08:29 -- target/filesystem.sh@37 -- # kill -0 3061383 00:07:24.997 20:08:29 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:24.997 20:08:29 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:24.997 20:08:29 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:24.997 20:08:29 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:24.997 00:07:24.997 real 0m2.949s 00:07:24.997 user 0m0.012s 00:07:24.997 sys 0m0.068s 00:07:24.997 20:08:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.997 20:08:29 -- common/autotest_common.sh@10 -- # set +x 00:07:24.997 ************************************ 00:07:24.997 END TEST filesystem_in_capsule_xfs 00:07:24.997 ************************************ 00:07:24.997 20:08:29 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:24.997 20:08:29 -- target/filesystem.sh@93 -- # sync 00:07:24.997 20:08:29 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:24.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:24.997 20:08:29 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:24.997 20:08:29 -- common/autotest_common.sh@1208 -- # local i=0 00:07:24.997 20:08:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:24.997 20:08:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:24.997 20:08:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:24.997 20:08:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:24.997 20:08:29 -- common/autotest_common.sh@1220 -- # return 0 00:07:24.997 20:08:29 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:24.997 20:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:24.997 20:08:29 -- common/autotest_common.sh@10 -- # set +x 00:07:24.997 20:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:24.997 20:08:29 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:24.997 20:08:29 -- target/filesystem.sh@101 -- # killprocess 3061383 00:07:24.997 20:08:29 -- common/autotest_common.sh@936 -- # '[' -z 3061383 ']' 00:07:24.997 20:08:29 -- common/autotest_common.sh@940 -- # kill -0 3061383 00:07:24.997 20:08:29 -- common/autotest_common.sh@941 -- # uname 00:07:24.997 20:08:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:24.997 20:08:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3061383 00:07:25.255 20:08:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:25.255 20:08:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:25.255 20:08:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3061383' 00:07:25.255 killing process with pid 3061383 00:07:25.255 20:08:30 -- common/autotest_common.sh@955 -- # kill 3061383 00:07:25.255 20:08:30 -- common/autotest_common.sh@960 -- # wait 3061383 00:07:25.514 20:08:30 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:25.514 00:07:25.514 real 0m16.559s 00:07:25.514 user 1m3.863s 00:07:25.514 sys 0m2.219s 00:07:25.514 20:08:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.514 20:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:25.514 ************************************ 00:07:25.514 END TEST nvmf_filesystem_in_capsule 00:07:25.514 ************************************ 00:07:25.514 20:08:30 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:25.514 20:08:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:25.514 20:08:30 -- nvmf/common.sh@116 -- # sync 00:07:25.514 20:08:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:25.514 20:08:30 -- nvmf/common.sh@119 -- # set +e 00:07:25.514 20:08:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:25.514 20:08:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:25.514 rmmod nvme_tcp 00:07:25.774 rmmod nvme_fabrics 00:07:25.774 rmmod nvme_keyring 00:07:25.774 20:08:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:25.774 20:08:30 -- nvmf/common.sh@123 -- # set -e 00:07:25.774 20:08:30 -- nvmf/common.sh@124 -- # return 0 00:07:25.774 20:08:30 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:25.774 20:08:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:25.774 20:08:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:25.774 20:08:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:25.774 20:08:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:25.774 20:08:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:25.774 20:08:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:25.774 20:08:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:25.774 20:08:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:27.681 20:08:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:27.681 00:07:27.681 real 0m38.416s 00:07:27.681 user 2m11.278s 00:07:27.681 sys 0m6.036s 00:07:27.681 20:08:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.681 20:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:27.681 ************************************ 00:07:27.681 END TEST nvmf_filesystem 00:07:27.681 ************************************ 00:07:27.681 20:08:32 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:27.681 20:08:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:27.681 20:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.681 20:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:27.681 ************************************ 00:07:27.681 START TEST nvmf_discovery 00:07:27.681 ************************************ 00:07:27.681 20:08:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:27.681 * Looking for test storage... 00:07:27.681 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:27.681 20:08:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:27.681 20:08:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:27.681 20:08:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:27.940 20:08:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:27.940 20:08:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:27.940 20:08:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:27.940 20:08:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:27.940 20:08:32 -- scripts/common.sh@335 -- # IFS=.-: 00:07:27.940 20:08:32 -- scripts/common.sh@335 -- # read -ra ver1 00:07:27.940 20:08:32 -- scripts/common.sh@336 -- # IFS=.-: 00:07:27.940 20:08:32 -- scripts/common.sh@336 -- # read -ra ver2 00:07:27.940 20:08:32 -- scripts/common.sh@337 -- # local 'op=<' 00:07:27.940 20:08:32 -- scripts/common.sh@339 -- # ver1_l=2 00:07:27.940 20:08:32 -- scripts/common.sh@340 -- # ver2_l=1 00:07:27.940 20:08:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:27.940 20:08:32 -- scripts/common.sh@343 -- # case "$op" in 00:07:27.940 20:08:32 -- scripts/common.sh@344 -- # : 1 00:07:27.940 20:08:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:27.940 20:08:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:27.940 20:08:32 -- scripts/common.sh@364 -- # decimal 1 00:07:27.940 20:08:32 -- scripts/common.sh@352 -- # local d=1 00:07:27.940 20:08:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:27.940 20:08:32 -- scripts/common.sh@354 -- # echo 1 00:07:27.940 20:08:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:27.940 20:08:32 -- scripts/common.sh@365 -- # decimal 2 00:07:27.940 20:08:32 -- scripts/common.sh@352 -- # local d=2 00:07:27.940 20:08:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:27.940 20:08:32 -- scripts/common.sh@354 -- # echo 2 00:07:27.940 20:08:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:27.940 20:08:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:27.940 20:08:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:27.940 20:08:32 -- scripts/common.sh@367 -- # return 0 00:07:27.940 20:08:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:27.940 20:08:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:27.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.940 --rc genhtml_branch_coverage=1 00:07:27.940 --rc genhtml_function_coverage=1 00:07:27.940 --rc genhtml_legend=1 00:07:27.940 --rc geninfo_all_blocks=1 00:07:27.940 --rc geninfo_unexecuted_blocks=1 00:07:27.940 00:07:27.940 ' 00:07:27.940 20:08:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:27.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.940 --rc genhtml_branch_coverage=1 00:07:27.940 --rc genhtml_function_coverage=1 00:07:27.940 --rc genhtml_legend=1 00:07:27.940 --rc geninfo_all_blocks=1 00:07:27.940 --rc geninfo_unexecuted_blocks=1 00:07:27.940 00:07:27.940 ' 00:07:27.940 20:08:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:27.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.940 --rc genhtml_branch_coverage=1 00:07:27.940 --rc genhtml_function_coverage=1 00:07:27.940 --rc genhtml_legend=1 00:07:27.940 --rc geninfo_all_blocks=1 00:07:27.940 --rc geninfo_unexecuted_blocks=1 00:07:27.940 00:07:27.940 ' 00:07:27.940 20:08:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:27.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.940 --rc genhtml_branch_coverage=1 00:07:27.940 --rc genhtml_function_coverage=1 00:07:27.940 --rc genhtml_legend=1 00:07:27.940 --rc geninfo_all_blocks=1 00:07:27.940 --rc geninfo_unexecuted_blocks=1 00:07:27.940 00:07:27.940 ' 00:07:27.940 20:08:32 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:27.940 20:08:32 -- nvmf/common.sh@7 -- # uname -s 00:07:27.940 20:08:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:27.940 20:08:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:27.940 20:08:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:27.940 20:08:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:27.940 20:08:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:27.940 20:08:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:27.940 20:08:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:27.940 20:08:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:27.940 20:08:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:27.941 20:08:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:27.941 20:08:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:27.941 20:08:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:27.941 20:08:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:27.941 20:08:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:27.941 20:08:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:27.941 20:08:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:27.941 20:08:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:27.941 20:08:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:27.941 20:08:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:27.941 20:08:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:27.941 20:08:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:27.941 20:08:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:27.941 20:08:32 -- paths/export.sh@5 -- # export PATH 00:07:27.941 20:08:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:27.941 20:08:32 -- nvmf/common.sh@46 -- # : 0 00:07:27.941 20:08:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:27.941 20:08:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:27.941 20:08:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:27.941 20:08:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:27.941 20:08:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:27.941 20:08:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:27.941 20:08:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:27.941 20:08:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:27.941 20:08:32 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:27.941 20:08:32 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:27.941 20:08:32 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:27.941 20:08:32 -- target/discovery.sh@15 -- # hash nvme 00:07:27.941 20:08:32 -- target/discovery.sh@20 -- # nvmftestinit 00:07:27.941 20:08:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:27.941 20:08:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:27.941 20:08:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:27.941 20:08:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:27.941 20:08:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:27.941 20:08:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:27.941 20:08:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:27.941 20:08:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:27.941 20:08:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:27.941 20:08:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:27.941 20:08:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:27.941 20:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:30.475 20:08:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:30.475 20:08:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:30.475 20:08:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:30.475 20:08:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:30.475 20:08:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:30.475 20:08:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:30.475 20:08:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:30.475 20:08:34 -- nvmf/common.sh@294 -- # net_devs=() 00:07:30.475 20:08:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:30.475 20:08:34 -- nvmf/common.sh@295 -- # e810=() 00:07:30.475 20:08:34 -- nvmf/common.sh@295 -- # local -ga e810 00:07:30.475 20:08:34 -- nvmf/common.sh@296 -- # x722=() 00:07:30.475 20:08:34 -- nvmf/common.sh@296 -- # local -ga x722 00:07:30.475 20:08:34 -- nvmf/common.sh@297 -- # mlx=() 00:07:30.475 20:08:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:30.475 20:08:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:30.475 20:08:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:30.475 20:08:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:30.475 20:08:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:30.475 20:08:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:30.475 20:08:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:30.475 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:30.475 20:08:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:30.475 20:08:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:30.475 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:30.475 20:08:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:30.475 20:08:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:30.475 20:08:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:30.475 20:08:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:30.475 20:08:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:30.475 20:08:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:30.475 20:08:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:30.475 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:30.475 20:08:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:30.475 20:08:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:30.475 20:08:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:30.475 20:08:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:30.475 20:08:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:30.475 20:08:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:30.476 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:30.476 20:08:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:30.476 20:08:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:30.476 20:08:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:30.476 20:08:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:30.476 20:08:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:30.476 20:08:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:30.476 20:08:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:30.476 20:08:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:30.476 20:08:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:30.476 20:08:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:30.476 20:08:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:30.476 20:08:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:30.476 20:08:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:30.476 20:08:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:30.476 20:08:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:30.476 20:08:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:30.476 20:08:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:30.476 20:08:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:30.476 20:08:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:30.476 20:08:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:30.476 20:08:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:30.476 20:08:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:30.476 20:08:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:30.476 20:08:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:30.476 20:08:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:30.476 20:08:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:30.476 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:30.476 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:07:30.476 00:07:30.476 --- 10.0.0.2 ping statistics --- 00:07:30.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:30.476 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:07:30.476 20:08:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:30.476 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:30.476 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:07:30.476 00:07:30.476 --- 10.0.0.1 ping statistics --- 00:07:30.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:30.476 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:07:30.476 20:08:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:30.476 20:08:35 -- nvmf/common.sh@410 -- # return 0 00:07:30.476 20:08:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:30.476 20:08:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:30.476 20:08:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:30.476 20:08:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:30.476 20:08:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:30.476 20:08:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:30.476 20:08:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:30.476 20:08:35 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:30.476 20:08:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:30.476 20:08:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.476 20:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:30.476 20:08:35 -- nvmf/common.sh@469 -- # nvmfpid=3065607 00:07:30.476 20:08:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:30.476 20:08:35 -- nvmf/common.sh@470 -- # waitforlisten 3065607 00:07:30.476 20:08:35 -- common/autotest_common.sh@829 -- # '[' -z 3065607 ']' 00:07:30.476 20:08:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:30.476 20:08:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:30.476 20:08:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:30.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:30.476 20:08:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:30.476 20:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:30.476 [2024-11-20 20:08:35.174570] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.476 [2024-11-20 20:08:35.174662] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:30.476 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.476 [2024-11-20 20:08:35.246560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:30.476 [2024-11-20 20:08:35.357259] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:30.476 [2024-11-20 20:08:35.357411] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:30.476 [2024-11-20 20:08:35.357428] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:30.476 [2024-11-20 20:08:35.357441] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:30.476 [2024-11-20 20:08:35.357501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:30.476 [2024-11-20 20:08:35.357556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:30.476 [2024-11-20 20:08:35.357687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:30.476 [2024-11-20 20:08:35.357690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.410 20:08:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:31.410 20:08:36 -- common/autotest_common.sh@862 -- # return 0 00:07:31.410 20:08:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:31.410 20:08:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 20:08:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:31.410 20:08:36 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 [2024-11-20 20:08:36.234864] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@26 -- # seq 1 4 00:07:31.410 20:08:36 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:31.410 20:08:36 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 Null1 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 [2024-11-20 20:08:36.275194] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:31.410 20:08:36 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 Null2 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.410 20:08:36 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:31.410 20:08:36 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:31.410 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.410 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.410 Null3 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:31.411 20:08:36 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 Null4 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:31.411 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.411 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.411 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.411 20:08:36 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:31.669 00:07:31.669 Discovery Log Number of Records 6, Generation counter 6 00:07:31.669 =====Discovery Log Entry 0====== 00:07:31.669 trtype: tcp 00:07:31.669 adrfam: ipv4 00:07:31.669 subtype: current discovery subsystem 00:07:31.669 treq: not required 00:07:31.669 portid: 0 00:07:31.669 trsvcid: 4420 00:07:31.669 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:31.669 traddr: 10.0.0.2 00:07:31.669 eflags: explicit discovery connections, duplicate discovery information 00:07:31.669 sectype: none 00:07:31.669 =====Discovery Log Entry 1====== 00:07:31.669 trtype: tcp 00:07:31.669 adrfam: ipv4 00:07:31.669 subtype: nvme subsystem 00:07:31.669 treq: not required 00:07:31.669 portid: 0 00:07:31.669 trsvcid: 4420 00:07:31.669 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:31.669 traddr: 10.0.0.2 00:07:31.669 eflags: none 00:07:31.669 sectype: none 00:07:31.669 =====Discovery Log Entry 2====== 00:07:31.669 trtype: tcp 00:07:31.669 adrfam: ipv4 00:07:31.669 subtype: nvme subsystem 00:07:31.669 treq: not required 00:07:31.669 portid: 0 00:07:31.669 trsvcid: 4420 00:07:31.669 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:31.669 traddr: 10.0.0.2 00:07:31.669 eflags: none 00:07:31.669 sectype: none 00:07:31.669 =====Discovery Log Entry 3====== 00:07:31.669 trtype: tcp 00:07:31.669 adrfam: ipv4 00:07:31.669 subtype: nvme subsystem 00:07:31.669 treq: not required 00:07:31.669 portid: 0 00:07:31.669 trsvcid: 4420 00:07:31.669 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:31.669 traddr: 10.0.0.2 00:07:31.669 eflags: none 00:07:31.669 sectype: none 00:07:31.669 =====Discovery Log Entry 4====== 00:07:31.669 trtype: tcp 00:07:31.669 adrfam: ipv4 00:07:31.669 subtype: nvme subsystem 00:07:31.669 treq: not required 00:07:31.669 portid: 0 00:07:31.669 trsvcid: 4420 00:07:31.669 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:31.669 traddr: 10.0.0.2 00:07:31.669 eflags: none 00:07:31.669 sectype: none 00:07:31.669 =====Discovery Log Entry 5====== 00:07:31.669 trtype: tcp 00:07:31.669 adrfam: ipv4 00:07:31.669 subtype: discovery subsystem referral 00:07:31.669 treq: not required 00:07:31.669 portid: 0 00:07:31.669 trsvcid: 4430 00:07:31.669 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:31.669 traddr: 10.0.0.2 00:07:31.669 eflags: none 00:07:31.669 sectype: none 00:07:31.669 20:08:36 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:31.669 Perform nvmf subsystem discovery via RPC 00:07:31.669 20:08:36 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:31.669 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.669 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.669 [2024-11-20 20:08:36.608095] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:31.669 [ 00:07:31.669 { 00:07:31.669 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:31.669 "subtype": "Discovery", 00:07:31.669 "listen_addresses": [ 00:07:31.669 { 00:07:31.669 "transport": "TCP", 00:07:31.669 "trtype": "TCP", 00:07:31.669 "adrfam": "IPv4", 00:07:31.669 "traddr": "10.0.0.2", 00:07:31.669 "trsvcid": "4420" 00:07:31.669 } 00:07:31.669 ], 00:07:31.669 "allow_any_host": true, 00:07:31.669 "hosts": [] 00:07:31.669 }, 00:07:31.669 { 00:07:31.669 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:31.669 "subtype": "NVMe", 00:07:31.669 "listen_addresses": [ 00:07:31.669 { 00:07:31.669 "transport": "TCP", 00:07:31.669 "trtype": "TCP", 00:07:31.669 "adrfam": "IPv4", 00:07:31.669 "traddr": "10.0.0.2", 00:07:31.669 "trsvcid": "4420" 00:07:31.669 } 00:07:31.669 ], 00:07:31.669 "allow_any_host": true, 00:07:31.669 "hosts": [], 00:07:31.669 "serial_number": "SPDK00000000000001", 00:07:31.669 "model_number": "SPDK bdev Controller", 00:07:31.669 "max_namespaces": 32, 00:07:31.669 "min_cntlid": 1, 00:07:31.669 "max_cntlid": 65519, 00:07:31.669 "namespaces": [ 00:07:31.669 { 00:07:31.669 "nsid": 1, 00:07:31.669 "bdev_name": "Null1", 00:07:31.669 "name": "Null1", 00:07:31.669 "nguid": "C7FB53A53E4640F78F4E2065BC056CA0", 00:07:31.669 "uuid": "c7fb53a5-3e46-40f7-8f4e-2065bc056ca0" 00:07:31.669 } 00:07:31.669 ] 00:07:31.669 }, 00:07:31.670 { 00:07:31.670 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:31.670 "subtype": "NVMe", 00:07:31.670 "listen_addresses": [ 00:07:31.670 { 00:07:31.670 "transport": "TCP", 00:07:31.670 "trtype": "TCP", 00:07:31.670 "adrfam": "IPv4", 00:07:31.670 "traddr": "10.0.0.2", 00:07:31.670 "trsvcid": "4420" 00:07:31.670 } 00:07:31.670 ], 00:07:31.670 "allow_any_host": true, 00:07:31.670 "hosts": [], 00:07:31.670 "serial_number": "SPDK00000000000002", 00:07:31.670 "model_number": "SPDK bdev Controller", 00:07:31.670 "max_namespaces": 32, 00:07:31.670 "min_cntlid": 1, 00:07:31.670 "max_cntlid": 65519, 00:07:31.670 "namespaces": [ 00:07:31.670 { 00:07:31.670 "nsid": 1, 00:07:31.670 "bdev_name": "Null2", 00:07:31.670 "name": "Null2", 00:07:31.670 "nguid": "197B082D4DFB40889AD822A4B99B2447", 00:07:31.670 "uuid": "197b082d-4dfb-4088-9ad8-22a4b99b2447" 00:07:31.670 } 00:07:31.670 ] 00:07:31.670 }, 00:07:31.670 { 00:07:31.670 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:31.670 "subtype": "NVMe", 00:07:31.670 "listen_addresses": [ 00:07:31.670 { 00:07:31.670 "transport": "TCP", 00:07:31.670 "trtype": "TCP", 00:07:31.670 "adrfam": "IPv4", 00:07:31.670 "traddr": "10.0.0.2", 00:07:31.670 "trsvcid": "4420" 00:07:31.670 } 00:07:31.670 ], 00:07:31.670 "allow_any_host": true, 00:07:31.670 "hosts": [], 00:07:31.670 "serial_number": "SPDK00000000000003", 00:07:31.670 "model_number": "SPDK bdev Controller", 00:07:31.670 "max_namespaces": 32, 00:07:31.670 "min_cntlid": 1, 00:07:31.670 "max_cntlid": 65519, 00:07:31.670 "namespaces": [ 00:07:31.670 { 00:07:31.670 "nsid": 1, 00:07:31.670 "bdev_name": "Null3", 00:07:31.670 "name": "Null3", 00:07:31.670 "nguid": "C519DB12326F44F7A9EDAB318921F13D", 00:07:31.670 "uuid": "c519db12-326f-44f7-a9ed-ab318921f13d" 00:07:31.670 } 00:07:31.670 ] 00:07:31.670 }, 00:07:31.670 { 00:07:31.670 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:31.670 "subtype": "NVMe", 00:07:31.670 "listen_addresses": [ 00:07:31.670 { 00:07:31.670 "transport": "TCP", 00:07:31.670 "trtype": "TCP", 00:07:31.670 "adrfam": "IPv4", 00:07:31.670 "traddr": "10.0.0.2", 00:07:31.670 "trsvcid": "4420" 00:07:31.670 } 00:07:31.670 ], 00:07:31.670 "allow_any_host": true, 00:07:31.670 "hosts": [], 00:07:31.670 "serial_number": "SPDK00000000000004", 00:07:31.670 "model_number": "SPDK bdev Controller", 00:07:31.670 "max_namespaces": 32, 00:07:31.670 "min_cntlid": 1, 00:07:31.670 "max_cntlid": 65519, 00:07:31.670 "namespaces": [ 00:07:31.670 { 00:07:31.670 "nsid": 1, 00:07:31.670 "bdev_name": "Null4", 00:07:31.670 "name": "Null4", 00:07:31.670 "nguid": "C1D0BDE6A28D420ABAA88D1B5034519C", 00:07:31.670 "uuid": "c1d0bde6-a28d-420a-baa8-8d1b5034519c" 00:07:31.670 } 00:07:31.670 ] 00:07:31.670 } 00:07:31.670 ] 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@42 -- # seq 1 4 00:07:31.670 20:08:36 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:31.670 20:08:36 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:31.670 20:08:36 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:31.670 20:08:36 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:31.670 20:08:36 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.670 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.670 20:08:36 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:31.670 20:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.670 20:08:36 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:31.670 20:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:31.929 20:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.929 20:08:36 -- target/discovery.sh@49 -- # check_bdevs= 00:07:31.929 20:08:36 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:31.929 20:08:36 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:31.929 20:08:36 -- target/discovery.sh@57 -- # nvmftestfini 00:07:31.929 20:08:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:31.929 20:08:36 -- nvmf/common.sh@116 -- # sync 00:07:31.929 20:08:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:31.929 20:08:36 -- nvmf/common.sh@119 -- # set +e 00:07:31.929 20:08:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:31.929 20:08:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:31.929 rmmod nvme_tcp 00:07:31.929 rmmod nvme_fabrics 00:07:31.929 rmmod nvme_keyring 00:07:31.929 20:08:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:31.929 20:08:36 -- nvmf/common.sh@123 -- # set -e 00:07:31.929 20:08:36 -- nvmf/common.sh@124 -- # return 0 00:07:31.929 20:08:36 -- nvmf/common.sh@477 -- # '[' -n 3065607 ']' 00:07:31.929 20:08:36 -- nvmf/common.sh@478 -- # killprocess 3065607 00:07:31.929 20:08:36 -- common/autotest_common.sh@936 -- # '[' -z 3065607 ']' 00:07:31.929 20:08:36 -- common/autotest_common.sh@940 -- # kill -0 3065607 00:07:31.929 20:08:36 -- common/autotest_common.sh@941 -- # uname 00:07:31.929 20:08:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:31.929 20:08:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3065607 00:07:31.929 20:08:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:31.929 20:08:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:31.929 20:08:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3065607' 00:07:31.929 killing process with pid 3065607 00:07:31.929 20:08:36 -- common/autotest_common.sh@955 -- # kill 3065607 00:07:31.929 [2024-11-20 20:08:36.828870] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:31.929 20:08:36 -- common/autotest_common.sh@960 -- # wait 3065607 00:07:32.187 20:08:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:32.187 20:08:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:32.187 20:08:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:32.187 20:08:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:32.187 20:08:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:32.187 20:08:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:32.187 20:08:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:32.187 20:08:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:34.729 20:08:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:34.729 00:07:34.729 real 0m6.492s 00:07:34.729 user 0m8.008s 00:07:34.729 sys 0m1.990s 00:07:34.729 20:08:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.729 20:08:39 -- common/autotest_common.sh@10 -- # set +x 00:07:34.729 ************************************ 00:07:34.729 END TEST nvmf_discovery 00:07:34.729 ************************************ 00:07:34.729 20:08:39 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:34.729 20:08:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:34.729 20:08:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.729 20:08:39 -- common/autotest_common.sh@10 -- # set +x 00:07:34.729 ************************************ 00:07:34.729 START TEST nvmf_referrals 00:07:34.729 ************************************ 00:07:34.729 20:08:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:34.729 * Looking for test storage... 00:07:34.729 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:34.729 20:08:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:34.729 20:08:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:34.729 20:08:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:34.729 20:08:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:34.729 20:08:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:34.729 20:08:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:34.729 20:08:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:34.729 20:08:39 -- scripts/common.sh@335 -- # IFS=.-: 00:07:34.729 20:08:39 -- scripts/common.sh@335 -- # read -ra ver1 00:07:34.729 20:08:39 -- scripts/common.sh@336 -- # IFS=.-: 00:07:34.729 20:08:39 -- scripts/common.sh@336 -- # read -ra ver2 00:07:34.729 20:08:39 -- scripts/common.sh@337 -- # local 'op=<' 00:07:34.729 20:08:39 -- scripts/common.sh@339 -- # ver1_l=2 00:07:34.729 20:08:39 -- scripts/common.sh@340 -- # ver2_l=1 00:07:34.729 20:08:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:34.729 20:08:39 -- scripts/common.sh@343 -- # case "$op" in 00:07:34.729 20:08:39 -- scripts/common.sh@344 -- # : 1 00:07:34.729 20:08:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:34.729 20:08:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:34.729 20:08:39 -- scripts/common.sh@364 -- # decimal 1 00:07:34.729 20:08:39 -- scripts/common.sh@352 -- # local d=1 00:07:34.729 20:08:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:34.729 20:08:39 -- scripts/common.sh@354 -- # echo 1 00:07:34.729 20:08:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:34.729 20:08:39 -- scripts/common.sh@365 -- # decimal 2 00:07:34.729 20:08:39 -- scripts/common.sh@352 -- # local d=2 00:07:34.729 20:08:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:34.729 20:08:39 -- scripts/common.sh@354 -- # echo 2 00:07:34.729 20:08:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:34.729 20:08:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:34.729 20:08:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:34.729 20:08:39 -- scripts/common.sh@367 -- # return 0 00:07:34.729 20:08:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:34.729 20:08:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:34.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.729 --rc genhtml_branch_coverage=1 00:07:34.729 --rc genhtml_function_coverage=1 00:07:34.729 --rc genhtml_legend=1 00:07:34.729 --rc geninfo_all_blocks=1 00:07:34.729 --rc geninfo_unexecuted_blocks=1 00:07:34.729 00:07:34.729 ' 00:07:34.729 20:08:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:34.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.729 --rc genhtml_branch_coverage=1 00:07:34.729 --rc genhtml_function_coverage=1 00:07:34.729 --rc genhtml_legend=1 00:07:34.729 --rc geninfo_all_blocks=1 00:07:34.729 --rc geninfo_unexecuted_blocks=1 00:07:34.729 00:07:34.729 ' 00:07:34.729 20:08:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:34.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.729 --rc genhtml_branch_coverage=1 00:07:34.729 --rc genhtml_function_coverage=1 00:07:34.729 --rc genhtml_legend=1 00:07:34.729 --rc geninfo_all_blocks=1 00:07:34.729 --rc geninfo_unexecuted_blocks=1 00:07:34.729 00:07:34.729 ' 00:07:34.729 20:08:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:34.729 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.729 --rc genhtml_branch_coverage=1 00:07:34.729 --rc genhtml_function_coverage=1 00:07:34.729 --rc genhtml_legend=1 00:07:34.729 --rc geninfo_all_blocks=1 00:07:34.729 --rc geninfo_unexecuted_blocks=1 00:07:34.729 00:07:34.729 ' 00:07:34.729 20:08:39 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:34.729 20:08:39 -- nvmf/common.sh@7 -- # uname -s 00:07:34.729 20:08:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:34.729 20:08:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:34.729 20:08:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:34.729 20:08:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:34.729 20:08:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:34.729 20:08:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:34.729 20:08:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:34.729 20:08:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:34.729 20:08:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:34.729 20:08:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:34.729 20:08:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:34.729 20:08:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:34.729 20:08:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:34.729 20:08:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:34.729 20:08:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:34.729 20:08:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:34.729 20:08:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:34.729 20:08:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:34.729 20:08:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:34.729 20:08:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.729 20:08:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.729 20:08:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.729 20:08:39 -- paths/export.sh@5 -- # export PATH 00:07:34.730 20:08:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.730 20:08:39 -- nvmf/common.sh@46 -- # : 0 00:07:34.730 20:08:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:34.730 20:08:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:34.730 20:08:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:34.730 20:08:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:34.730 20:08:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:34.730 20:08:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:34.730 20:08:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:34.730 20:08:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:34.730 20:08:39 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:34.730 20:08:39 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:34.730 20:08:39 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:34.730 20:08:39 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:34.730 20:08:39 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:34.730 20:08:39 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:34.730 20:08:39 -- target/referrals.sh@37 -- # nvmftestinit 00:07:34.730 20:08:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:34.730 20:08:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:34.730 20:08:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:34.730 20:08:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:34.730 20:08:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:34.730 20:08:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:34.730 20:08:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:34.730 20:08:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:34.730 20:08:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:34.730 20:08:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:34.730 20:08:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:34.730 20:08:39 -- common/autotest_common.sh@10 -- # set +x 00:07:36.633 20:08:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:36.633 20:08:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:36.633 20:08:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:36.633 20:08:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:36.633 20:08:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:36.633 20:08:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:36.633 20:08:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:36.633 20:08:41 -- nvmf/common.sh@294 -- # net_devs=() 00:07:36.633 20:08:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:36.633 20:08:41 -- nvmf/common.sh@295 -- # e810=() 00:07:36.633 20:08:41 -- nvmf/common.sh@295 -- # local -ga e810 00:07:36.633 20:08:41 -- nvmf/common.sh@296 -- # x722=() 00:07:36.633 20:08:41 -- nvmf/common.sh@296 -- # local -ga x722 00:07:36.633 20:08:41 -- nvmf/common.sh@297 -- # mlx=() 00:07:36.633 20:08:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:36.633 20:08:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:36.633 20:08:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:36.633 20:08:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:36.633 20:08:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:36.633 20:08:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:36.633 20:08:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:36.633 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:36.633 20:08:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:36.633 20:08:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:36.633 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:36.633 20:08:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:36.633 20:08:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:36.633 20:08:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:36.633 20:08:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:36.633 20:08:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:36.633 20:08:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:36.633 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:36.633 20:08:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:36.633 20:08:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:36.633 20:08:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:36.633 20:08:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:36.633 20:08:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:36.633 20:08:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:36.633 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:36.633 20:08:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:36.633 20:08:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:36.633 20:08:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:36.633 20:08:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:36.633 20:08:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:36.633 20:08:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:36.633 20:08:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:36.633 20:08:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:36.633 20:08:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:36.633 20:08:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:36.633 20:08:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:36.633 20:08:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:36.633 20:08:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:36.633 20:08:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:36.633 20:08:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:36.633 20:08:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:36.633 20:08:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:36.633 20:08:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:36.633 20:08:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:36.633 20:08:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:36.633 20:08:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:36.633 20:08:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:36.633 20:08:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:36.633 20:08:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:36.633 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:36.633 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:07:36.633 00:07:36.633 --- 10.0.0.2 ping statistics --- 00:07:36.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:36.633 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:07:36.633 20:08:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:36.633 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:36.633 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:07:36.633 00:07:36.633 --- 10.0.0.1 ping statistics --- 00:07:36.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:36.633 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:07:36.633 20:08:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:36.633 20:08:41 -- nvmf/common.sh@410 -- # return 0 00:07:36.633 20:08:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:36.633 20:08:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:36.633 20:08:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:36.633 20:08:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:36.633 20:08:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:36.633 20:08:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:36.633 20:08:41 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:36.633 20:08:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:36.633 20:08:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:36.633 20:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:36.633 20:08:41 -- nvmf/common.sh@469 -- # nvmfpid=3067743 00:07:36.633 20:08:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:36.633 20:08:41 -- nvmf/common.sh@470 -- # waitforlisten 3067743 00:07:36.633 20:08:41 -- common/autotest_common.sh@829 -- # '[' -z 3067743 ']' 00:07:36.633 20:08:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:36.633 20:08:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:36.634 20:08:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:36.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:36.634 20:08:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:36.634 20:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:36.634 [2024-11-20 20:08:41.620559] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:36.634 [2024-11-20 20:08:41.620657] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:36.634 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.892 [2024-11-20 20:08:41.690966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.892 [2024-11-20 20:08:41.809090] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:36.892 [2024-11-20 20:08:41.809282] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:36.892 [2024-11-20 20:08:41.809312] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:36.892 [2024-11-20 20:08:41.809335] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:36.892 [2024-11-20 20:08:41.809444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.892 [2024-11-20 20:08:41.809505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.892 [2024-11-20 20:08:41.809567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.892 [2024-11-20 20:08:41.809576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.825 20:08:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:37.825 20:08:42 -- common/autotest_common.sh@862 -- # return 0 00:07:37.825 20:08:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:37.825 20:08:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 20:08:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:37.825 20:08:42 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 [2024-11-20 20:08:42.659773] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 [2024-11-20 20:08:42.671962] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- target/referrals.sh@48 -- # jq length 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:37.825 20:08:42 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:37.825 20:08:42 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:37.825 20:08:42 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:37.825 20:08:42 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:37.825 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.825 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:37.825 20:08:42 -- target/referrals.sh@21 -- # sort 00:07:37.825 20:08:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:37.825 20:08:42 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:37.825 20:08:42 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:37.825 20:08:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:37.825 20:08:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:37.825 20:08:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.825 20:08:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:37.825 20:08:42 -- target/referrals.sh@26 -- # sort 00:07:38.083 20:08:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:38.083 20:08:42 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:38.083 20:08:42 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:38.083 20:08:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.083 20:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:38.083 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.083 20:08:43 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:38.083 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.083 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.083 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.083 20:08:43 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:38.083 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.083 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.083 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.083 20:08:43 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:38.083 20:08:43 -- target/referrals.sh@56 -- # jq length 00:07:38.083 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.083 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.083 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.083 20:08:43 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:38.083 20:08:43 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:38.083 20:08:43 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:38.083 20:08:43 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:38.083 20:08:43 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.083 20:08:43 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:38.083 20:08:43 -- target/referrals.sh@26 -- # sort 00:07:38.340 20:08:43 -- target/referrals.sh@26 -- # echo 00:07:38.341 20:08:43 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:38.341 20:08:43 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:38.341 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.341 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.341 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.341 20:08:43 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:38.341 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.341 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.341 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.341 20:08:43 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:38.341 20:08:43 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:38.341 20:08:43 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:38.341 20:08:43 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:38.341 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.341 20:08:43 -- target/referrals.sh@21 -- # sort 00:07:38.341 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.341 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.341 20:08:43 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:38.341 20:08:43 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:38.341 20:08:43 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:38.341 20:08:43 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:38.341 20:08:43 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:38.341 20:08:43 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.341 20:08:43 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:38.341 20:08:43 -- target/referrals.sh@26 -- # sort 00:07:38.598 20:08:43 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:38.598 20:08:43 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:38.598 20:08:43 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:38.598 20:08:43 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:38.598 20:08:43 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:38.598 20:08:43 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.598 20:08:43 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:38.598 20:08:43 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:38.598 20:08:43 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:38.598 20:08:43 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:38.598 20:08:43 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:38.598 20:08:43 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.598 20:08:43 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:38.856 20:08:43 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:38.856 20:08:43 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:38.856 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.856 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.856 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.856 20:08:43 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:38.856 20:08:43 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:38.856 20:08:43 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:38.856 20:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.856 20:08:43 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:38.856 20:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.856 20:08:43 -- target/referrals.sh@21 -- # sort 00:07:38.856 20:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.856 20:08:43 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:38.856 20:08:43 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:38.856 20:08:43 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:38.856 20:08:43 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:38.856 20:08:43 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:38.856 20:08:43 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.856 20:08:43 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:38.856 20:08:43 -- target/referrals.sh@26 -- # sort 00:07:39.113 20:08:44 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:39.113 20:08:44 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:39.113 20:08:44 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:39.113 20:08:44 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:39.113 20:08:44 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:39.113 20:08:44 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.113 20:08:44 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:39.371 20:08:44 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:39.371 20:08:44 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:39.371 20:08:44 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:39.371 20:08:44 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:39.371 20:08:44 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.371 20:08:44 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:39.371 20:08:44 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:39.371 20:08:44 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:39.371 20:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.371 20:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:39.371 20:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.371 20:08:44 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:39.371 20:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.371 20:08:44 -- target/referrals.sh@82 -- # jq length 00:07:39.371 20:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:39.371 20:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.629 20:08:44 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:39.629 20:08:44 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:39.629 20:08:44 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:39.629 20:08:44 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:39.629 20:08:44 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.629 20:08:44 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:39.629 20:08:44 -- target/referrals.sh@26 -- # sort 00:07:39.629 20:08:44 -- target/referrals.sh@26 -- # echo 00:07:39.629 20:08:44 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:39.629 20:08:44 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:39.629 20:08:44 -- target/referrals.sh@86 -- # nvmftestfini 00:07:39.629 20:08:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:39.629 20:08:44 -- nvmf/common.sh@116 -- # sync 00:07:39.629 20:08:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:39.629 20:08:44 -- nvmf/common.sh@119 -- # set +e 00:07:39.629 20:08:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:39.629 20:08:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:39.629 rmmod nvme_tcp 00:07:39.629 rmmod nvme_fabrics 00:07:39.629 rmmod nvme_keyring 00:07:39.629 20:08:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:39.629 20:08:44 -- nvmf/common.sh@123 -- # set -e 00:07:39.629 20:08:44 -- nvmf/common.sh@124 -- # return 0 00:07:39.629 20:08:44 -- nvmf/common.sh@477 -- # '[' -n 3067743 ']' 00:07:39.629 20:08:44 -- nvmf/common.sh@478 -- # killprocess 3067743 00:07:39.629 20:08:44 -- common/autotest_common.sh@936 -- # '[' -z 3067743 ']' 00:07:39.629 20:08:44 -- common/autotest_common.sh@940 -- # kill -0 3067743 00:07:39.629 20:08:44 -- common/autotest_common.sh@941 -- # uname 00:07:39.629 20:08:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:39.629 20:08:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3067743 00:07:39.887 20:08:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:39.887 20:08:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:39.887 20:08:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3067743' 00:07:39.887 killing process with pid 3067743 00:07:39.887 20:08:44 -- common/autotest_common.sh@955 -- # kill 3067743 00:07:39.887 20:08:44 -- common/autotest_common.sh@960 -- # wait 3067743 00:07:40.145 20:08:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:40.145 20:08:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:40.145 20:08:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:40.145 20:08:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:40.145 20:08:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:40.145 20:08:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:40.145 20:08:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:40.145 20:08:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:42.052 20:08:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:42.052 00:07:42.052 real 0m7.850s 00:07:42.052 user 0m14.318s 00:07:42.052 sys 0m2.242s 00:07:42.052 20:08:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.052 20:08:47 -- common/autotest_common.sh@10 -- # set +x 00:07:42.052 ************************************ 00:07:42.052 END TEST nvmf_referrals 00:07:42.052 ************************************ 00:07:42.052 20:08:47 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:42.052 20:08:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:42.052 20:08:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.052 20:08:47 -- common/autotest_common.sh@10 -- # set +x 00:07:42.052 ************************************ 00:07:42.052 START TEST nvmf_connect_disconnect 00:07:42.052 ************************************ 00:07:42.052 20:08:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:42.309 * Looking for test storage... 00:07:42.309 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:42.309 20:08:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:42.310 20:08:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:42.310 20:08:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:42.310 20:08:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:42.310 20:08:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:42.310 20:08:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:42.310 20:08:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:42.310 20:08:47 -- scripts/common.sh@335 -- # IFS=.-: 00:07:42.310 20:08:47 -- scripts/common.sh@335 -- # read -ra ver1 00:07:42.310 20:08:47 -- scripts/common.sh@336 -- # IFS=.-: 00:07:42.310 20:08:47 -- scripts/common.sh@336 -- # read -ra ver2 00:07:42.310 20:08:47 -- scripts/common.sh@337 -- # local 'op=<' 00:07:42.310 20:08:47 -- scripts/common.sh@339 -- # ver1_l=2 00:07:42.310 20:08:47 -- scripts/common.sh@340 -- # ver2_l=1 00:07:42.310 20:08:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:42.310 20:08:47 -- scripts/common.sh@343 -- # case "$op" in 00:07:42.310 20:08:47 -- scripts/common.sh@344 -- # : 1 00:07:42.310 20:08:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:42.310 20:08:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:42.310 20:08:47 -- scripts/common.sh@364 -- # decimal 1 00:07:42.310 20:08:47 -- scripts/common.sh@352 -- # local d=1 00:07:42.310 20:08:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:42.310 20:08:47 -- scripts/common.sh@354 -- # echo 1 00:07:42.310 20:08:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:42.310 20:08:47 -- scripts/common.sh@365 -- # decimal 2 00:07:42.310 20:08:47 -- scripts/common.sh@352 -- # local d=2 00:07:42.310 20:08:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:42.310 20:08:47 -- scripts/common.sh@354 -- # echo 2 00:07:42.310 20:08:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:42.310 20:08:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:42.310 20:08:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:42.310 20:08:47 -- scripts/common.sh@367 -- # return 0 00:07:42.310 20:08:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:42.310 20:08:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:42.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.310 --rc genhtml_branch_coverage=1 00:07:42.310 --rc genhtml_function_coverage=1 00:07:42.310 --rc genhtml_legend=1 00:07:42.310 --rc geninfo_all_blocks=1 00:07:42.310 --rc geninfo_unexecuted_blocks=1 00:07:42.310 00:07:42.310 ' 00:07:42.310 20:08:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:42.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.310 --rc genhtml_branch_coverage=1 00:07:42.310 --rc genhtml_function_coverage=1 00:07:42.310 --rc genhtml_legend=1 00:07:42.310 --rc geninfo_all_blocks=1 00:07:42.310 --rc geninfo_unexecuted_blocks=1 00:07:42.310 00:07:42.310 ' 00:07:42.310 20:08:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:42.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.310 --rc genhtml_branch_coverage=1 00:07:42.310 --rc genhtml_function_coverage=1 00:07:42.310 --rc genhtml_legend=1 00:07:42.310 --rc geninfo_all_blocks=1 00:07:42.310 --rc geninfo_unexecuted_blocks=1 00:07:42.310 00:07:42.310 ' 00:07:42.310 20:08:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:42.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.310 --rc genhtml_branch_coverage=1 00:07:42.310 --rc genhtml_function_coverage=1 00:07:42.310 --rc genhtml_legend=1 00:07:42.310 --rc geninfo_all_blocks=1 00:07:42.310 --rc geninfo_unexecuted_blocks=1 00:07:42.310 00:07:42.310 ' 00:07:42.310 20:08:47 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:42.310 20:08:47 -- nvmf/common.sh@7 -- # uname -s 00:07:42.310 20:08:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:42.310 20:08:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:42.310 20:08:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:42.310 20:08:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:42.310 20:08:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:42.310 20:08:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:42.310 20:08:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:42.310 20:08:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:42.310 20:08:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:42.310 20:08:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:42.310 20:08:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:42.310 20:08:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:42.310 20:08:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:42.310 20:08:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:42.310 20:08:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:42.310 20:08:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:42.310 20:08:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:42.310 20:08:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:42.310 20:08:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:42.310 20:08:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.310 20:08:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.310 20:08:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.310 20:08:47 -- paths/export.sh@5 -- # export PATH 00:07:42.310 20:08:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.310 20:08:47 -- nvmf/common.sh@46 -- # : 0 00:07:42.310 20:08:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:42.310 20:08:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:42.310 20:08:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:42.310 20:08:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:42.310 20:08:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:42.310 20:08:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:42.310 20:08:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:42.310 20:08:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:42.310 20:08:47 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:42.310 20:08:47 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:42.310 20:08:47 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:42.310 20:08:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:42.310 20:08:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:42.310 20:08:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:42.310 20:08:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:42.310 20:08:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:42.310 20:08:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:42.310 20:08:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:42.310 20:08:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:42.310 20:08:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:42.310 20:08:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:42.310 20:08:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:42.310 20:08:47 -- common/autotest_common.sh@10 -- # set +x 00:07:44.840 20:08:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:44.840 20:08:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:44.840 20:08:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:44.840 20:08:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:44.840 20:08:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:44.840 20:08:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:44.840 20:08:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:44.840 20:08:49 -- nvmf/common.sh@294 -- # net_devs=() 00:07:44.840 20:08:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:44.840 20:08:49 -- nvmf/common.sh@295 -- # e810=() 00:07:44.840 20:08:49 -- nvmf/common.sh@295 -- # local -ga e810 00:07:44.840 20:08:49 -- nvmf/common.sh@296 -- # x722=() 00:07:44.840 20:08:49 -- nvmf/common.sh@296 -- # local -ga x722 00:07:44.840 20:08:49 -- nvmf/common.sh@297 -- # mlx=() 00:07:44.840 20:08:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:44.840 20:08:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:44.840 20:08:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:44.840 20:08:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:44.840 20:08:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:44.840 20:08:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:44.840 20:08:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:44.840 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:44.840 20:08:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:44.840 20:08:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:44.840 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:44.840 20:08:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:44.840 20:08:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:44.840 20:08:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:44.840 20:08:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:44.840 20:08:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:44.840 20:08:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:44.840 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:44.840 20:08:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:44.840 20:08:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:44.840 20:08:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:44.840 20:08:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:44.840 20:08:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:44.840 20:08:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:44.840 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:44.840 20:08:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:44.840 20:08:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:44.840 20:08:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:44.840 20:08:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:44.840 20:08:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:44.840 20:08:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:44.840 20:08:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:44.840 20:08:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:44.840 20:08:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:44.840 20:08:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:44.840 20:08:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:44.840 20:08:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:44.840 20:08:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:44.840 20:08:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:44.840 20:08:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:44.840 20:08:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:44.840 20:08:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:44.840 20:08:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:44.840 20:08:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:44.840 20:08:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:44.841 20:08:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:44.841 20:08:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:44.841 20:08:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:44.841 20:08:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:44.841 20:08:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:44.841 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:44.841 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:07:44.841 00:07:44.841 --- 10.0.0.2 ping statistics --- 00:07:44.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:44.841 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:07:44.841 20:08:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:44.841 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:44.841 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:07:44.841 00:07:44.841 --- 10.0.0.1 ping statistics --- 00:07:44.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:44.841 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:07:44.841 20:08:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:44.841 20:08:49 -- nvmf/common.sh@410 -- # return 0 00:07:44.841 20:08:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:44.841 20:08:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:44.841 20:08:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:44.841 20:08:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:44.841 20:08:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:44.841 20:08:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:44.841 20:08:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:44.841 20:08:49 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:44.841 20:08:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:44.841 20:08:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:44.841 20:08:49 -- common/autotest_common.sh@10 -- # set +x 00:07:44.841 20:08:49 -- nvmf/common.sh@469 -- # nvmfpid=3070206 00:07:44.841 20:08:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:44.841 20:08:49 -- nvmf/common.sh@470 -- # waitforlisten 3070206 00:07:44.841 20:08:49 -- common/autotest_common.sh@829 -- # '[' -z 3070206 ']' 00:07:44.841 20:08:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:44.841 20:08:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:44.841 20:08:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:44.841 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:44.841 20:08:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:44.841 20:08:49 -- common/autotest_common.sh@10 -- # set +x 00:07:44.841 [2024-11-20 20:08:49.486049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.841 [2024-11-20 20:08:49.486143] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:44.841 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.841 [2024-11-20 20:08:49.555736] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:44.841 [2024-11-20 20:08:49.680646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:44.841 [2024-11-20 20:08:49.680842] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:44.841 [2024-11-20 20:08:49.680873] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:44.841 [2024-11-20 20:08:49.680895] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:44.841 [2024-11-20 20:08:49.681023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.841 [2024-11-20 20:08:49.681093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:44.841 [2024-11-20 20:08:49.681130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:44.841 [2024-11-20 20:08:49.681138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.775 20:08:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:45.775 20:08:50 -- common/autotest_common.sh@862 -- # return 0 00:07:45.775 20:08:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:45.775 20:08:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:45.775 20:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:45.775 20:08:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:45.775 20:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.775 20:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:45.775 [2024-11-20 20:08:50.531774] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:45.775 20:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:45.775 20:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.775 20:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:45.775 20:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:45.775 20:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.775 20:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:45.775 20:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:45.775 20:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.775 20:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:45.775 20:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:45.775 20:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.775 20:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:45.775 [2024-11-20 20:08:50.585735] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:45.775 20:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:45.775 20:08:50 -- target/connect_disconnect.sh@34 -- # set +x 00:07:48.304 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:52.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.256 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.344 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.241 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.192 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.615 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.142 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.664 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.085 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.509 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.457 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.508 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.481 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.533 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.431 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.857 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.381 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.907 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.329 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.854 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.279 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.187 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.178 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.655 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.708 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.032 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.083 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.982 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.462 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.987 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.409 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.381 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.921 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.827 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.903 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.444 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.353 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.333 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.325 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.863 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.416 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.322 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.768 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.299 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.265 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.333 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.185 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.238 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.135 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.188 20:12:41 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:37.188 20:12:41 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:37.188 20:12:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:37.188 20:12:41 -- nvmf/common.sh@116 -- # sync 00:11:37.188 20:12:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:37.188 20:12:41 -- nvmf/common.sh@119 -- # set +e 00:11:37.188 20:12:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:37.188 20:12:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:37.188 rmmod nvme_tcp 00:11:37.188 rmmod nvme_fabrics 00:11:37.188 rmmod nvme_keyring 00:11:37.188 20:12:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:37.188 20:12:41 -- nvmf/common.sh@123 -- # set -e 00:11:37.188 20:12:41 -- nvmf/common.sh@124 -- # return 0 00:11:37.188 20:12:41 -- nvmf/common.sh@477 -- # '[' -n 3070206 ']' 00:11:37.188 20:12:41 -- nvmf/common.sh@478 -- # killprocess 3070206 00:11:37.188 20:12:41 -- common/autotest_common.sh@936 -- # '[' -z 3070206 ']' 00:11:37.188 20:12:41 -- common/autotest_common.sh@940 -- # kill -0 3070206 00:11:37.188 20:12:41 -- common/autotest_common.sh@941 -- # uname 00:11:37.188 20:12:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:37.188 20:12:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3070206 00:11:37.188 20:12:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:37.188 20:12:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:37.188 20:12:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3070206' 00:11:37.188 killing process with pid 3070206 00:11:37.188 20:12:41 -- common/autotest_common.sh@955 -- # kill 3070206 00:11:37.188 20:12:41 -- common/autotest_common.sh@960 -- # wait 3070206 00:11:37.464 20:12:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:37.464 20:12:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:37.464 20:12:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:37.464 20:12:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:37.464 20:12:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:37.464 20:12:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:37.464 20:12:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:37.464 20:12:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:39.473 20:12:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:39.473 00:11:39.473 real 3m57.260s 00:11:39.473 user 15m4.337s 00:11:39.473 sys 0m34.846s 00:11:39.473 20:12:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:39.473 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:11:39.473 ************************************ 00:11:39.473 END TEST nvmf_connect_disconnect 00:11:39.473 ************************************ 00:11:39.473 20:12:44 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:39.473 20:12:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:39.473 20:12:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:39.473 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:11:39.473 ************************************ 00:11:39.473 START TEST nvmf_multitarget 00:11:39.473 ************************************ 00:11:39.473 20:12:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:39.473 * Looking for test storage... 00:11:39.473 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:39.473 20:12:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:39.473 20:12:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:39.473 20:12:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:39.473 20:12:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:39.473 20:12:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:39.473 20:12:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:39.473 20:12:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:39.473 20:12:44 -- scripts/common.sh@335 -- # IFS=.-: 00:11:39.473 20:12:44 -- scripts/common.sh@335 -- # read -ra ver1 00:11:39.473 20:12:44 -- scripts/common.sh@336 -- # IFS=.-: 00:11:39.473 20:12:44 -- scripts/common.sh@336 -- # read -ra ver2 00:11:39.473 20:12:44 -- scripts/common.sh@337 -- # local 'op=<' 00:11:39.473 20:12:44 -- scripts/common.sh@339 -- # ver1_l=2 00:11:39.473 20:12:44 -- scripts/common.sh@340 -- # ver2_l=1 00:11:39.473 20:12:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:39.473 20:12:44 -- scripts/common.sh@343 -- # case "$op" in 00:11:39.473 20:12:44 -- scripts/common.sh@344 -- # : 1 00:11:39.473 20:12:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:39.473 20:12:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:39.473 20:12:44 -- scripts/common.sh@364 -- # decimal 1 00:11:39.473 20:12:44 -- scripts/common.sh@352 -- # local d=1 00:11:39.473 20:12:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:39.473 20:12:44 -- scripts/common.sh@354 -- # echo 1 00:11:39.473 20:12:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:39.473 20:12:44 -- scripts/common.sh@365 -- # decimal 2 00:11:39.473 20:12:44 -- scripts/common.sh@352 -- # local d=2 00:11:39.473 20:12:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:39.473 20:12:44 -- scripts/common.sh@354 -- # echo 2 00:11:39.473 20:12:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:39.473 20:12:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:39.473 20:12:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:39.473 20:12:44 -- scripts/common.sh@367 -- # return 0 00:11:39.473 20:12:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:39.473 20:12:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:39.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:39.473 --rc genhtml_branch_coverage=1 00:11:39.473 --rc genhtml_function_coverage=1 00:11:39.473 --rc genhtml_legend=1 00:11:39.473 --rc geninfo_all_blocks=1 00:11:39.473 --rc geninfo_unexecuted_blocks=1 00:11:39.473 00:11:39.473 ' 00:11:39.473 20:12:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:39.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:39.473 --rc genhtml_branch_coverage=1 00:11:39.473 --rc genhtml_function_coverage=1 00:11:39.473 --rc genhtml_legend=1 00:11:39.473 --rc geninfo_all_blocks=1 00:11:39.473 --rc geninfo_unexecuted_blocks=1 00:11:39.473 00:11:39.473 ' 00:11:39.473 20:12:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:39.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:39.473 --rc genhtml_branch_coverage=1 00:11:39.473 --rc genhtml_function_coverage=1 00:11:39.473 --rc genhtml_legend=1 00:11:39.473 --rc geninfo_all_blocks=1 00:11:39.473 --rc geninfo_unexecuted_blocks=1 00:11:39.473 00:11:39.473 ' 00:11:39.473 20:12:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:39.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:39.473 --rc genhtml_branch_coverage=1 00:11:39.473 --rc genhtml_function_coverage=1 00:11:39.473 --rc genhtml_legend=1 00:11:39.473 --rc geninfo_all_blocks=1 00:11:39.473 --rc geninfo_unexecuted_blocks=1 00:11:39.473 00:11:39.473 ' 00:11:39.473 20:12:44 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:39.473 20:12:44 -- nvmf/common.sh@7 -- # uname -s 00:11:39.473 20:12:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:39.473 20:12:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:39.473 20:12:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:39.473 20:12:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:39.473 20:12:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:39.473 20:12:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:39.473 20:12:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:39.473 20:12:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:39.473 20:12:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:39.473 20:12:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:39.473 20:12:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:39.473 20:12:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:39.473 20:12:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:39.473 20:12:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:39.473 20:12:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:39.473 20:12:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:39.473 20:12:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:39.473 20:12:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:39.473 20:12:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:39.473 20:12:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:39.473 20:12:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:39.473 20:12:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:39.473 20:12:44 -- paths/export.sh@5 -- # export PATH 00:11:39.473 20:12:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:39.473 20:12:44 -- nvmf/common.sh@46 -- # : 0 00:11:39.473 20:12:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:39.473 20:12:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:39.474 20:12:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:39.474 20:12:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:39.474 20:12:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:39.474 20:12:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:39.474 20:12:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:39.474 20:12:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:39.474 20:12:44 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:39.474 20:12:44 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:39.474 20:12:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:39.474 20:12:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:39.474 20:12:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:39.474 20:12:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:39.474 20:12:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:39.474 20:12:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:39.474 20:12:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:39.474 20:12:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:39.474 20:12:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:39.474 20:12:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:39.474 20:12:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:39.474 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:11:41.999 20:12:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:41.999 20:12:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:41.999 20:12:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:41.999 20:12:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:41.999 20:12:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:41.999 20:12:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:41.999 20:12:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:41.999 20:12:46 -- nvmf/common.sh@294 -- # net_devs=() 00:11:41.999 20:12:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:41.999 20:12:46 -- nvmf/common.sh@295 -- # e810=() 00:11:41.999 20:12:46 -- nvmf/common.sh@295 -- # local -ga e810 00:11:41.999 20:12:46 -- nvmf/common.sh@296 -- # x722=() 00:11:41.999 20:12:46 -- nvmf/common.sh@296 -- # local -ga x722 00:11:41.999 20:12:46 -- nvmf/common.sh@297 -- # mlx=() 00:11:41.999 20:12:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:41.999 20:12:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:41.999 20:12:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:41.999 20:12:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:41.999 20:12:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:41.999 20:12:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:41.999 20:12:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:41.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:41.999 20:12:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:41.999 20:12:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:41.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:41.999 20:12:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:41.999 20:12:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:41.999 20:12:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:41.999 20:12:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:41.999 20:12:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:41.999 20:12:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:41.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:41.999 20:12:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:41.999 20:12:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:41.999 20:12:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:41.999 20:12:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:41.999 20:12:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:41.999 20:12:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:41.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:41.999 20:12:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:41.999 20:12:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:41.999 20:12:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:41.999 20:12:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:41.999 20:12:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:41.999 20:12:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:41.999 20:12:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:41.999 20:12:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:41.999 20:12:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:41.999 20:12:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:41.999 20:12:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:41.999 20:12:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:41.999 20:12:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:41.999 20:12:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:41.999 20:12:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:41.999 20:12:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:41.999 20:12:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:41.999 20:12:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:42.000 20:12:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:42.000 20:12:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:42.000 20:12:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:42.000 20:12:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:42.000 20:12:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:42.000 20:12:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:42.000 20:12:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:42.000 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:42.000 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:11:42.000 00:11:42.000 --- 10.0.0.2 ping statistics --- 00:11:42.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:42.000 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:11:42.000 20:12:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:42.000 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:42.000 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:11:42.000 00:11:42.000 --- 10.0.0.1 ping statistics --- 00:11:42.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:42.000 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:11:42.000 20:12:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:42.000 20:12:46 -- nvmf/common.sh@410 -- # return 0 00:11:42.000 20:12:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:42.000 20:12:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:42.000 20:12:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:42.000 20:12:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:42.000 20:12:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:42.000 20:12:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:42.000 20:12:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:42.000 20:12:46 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:42.000 20:12:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:42.000 20:12:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:42.000 20:12:46 -- common/autotest_common.sh@10 -- # set +x 00:11:42.000 20:12:46 -- nvmf/common.sh@469 -- # nvmfpid=3102881 00:11:42.000 20:12:46 -- nvmf/common.sh@470 -- # waitforlisten 3102881 00:11:42.000 20:12:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:42.000 20:12:46 -- common/autotest_common.sh@829 -- # '[' -z 3102881 ']' 00:11:42.000 20:12:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:42.000 20:12:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:42.000 20:12:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:42.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:42.000 20:12:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:42.000 20:12:46 -- common/autotest_common.sh@10 -- # set +x 00:11:42.000 [2024-11-20 20:12:46.733370] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:42.000 [2024-11-20 20:12:46.733468] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:42.000 EAL: No free 2048 kB hugepages reported on node 1 00:11:42.000 [2024-11-20 20:12:46.799709] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:42.000 [2024-11-20 20:12:46.910212] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:42.000 [2024-11-20 20:12:46.910383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:42.000 [2024-11-20 20:12:46.910401] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:42.000 [2024-11-20 20:12:46.910428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:42.000 [2024-11-20 20:12:46.910480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:42.000 [2024-11-20 20:12:46.910544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:42.000 [2024-11-20 20:12:46.910588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:42.000 [2024-11-20 20:12:46.910591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:42.932 20:12:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:42.932 20:12:47 -- common/autotest_common.sh@862 -- # return 0 00:11:42.932 20:12:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:42.932 20:12:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:42.932 20:12:47 -- common/autotest_common.sh@10 -- # set +x 00:11:42.932 20:12:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:42.932 20:12:47 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:42.932 20:12:47 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:42.932 20:12:47 -- target/multitarget.sh@21 -- # jq length 00:11:42.932 20:12:47 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:42.932 20:12:47 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:43.188 "nvmf_tgt_1" 00:11:43.188 20:12:48 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:43.188 "nvmf_tgt_2" 00:11:43.188 20:12:48 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:43.188 20:12:48 -- target/multitarget.sh@28 -- # jq length 00:11:43.445 20:12:48 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:43.445 20:12:48 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:43.445 true 00:11:43.445 20:12:48 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:43.445 true 00:11:43.703 20:12:48 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:43.703 20:12:48 -- target/multitarget.sh@35 -- # jq length 00:11:43.703 20:12:48 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:43.703 20:12:48 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:43.703 20:12:48 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:43.703 20:12:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:43.703 20:12:48 -- nvmf/common.sh@116 -- # sync 00:11:43.703 20:12:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:43.703 20:12:48 -- nvmf/common.sh@119 -- # set +e 00:11:43.703 20:12:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:43.703 20:12:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:43.703 rmmod nvme_tcp 00:11:43.703 rmmod nvme_fabrics 00:11:43.703 rmmod nvme_keyring 00:11:43.703 20:12:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:43.703 20:12:48 -- nvmf/common.sh@123 -- # set -e 00:11:43.703 20:12:48 -- nvmf/common.sh@124 -- # return 0 00:11:43.703 20:12:48 -- nvmf/common.sh@477 -- # '[' -n 3102881 ']' 00:11:43.703 20:12:48 -- nvmf/common.sh@478 -- # killprocess 3102881 00:11:43.703 20:12:48 -- common/autotest_common.sh@936 -- # '[' -z 3102881 ']' 00:11:43.703 20:12:48 -- common/autotest_common.sh@940 -- # kill -0 3102881 00:11:43.703 20:12:48 -- common/autotest_common.sh@941 -- # uname 00:11:43.703 20:12:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:43.703 20:12:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3102881 00:11:43.703 20:12:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:43.703 20:12:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:43.703 20:12:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3102881' 00:11:43.703 killing process with pid 3102881 00:11:43.703 20:12:48 -- common/autotest_common.sh@955 -- # kill 3102881 00:11:43.703 20:12:48 -- common/autotest_common.sh@960 -- # wait 3102881 00:11:43.961 20:12:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:43.961 20:12:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:43.961 20:12:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:43.961 20:12:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:43.961 20:12:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:43.962 20:12:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:43.962 20:12:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:43.962 20:12:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.499 20:12:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:46.499 00:11:46.499 real 0m6.677s 00:11:46.499 user 0m9.928s 00:11:46.499 sys 0m2.009s 00:11:46.499 20:12:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:46.499 20:12:51 -- common/autotest_common.sh@10 -- # set +x 00:11:46.499 ************************************ 00:11:46.499 END TEST nvmf_multitarget 00:11:46.499 ************************************ 00:11:46.499 20:12:51 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:46.499 20:12:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:46.499 20:12:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:46.499 20:12:51 -- common/autotest_common.sh@10 -- # set +x 00:11:46.499 ************************************ 00:11:46.499 START TEST nvmf_rpc 00:11:46.499 ************************************ 00:11:46.499 20:12:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:46.499 * Looking for test storage... 00:11:46.499 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:46.499 20:12:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:46.499 20:12:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:46.499 20:12:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:46.499 20:12:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:46.499 20:12:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:46.499 20:12:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:46.499 20:12:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:46.499 20:12:51 -- scripts/common.sh@335 -- # IFS=.-: 00:11:46.499 20:12:51 -- scripts/common.sh@335 -- # read -ra ver1 00:11:46.499 20:12:51 -- scripts/common.sh@336 -- # IFS=.-: 00:11:46.499 20:12:51 -- scripts/common.sh@336 -- # read -ra ver2 00:11:46.499 20:12:51 -- scripts/common.sh@337 -- # local 'op=<' 00:11:46.499 20:12:51 -- scripts/common.sh@339 -- # ver1_l=2 00:11:46.499 20:12:51 -- scripts/common.sh@340 -- # ver2_l=1 00:11:46.499 20:12:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:46.499 20:12:51 -- scripts/common.sh@343 -- # case "$op" in 00:11:46.499 20:12:51 -- scripts/common.sh@344 -- # : 1 00:11:46.499 20:12:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:46.499 20:12:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:46.499 20:12:51 -- scripts/common.sh@364 -- # decimal 1 00:11:46.499 20:12:51 -- scripts/common.sh@352 -- # local d=1 00:11:46.499 20:12:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:46.499 20:12:51 -- scripts/common.sh@354 -- # echo 1 00:11:46.499 20:12:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:46.499 20:12:51 -- scripts/common.sh@365 -- # decimal 2 00:11:46.499 20:12:51 -- scripts/common.sh@352 -- # local d=2 00:11:46.499 20:12:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:46.499 20:12:51 -- scripts/common.sh@354 -- # echo 2 00:11:46.499 20:12:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:46.499 20:12:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:46.499 20:12:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:46.499 20:12:51 -- scripts/common.sh@367 -- # return 0 00:11:46.499 20:12:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:46.499 20:12:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:46.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.499 --rc genhtml_branch_coverage=1 00:11:46.499 --rc genhtml_function_coverage=1 00:11:46.499 --rc genhtml_legend=1 00:11:46.499 --rc geninfo_all_blocks=1 00:11:46.499 --rc geninfo_unexecuted_blocks=1 00:11:46.499 00:11:46.499 ' 00:11:46.499 20:12:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:46.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.499 --rc genhtml_branch_coverage=1 00:11:46.499 --rc genhtml_function_coverage=1 00:11:46.499 --rc genhtml_legend=1 00:11:46.499 --rc geninfo_all_blocks=1 00:11:46.499 --rc geninfo_unexecuted_blocks=1 00:11:46.499 00:11:46.500 ' 00:11:46.500 20:12:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:46.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.500 --rc genhtml_branch_coverage=1 00:11:46.500 --rc genhtml_function_coverage=1 00:11:46.500 --rc genhtml_legend=1 00:11:46.500 --rc geninfo_all_blocks=1 00:11:46.500 --rc geninfo_unexecuted_blocks=1 00:11:46.500 00:11:46.500 ' 00:11:46.500 20:12:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:46.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.500 --rc genhtml_branch_coverage=1 00:11:46.500 --rc genhtml_function_coverage=1 00:11:46.500 --rc genhtml_legend=1 00:11:46.500 --rc geninfo_all_blocks=1 00:11:46.500 --rc geninfo_unexecuted_blocks=1 00:11:46.500 00:11:46.500 ' 00:11:46.500 20:12:51 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:46.500 20:12:51 -- nvmf/common.sh@7 -- # uname -s 00:11:46.500 20:12:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:46.500 20:12:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:46.500 20:12:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:46.500 20:12:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:46.500 20:12:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:46.500 20:12:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:46.500 20:12:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:46.500 20:12:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:46.500 20:12:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:46.500 20:12:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:46.500 20:12:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.500 20:12:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.500 20:12:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:46.500 20:12:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:46.500 20:12:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:46.500 20:12:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:46.500 20:12:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:46.500 20:12:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:46.500 20:12:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:46.500 20:12:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.500 20:12:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.500 20:12:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.500 20:12:51 -- paths/export.sh@5 -- # export PATH 00:11:46.500 20:12:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.500 20:12:51 -- nvmf/common.sh@46 -- # : 0 00:11:46.500 20:12:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:46.500 20:12:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:46.500 20:12:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:46.500 20:12:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:46.500 20:12:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:46.500 20:12:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:46.500 20:12:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:46.500 20:12:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:46.500 20:12:51 -- target/rpc.sh@11 -- # loops=5 00:11:46.500 20:12:51 -- target/rpc.sh@23 -- # nvmftestinit 00:11:46.500 20:12:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:46.500 20:12:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:46.500 20:12:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:46.500 20:12:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:46.500 20:12:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:46.500 20:12:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:46.500 20:12:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:46.500 20:12:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.500 20:12:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:46.500 20:12:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:46.500 20:12:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:46.500 20:12:51 -- common/autotest_common.sh@10 -- # set +x 00:11:48.403 20:12:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:48.403 20:12:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:48.403 20:12:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:48.403 20:12:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:48.403 20:12:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:48.403 20:12:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:48.403 20:12:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:48.403 20:12:53 -- nvmf/common.sh@294 -- # net_devs=() 00:11:48.403 20:12:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:48.403 20:12:53 -- nvmf/common.sh@295 -- # e810=() 00:11:48.403 20:12:53 -- nvmf/common.sh@295 -- # local -ga e810 00:11:48.403 20:12:53 -- nvmf/common.sh@296 -- # x722=() 00:11:48.403 20:12:53 -- nvmf/common.sh@296 -- # local -ga x722 00:11:48.403 20:12:53 -- nvmf/common.sh@297 -- # mlx=() 00:11:48.403 20:12:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:48.403 20:12:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:48.403 20:12:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:48.403 20:12:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:48.403 20:12:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:48.403 20:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:48.403 20:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:48.403 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:48.403 20:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:48.403 20:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:48.403 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:48.403 20:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:48.403 20:12:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:48.403 20:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:48.403 20:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:48.403 20:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:48.403 20:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:48.403 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:48.403 20:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:48.403 20:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:48.403 20:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:48.403 20:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:48.403 20:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:48.403 20:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:48.403 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:48.403 20:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:48.403 20:12:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:48.403 20:12:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:48.403 20:12:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:48.403 20:12:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:48.403 20:12:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:48.403 20:12:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:48.403 20:12:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:48.403 20:12:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:48.403 20:12:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:48.403 20:12:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:48.403 20:12:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:48.403 20:12:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:48.403 20:12:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:48.403 20:12:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:48.403 20:12:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:48.403 20:12:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:48.403 20:12:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:48.403 20:12:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:48.403 20:12:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:48.403 20:12:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:48.403 20:12:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:48.403 20:12:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:48.403 20:12:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:48.403 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:48.403 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:11:48.403 00:11:48.403 --- 10.0.0.2 ping statistics --- 00:11:48.403 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:48.403 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:11:48.403 20:12:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:48.403 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:48.403 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:11:48.403 00:11:48.403 --- 10.0.0.1 ping statistics --- 00:11:48.403 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:48.403 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:11:48.403 20:12:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:48.403 20:12:53 -- nvmf/common.sh@410 -- # return 0 00:11:48.403 20:12:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:48.403 20:12:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:48.403 20:12:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:48.403 20:12:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:48.403 20:12:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:48.403 20:12:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:48.403 20:12:53 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:48.403 20:12:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:48.403 20:12:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:48.403 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:11:48.403 20:12:53 -- nvmf/common.sh@469 -- # nvmfpid=3105115 00:11:48.403 20:12:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:48.403 20:12:53 -- nvmf/common.sh@470 -- # waitforlisten 3105115 00:11:48.404 20:12:53 -- common/autotest_common.sh@829 -- # '[' -z 3105115 ']' 00:11:48.404 20:12:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:48.404 20:12:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:48.404 20:12:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:48.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:48.404 20:12:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:48.404 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:11:48.662 [2024-11-20 20:12:53.444250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:48.662 [2024-11-20 20:12:53.444330] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:48.662 EAL: No free 2048 kB hugepages reported on node 1 00:11:48.662 [2024-11-20 20:12:53.514297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:48.662 [2024-11-20 20:12:53.634024] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:48.662 [2024-11-20 20:12:53.634199] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:48.662 [2024-11-20 20:12:53.634219] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:48.662 [2024-11-20 20:12:53.634234] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:48.662 [2024-11-20 20:12:53.634320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:48.662 [2024-11-20 20:12:53.634378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:48.662 [2024-11-20 20:12:53.634431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:48.662 [2024-11-20 20:12:53.634434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:49.595 20:12:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:49.595 20:12:54 -- common/autotest_common.sh@862 -- # return 0 00:11:49.595 20:12:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:49.595 20:12:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:49.595 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.595 20:12:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:49.595 20:12:54 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:49.595 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.595 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.595 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.595 20:12:54 -- target/rpc.sh@26 -- # stats='{ 00:11:49.595 "tick_rate": 2700000000, 00:11:49.595 "poll_groups": [ 00:11:49.595 { 00:11:49.595 "name": "nvmf_tgt_poll_group_0", 00:11:49.595 "admin_qpairs": 0, 00:11:49.595 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [] 00:11:49.596 }, 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_1", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [] 00:11:49.596 }, 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_2", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [] 00:11:49.596 }, 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_3", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [] 00:11:49.596 } 00:11:49.596 ] 00:11:49.596 }' 00:11:49.596 20:12:54 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:49.596 20:12:54 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:49.596 20:12:54 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:49.596 20:12:54 -- target/rpc.sh@15 -- # wc -l 00:11:49.596 20:12:54 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:49.596 20:12:54 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:49.596 20:12:54 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:49.596 20:12:54 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:49.596 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.596 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.596 [2024-11-20 20:12:54.528959] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:49.596 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.596 20:12:54 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:49.596 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.596 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.596 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.596 20:12:54 -- target/rpc.sh@33 -- # stats='{ 00:11:49.596 "tick_rate": 2700000000, 00:11:49.596 "poll_groups": [ 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_0", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [ 00:11:49.596 { 00:11:49.596 "trtype": "TCP" 00:11:49.596 } 00:11:49.596 ] 00:11:49.596 }, 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_1", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [ 00:11:49.596 { 00:11:49.596 "trtype": "TCP" 00:11:49.596 } 00:11:49.596 ] 00:11:49.596 }, 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_2", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [ 00:11:49.596 { 00:11:49.596 "trtype": "TCP" 00:11:49.596 } 00:11:49.596 ] 00:11:49.596 }, 00:11:49.596 { 00:11:49.596 "name": "nvmf_tgt_poll_group_3", 00:11:49.596 "admin_qpairs": 0, 00:11:49.596 "io_qpairs": 0, 00:11:49.596 "current_admin_qpairs": 0, 00:11:49.596 "current_io_qpairs": 0, 00:11:49.596 "pending_bdev_io": 0, 00:11:49.596 "completed_nvme_io": 0, 00:11:49.596 "transports": [ 00:11:49.596 { 00:11:49.596 "trtype": "TCP" 00:11:49.596 } 00:11:49.596 ] 00:11:49.596 } 00:11:49.596 ] 00:11:49.596 }' 00:11:49.596 20:12:54 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:49.596 20:12:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:49.596 20:12:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:49.596 20:12:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:49.596 20:12:54 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:49.596 20:12:54 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:49.596 20:12:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:49.596 20:12:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:49.596 20:12:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:49.596 20:12:54 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:49.596 20:12:54 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:49.596 20:12:54 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:49.596 20:12:54 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:49.596 20:12:54 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:49.596 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.596 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.854 Malloc1 00:11:49.854 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.854 20:12:54 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:49.854 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.854 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.854 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.854 20:12:54 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:49.854 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.854 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.854 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.854 20:12:54 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:49.854 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.854 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.854 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.854 20:12:54 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:49.854 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.854 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.854 [2024-11-20 20:12:54.682826] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:49.854 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.854 20:12:54 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:49.854 20:12:54 -- common/autotest_common.sh@650 -- # local es=0 00:11:49.854 20:12:54 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:49.854 20:12:54 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:49.854 20:12:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.854 20:12:54 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:49.854 20:12:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.854 20:12:54 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:49.854 20:12:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.854 20:12:54 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:49.855 20:12:54 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:49.855 20:12:54 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:49.855 [2024-11-20 20:12:54.705321] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:49.855 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:49.855 could not add new controller: failed to write to nvme-fabrics device 00:11:49.855 20:12:54 -- common/autotest_common.sh@653 -- # es=1 00:11:49.855 20:12:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:49.855 20:12:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:49.855 20:12:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:49.855 20:12:54 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.855 20:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.855 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:49.855 20:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.855 20:12:54 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.421 20:12:55 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:50.421 20:12:55 -- common/autotest_common.sh@1187 -- # local i=0 00:11:50.421 20:12:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:50.421 20:12:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:50.421 20:12:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:52.319 20:12:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:52.319 20:12:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:52.319 20:12:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:52.577 20:12:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:52.577 20:12:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:52.577 20:12:57 -- common/autotest_common.sh@1197 -- # return 0 00:11:52.577 20:12:57 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:52.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.577 20:12:57 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:52.577 20:12:57 -- common/autotest_common.sh@1208 -- # local i=0 00:11:52.577 20:12:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:52.577 20:12:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.577 20:12:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:52.577 20:12:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.577 20:12:57 -- common/autotest_common.sh@1220 -- # return 0 00:11:52.577 20:12:57 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:52.577 20:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.577 20:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:52.577 20:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.577 20:12:57 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:52.577 20:12:57 -- common/autotest_common.sh@650 -- # local es=0 00:11:52.577 20:12:57 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:52.578 20:12:57 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:52.578 20:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:52.578 20:12:57 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:52.578 20:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:52.578 20:12:57 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:52.578 20:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:52.578 20:12:57 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:52.578 20:12:57 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:52.578 20:12:57 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:52.578 [2024-11-20 20:12:57.507447] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:52.578 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:52.578 could not add new controller: failed to write to nvme-fabrics device 00:11:52.578 20:12:57 -- common/autotest_common.sh@653 -- # es=1 00:11:52.578 20:12:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:52.578 20:12:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:52.578 20:12:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:52.578 20:12:57 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:52.578 20:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.578 20:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:52.578 20:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.578 20:12:57 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.511 20:12:58 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:53.512 20:12:58 -- common/autotest_common.sh@1187 -- # local i=0 00:11:53.512 20:12:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:53.512 20:12:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:53.512 20:12:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:55.409 20:13:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:55.409 20:13:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:55.409 20:13:00 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:55.409 20:13:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:55.409 20:13:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:55.409 20:13:00 -- common/autotest_common.sh@1197 -- # return 0 00:11:55.409 20:13:00 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:55.409 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.409 20:13:00 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:55.409 20:13:00 -- common/autotest_common.sh@1208 -- # local i=0 00:11:55.409 20:13:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:55.409 20:13:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.409 20:13:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:55.409 20:13:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.409 20:13:00 -- common/autotest_common.sh@1220 -- # return 0 00:11:55.409 20:13:00 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:55.409 20:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.409 20:13:00 -- common/autotest_common.sh@10 -- # set +x 00:11:55.409 20:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.409 20:13:00 -- target/rpc.sh@81 -- # seq 1 5 00:11:55.409 20:13:00 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:55.409 20:13:00 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:55.409 20:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.409 20:13:00 -- common/autotest_common.sh@10 -- # set +x 00:11:55.409 20:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.409 20:13:00 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:55.409 20:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.409 20:13:00 -- common/autotest_common.sh@10 -- # set +x 00:11:55.409 [2024-11-20 20:13:00.434510] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:55.409 20:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.409 20:13:00 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:55.409 20:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.409 20:13:00 -- common/autotest_common.sh@10 -- # set +x 00:11:55.667 20:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.667 20:13:00 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:55.667 20:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.667 20:13:00 -- common/autotest_common.sh@10 -- # set +x 00:11:55.667 20:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.667 20:13:00 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:56.233 20:13:01 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:56.233 20:13:01 -- common/autotest_common.sh@1187 -- # local i=0 00:11:56.233 20:13:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:56.233 20:13:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:56.233 20:13:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:58.131 20:13:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:58.131 20:13:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:58.131 20:13:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:58.131 20:13:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:58.131 20:13:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:58.131 20:13:03 -- common/autotest_common.sh@1197 -- # return 0 00:11:58.131 20:13:03 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:58.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.389 20:13:03 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:58.389 20:13:03 -- common/autotest_common.sh@1208 -- # local i=0 00:11:58.389 20:13:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:58.389 20:13:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.389 20:13:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:58.389 20:13:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.389 20:13:03 -- common/autotest_common.sh@1220 -- # return 0 00:11:58.389 20:13:03 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:58.389 20:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.389 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:11:58.389 20:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.389 20:13:03 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:58.389 20:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.389 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:11:58.389 20:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.389 20:13:03 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:58.389 20:13:03 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:58.389 20:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.389 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:11:58.389 20:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.389 20:13:03 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:58.389 20:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.389 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:11:58.389 [2024-11-20 20:13:03.221186] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:58.389 20:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.389 20:13:03 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:58.389 20:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.389 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:11:58.389 20:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.389 20:13:03 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:58.389 20:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.389 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:11:58.389 20:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.389 20:13:03 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.954 20:13:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:58.954 20:13:03 -- common/autotest_common.sh@1187 -- # local i=0 00:11:58.954 20:13:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:58.954 20:13:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:58.955 20:13:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.493 20:13:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.493 20:13:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.493 20:13:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.493 20:13:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.493 20:13:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.493 20:13:05 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.493 20:13:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:01.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.493 20:13:06 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:01.493 20:13:06 -- common/autotest_common.sh@1208 -- # local i=0 00:12:01.493 20:13:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:01.493 20:13:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.493 20:13:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:01.493 20:13:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.493 20:13:06 -- common/autotest_common.sh@1220 -- # return 0 00:12:01.493 20:13:06 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:01.493 20:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.493 20:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:01.493 20:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.493 20:13:06 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:01.493 20:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.493 20:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:01.493 20:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.493 20:13:06 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:01.493 20:13:06 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:01.493 20:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.493 20:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:01.493 20:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.493 20:13:06 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.493 20:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.493 20:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:01.493 [2024-11-20 20:13:06.119786] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.493 20:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.493 20:13:06 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:01.493 20:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.493 20:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:01.494 20:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.494 20:13:06 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:01.494 20:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.494 20:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:01.494 20:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.494 20:13:06 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.060 20:13:06 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.060 20:13:06 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.060 20:13:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.060 20:13:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.060 20:13:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:03.959 20:13:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:03.959 20:13:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:03.959 20:13:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:03.959 20:13:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:03.959 20:13:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:03.959 20:13:08 -- common/autotest_common.sh@1197 -- # return 0 00:12:03.959 20:13:08 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:03.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.959 20:13:08 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:03.959 20:13:08 -- common/autotest_common.sh@1208 -- # local i=0 00:12:03.959 20:13:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:03.959 20:13:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.959 20:13:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:03.959 20:13:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.959 20:13:08 -- common/autotest_common.sh@1220 -- # return 0 00:12:03.959 20:13:08 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:03.959 20:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.959 20:13:08 -- common/autotest_common.sh@10 -- # set +x 00:12:03.959 20:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.959 20:13:08 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:03.959 20:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.959 20:13:08 -- common/autotest_common.sh@10 -- # set +x 00:12:03.959 20:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.959 20:13:08 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:03.959 20:13:08 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:03.959 20:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.959 20:13:08 -- common/autotest_common.sh@10 -- # set +x 00:12:03.959 20:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.959 20:13:08 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:03.959 20:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.959 20:13:08 -- common/autotest_common.sh@10 -- # set +x 00:12:03.959 [2024-11-20 20:13:08.935000] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:03.959 20:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.959 20:13:08 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:03.959 20:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.959 20:13:08 -- common/autotest_common.sh@10 -- # set +x 00:12:03.959 20:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.959 20:13:08 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:03.959 20:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.959 20:13:08 -- common/autotest_common.sh@10 -- # set +x 00:12:03.959 20:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.959 20:13:08 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.527 20:13:09 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.527 20:13:09 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.527 20:13:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.527 20:13:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.527 20:13:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:07.058 20:13:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:07.058 20:13:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:07.058 20:13:11 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:07.058 20:13:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:07.058 20:13:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:07.058 20:13:11 -- common/autotest_common.sh@1197 -- # return 0 00:12:07.058 20:13:11 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:07.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.058 20:13:11 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:07.058 20:13:11 -- common/autotest_common.sh@1208 -- # local i=0 00:12:07.058 20:13:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:07.058 20:13:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.058 20:13:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:07.058 20:13:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.058 20:13:11 -- common/autotest_common.sh@1220 -- # return 0 00:12:07.058 20:13:11 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:07.059 20:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.059 20:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:07.059 20:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.059 20:13:11 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:07.059 20:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.059 20:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:07.059 20:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.059 20:13:11 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:07.059 20:13:11 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:07.059 20:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.059 20:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:07.059 20:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.059 20:13:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:07.059 20:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.059 20:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:07.059 [2024-11-20 20:13:11.707220] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:07.059 20:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.059 20:13:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:07.059 20:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.059 20:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:07.059 20:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.059 20:13:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:07.059 20:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.059 20:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:07.059 20:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.059 20:13:11 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:07.316 20:13:12 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:07.316 20:13:12 -- common/autotest_common.sh@1187 -- # local i=0 00:12:07.316 20:13:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:07.316 20:13:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:07.316 20:13:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:09.845 20:13:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:09.845 20:13:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:09.845 20:13:14 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:09.845 20:13:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:09.845 20:13:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:09.845 20:13:14 -- common/autotest_common.sh@1197 -- # return 0 00:12:09.845 20:13:14 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:09.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.845 20:13:14 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:09.845 20:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:12:09.845 20:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:09.845 20:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.845 20:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:09.845 20:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.845 20:13:14 -- common/autotest_common.sh@1220 -- # return 0 00:12:09.845 20:13:14 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:09.845 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.845 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.845 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.845 20:13:14 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.845 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.845 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@99 -- # seq 1 5 00:12:09.846 20:13:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:09.846 20:13:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 [2024-11-20 20:13:14.500814] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:09.846 20:13:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 [2024-11-20 20:13:14.548883] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:09.846 20:13:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 [2024-11-20 20:13:14.597046] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:09.846 20:13:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 [2024-11-20 20:13:14.645254] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:09.846 20:13:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.846 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.846 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.846 20:13:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.846 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.847 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.847 [2024-11-20 20:13:14.693407] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.847 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.847 20:13:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:09.847 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.847 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.847 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.847 20:13:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.847 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.847 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.847 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.847 20:13:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:09.847 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.847 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.847 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.847 20:13:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.847 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.847 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.847 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.847 20:13:14 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:09.847 20:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.847 20:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:09.847 20:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.847 20:13:14 -- target/rpc.sh@110 -- # stats='{ 00:12:09.847 "tick_rate": 2700000000, 00:12:09.847 "poll_groups": [ 00:12:09.847 { 00:12:09.847 "name": "nvmf_tgt_poll_group_0", 00:12:09.847 "admin_qpairs": 2, 00:12:09.847 "io_qpairs": 84, 00:12:09.847 "current_admin_qpairs": 0, 00:12:09.847 "current_io_qpairs": 0, 00:12:09.847 "pending_bdev_io": 0, 00:12:09.847 "completed_nvme_io": 133, 00:12:09.847 "transports": [ 00:12:09.847 { 00:12:09.847 "trtype": "TCP" 00:12:09.847 } 00:12:09.847 ] 00:12:09.847 }, 00:12:09.847 { 00:12:09.847 "name": "nvmf_tgt_poll_group_1", 00:12:09.847 "admin_qpairs": 2, 00:12:09.847 "io_qpairs": 84, 00:12:09.847 "current_admin_qpairs": 0, 00:12:09.847 "current_io_qpairs": 0, 00:12:09.847 "pending_bdev_io": 0, 00:12:09.847 "completed_nvme_io": 182, 00:12:09.847 "transports": [ 00:12:09.847 { 00:12:09.847 "trtype": "TCP" 00:12:09.847 } 00:12:09.847 ] 00:12:09.847 }, 00:12:09.847 { 00:12:09.847 "name": "nvmf_tgt_poll_group_2", 00:12:09.847 "admin_qpairs": 1, 00:12:09.847 "io_qpairs": 84, 00:12:09.847 "current_admin_qpairs": 0, 00:12:09.847 "current_io_qpairs": 0, 00:12:09.847 "pending_bdev_io": 0, 00:12:09.847 "completed_nvme_io": 237, 00:12:09.847 "transports": [ 00:12:09.847 { 00:12:09.847 "trtype": "TCP" 00:12:09.847 } 00:12:09.847 ] 00:12:09.847 }, 00:12:09.847 { 00:12:09.847 "name": "nvmf_tgt_poll_group_3", 00:12:09.847 "admin_qpairs": 2, 00:12:09.847 "io_qpairs": 84, 00:12:09.847 "current_admin_qpairs": 0, 00:12:09.847 "current_io_qpairs": 0, 00:12:09.847 "pending_bdev_io": 0, 00:12:09.847 "completed_nvme_io": 134, 00:12:09.847 "transports": [ 00:12:09.847 { 00:12:09.847 "trtype": "TCP" 00:12:09.847 } 00:12:09.847 ] 00:12:09.847 } 00:12:09.847 ] 00:12:09.847 }' 00:12:09.847 20:13:14 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:09.847 20:13:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:09.847 20:13:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:09.847 20:13:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:09.847 20:13:14 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:09.847 20:13:14 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:09.847 20:13:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:09.847 20:13:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:09.847 20:13:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:09.847 20:13:14 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:09.847 20:13:14 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:09.847 20:13:14 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:09.847 20:13:14 -- target/rpc.sh@123 -- # nvmftestfini 00:12:09.847 20:13:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:09.847 20:13:14 -- nvmf/common.sh@116 -- # sync 00:12:09.847 20:13:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:09.847 20:13:14 -- nvmf/common.sh@119 -- # set +e 00:12:09.847 20:13:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:09.847 20:13:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:09.847 rmmod nvme_tcp 00:12:09.847 rmmod nvme_fabrics 00:12:09.847 rmmod nvme_keyring 00:12:10.106 20:13:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:10.106 20:13:14 -- nvmf/common.sh@123 -- # set -e 00:12:10.106 20:13:14 -- nvmf/common.sh@124 -- # return 0 00:12:10.106 20:13:14 -- nvmf/common.sh@477 -- # '[' -n 3105115 ']' 00:12:10.106 20:13:14 -- nvmf/common.sh@478 -- # killprocess 3105115 00:12:10.106 20:13:14 -- common/autotest_common.sh@936 -- # '[' -z 3105115 ']' 00:12:10.106 20:13:14 -- common/autotest_common.sh@940 -- # kill -0 3105115 00:12:10.106 20:13:14 -- common/autotest_common.sh@941 -- # uname 00:12:10.106 20:13:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:10.106 20:13:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3105115 00:12:10.106 20:13:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:10.106 20:13:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:10.106 20:13:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3105115' 00:12:10.106 killing process with pid 3105115 00:12:10.106 20:13:14 -- common/autotest_common.sh@955 -- # kill 3105115 00:12:10.106 20:13:14 -- common/autotest_common.sh@960 -- # wait 3105115 00:12:10.366 20:13:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:10.366 20:13:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:10.366 20:13:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:10.366 20:13:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:10.366 20:13:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:10.366 20:13:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:10.366 20:13:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:10.366 20:13:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:12.273 20:13:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:12.273 00:12:12.273 real 0m26.235s 00:12:12.273 user 1m25.721s 00:12:12.273 sys 0m4.210s 00:12:12.273 20:13:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:12.273 20:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:12.273 ************************************ 00:12:12.273 END TEST nvmf_rpc 00:12:12.273 ************************************ 00:12:12.273 20:13:17 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:12.273 20:13:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:12.273 20:13:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:12.273 20:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:12.273 ************************************ 00:12:12.273 START TEST nvmf_invalid 00:12:12.273 ************************************ 00:12:12.273 20:13:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:12.532 * Looking for test storage... 00:12:12.532 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:12.532 20:13:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:12.532 20:13:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:12.532 20:13:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:12.532 20:13:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:12.532 20:13:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:12.532 20:13:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:12.532 20:13:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:12.532 20:13:17 -- scripts/common.sh@335 -- # IFS=.-: 00:12:12.532 20:13:17 -- scripts/common.sh@335 -- # read -ra ver1 00:12:12.532 20:13:17 -- scripts/common.sh@336 -- # IFS=.-: 00:12:12.532 20:13:17 -- scripts/common.sh@336 -- # read -ra ver2 00:12:12.532 20:13:17 -- scripts/common.sh@337 -- # local 'op=<' 00:12:12.532 20:13:17 -- scripts/common.sh@339 -- # ver1_l=2 00:12:12.532 20:13:17 -- scripts/common.sh@340 -- # ver2_l=1 00:12:12.532 20:13:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:12.532 20:13:17 -- scripts/common.sh@343 -- # case "$op" in 00:12:12.532 20:13:17 -- scripts/common.sh@344 -- # : 1 00:12:12.532 20:13:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:12.532 20:13:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:12.532 20:13:17 -- scripts/common.sh@364 -- # decimal 1 00:12:12.532 20:13:17 -- scripts/common.sh@352 -- # local d=1 00:12:12.532 20:13:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:12.532 20:13:17 -- scripts/common.sh@354 -- # echo 1 00:12:12.532 20:13:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:12.532 20:13:17 -- scripts/common.sh@365 -- # decimal 2 00:12:12.532 20:13:17 -- scripts/common.sh@352 -- # local d=2 00:12:12.532 20:13:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:12.532 20:13:17 -- scripts/common.sh@354 -- # echo 2 00:12:12.532 20:13:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:12.532 20:13:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:12.532 20:13:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:12.532 20:13:17 -- scripts/common.sh@367 -- # return 0 00:12:12.532 20:13:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:12.532 20:13:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:12.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:12.532 --rc genhtml_branch_coverage=1 00:12:12.532 --rc genhtml_function_coverage=1 00:12:12.532 --rc genhtml_legend=1 00:12:12.532 --rc geninfo_all_blocks=1 00:12:12.532 --rc geninfo_unexecuted_blocks=1 00:12:12.532 00:12:12.532 ' 00:12:12.532 20:13:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:12.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:12.532 --rc genhtml_branch_coverage=1 00:12:12.532 --rc genhtml_function_coverage=1 00:12:12.532 --rc genhtml_legend=1 00:12:12.532 --rc geninfo_all_blocks=1 00:12:12.532 --rc geninfo_unexecuted_blocks=1 00:12:12.532 00:12:12.532 ' 00:12:12.533 20:13:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:12.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:12.533 --rc genhtml_branch_coverage=1 00:12:12.533 --rc genhtml_function_coverage=1 00:12:12.533 --rc genhtml_legend=1 00:12:12.533 --rc geninfo_all_blocks=1 00:12:12.533 --rc geninfo_unexecuted_blocks=1 00:12:12.533 00:12:12.533 ' 00:12:12.533 20:13:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:12.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:12.533 --rc genhtml_branch_coverage=1 00:12:12.533 --rc genhtml_function_coverage=1 00:12:12.533 --rc genhtml_legend=1 00:12:12.533 --rc geninfo_all_blocks=1 00:12:12.533 --rc geninfo_unexecuted_blocks=1 00:12:12.533 00:12:12.533 ' 00:12:12.533 20:13:17 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:12.533 20:13:17 -- nvmf/common.sh@7 -- # uname -s 00:12:12.533 20:13:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:12.533 20:13:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:12.533 20:13:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:12.533 20:13:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:12.533 20:13:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:12.533 20:13:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:12.533 20:13:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:12.533 20:13:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:12.533 20:13:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:12.533 20:13:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:12.533 20:13:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:12.533 20:13:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:12.533 20:13:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:12.533 20:13:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:12.533 20:13:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:12.533 20:13:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:12.533 20:13:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:12.533 20:13:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:12.533 20:13:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:12.533 20:13:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:12.533 20:13:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:12.533 20:13:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:12.533 20:13:17 -- paths/export.sh@5 -- # export PATH 00:12:12.533 20:13:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:12.533 20:13:17 -- nvmf/common.sh@46 -- # : 0 00:12:12.533 20:13:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:12.533 20:13:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:12.533 20:13:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:12.533 20:13:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:12.533 20:13:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:12.533 20:13:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:12.533 20:13:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:12.533 20:13:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:12.533 20:13:17 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:12.533 20:13:17 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:12.533 20:13:17 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:12.533 20:13:17 -- target/invalid.sh@14 -- # target=foobar 00:12:12.533 20:13:17 -- target/invalid.sh@16 -- # RANDOM=0 00:12:12.533 20:13:17 -- target/invalid.sh@34 -- # nvmftestinit 00:12:12.533 20:13:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:12.533 20:13:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:12.533 20:13:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:12.533 20:13:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:12.533 20:13:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:12.533 20:13:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:12.533 20:13:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:12.533 20:13:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:12.533 20:13:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:12.533 20:13:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:12.533 20:13:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:12.533 20:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:15.067 20:13:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:15.067 20:13:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:15.067 20:13:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:15.067 20:13:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:15.067 20:13:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:15.067 20:13:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:15.067 20:13:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:15.067 20:13:19 -- nvmf/common.sh@294 -- # net_devs=() 00:12:15.067 20:13:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:15.067 20:13:19 -- nvmf/common.sh@295 -- # e810=() 00:12:15.067 20:13:19 -- nvmf/common.sh@295 -- # local -ga e810 00:12:15.067 20:13:19 -- nvmf/common.sh@296 -- # x722=() 00:12:15.067 20:13:19 -- nvmf/common.sh@296 -- # local -ga x722 00:12:15.067 20:13:19 -- nvmf/common.sh@297 -- # mlx=() 00:12:15.067 20:13:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:15.067 20:13:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:15.067 20:13:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:15.067 20:13:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:15.067 20:13:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:15.067 20:13:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:15.067 20:13:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:15.067 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:15.067 20:13:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:15.067 20:13:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:15.067 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:15.067 20:13:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:15.067 20:13:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:15.067 20:13:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:15.068 20:13:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:15.068 20:13:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:15.068 20:13:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:15.068 20:13:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:15.068 20:13:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:15.068 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:15.068 20:13:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:15.068 20:13:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:15.068 20:13:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:15.068 20:13:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:15.068 20:13:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:15.068 20:13:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:15.068 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:15.068 20:13:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:15.068 20:13:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:15.068 20:13:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:15.068 20:13:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:15.068 20:13:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:15.068 20:13:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:15.068 20:13:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:15.068 20:13:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:15.068 20:13:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:15.068 20:13:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:15.068 20:13:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:15.068 20:13:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:15.068 20:13:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:15.068 20:13:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:15.068 20:13:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:15.068 20:13:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:15.068 20:13:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:15.068 20:13:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:15.068 20:13:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:15.068 20:13:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:15.068 20:13:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:15.068 20:13:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:15.068 20:13:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:15.068 20:13:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:15.068 20:13:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:15.068 20:13:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:15.068 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:15.068 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:12:15.068 00:12:15.068 --- 10.0.0.2 ping statistics --- 00:12:15.068 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:15.068 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:12:15.068 20:13:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:15.068 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:15.068 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:12:15.068 00:12:15.068 --- 10.0.0.1 ping statistics --- 00:12:15.068 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:15.068 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:12:15.068 20:13:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:15.068 20:13:19 -- nvmf/common.sh@410 -- # return 0 00:12:15.068 20:13:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:15.068 20:13:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:15.068 20:13:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:15.068 20:13:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:15.068 20:13:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:15.068 20:13:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:15.068 20:13:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:15.068 20:13:19 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:15.068 20:13:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:15.068 20:13:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:15.068 20:13:19 -- common/autotest_common.sh@10 -- # set +x 00:12:15.068 20:13:19 -- nvmf/common.sh@469 -- # nvmfpid=3109957 00:12:15.068 20:13:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:15.068 20:13:19 -- nvmf/common.sh@470 -- # waitforlisten 3109957 00:12:15.068 20:13:19 -- common/autotest_common.sh@829 -- # '[' -z 3109957 ']' 00:12:15.068 20:13:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:15.068 20:13:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:15.068 20:13:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:15.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:15.068 20:13:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:15.068 20:13:19 -- common/autotest_common.sh@10 -- # set +x 00:12:15.068 [2024-11-20 20:13:19.814349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:15.068 [2024-11-20 20:13:19.814430] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:15.068 EAL: No free 2048 kB hugepages reported on node 1 00:12:15.068 [2024-11-20 20:13:19.876874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:15.068 [2024-11-20 20:13:19.982184] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:15.068 [2024-11-20 20:13:19.982327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:15.068 [2024-11-20 20:13:19.982344] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:15.068 [2024-11-20 20:13:19.982363] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:15.068 [2024-11-20 20:13:19.982417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:15.068 [2024-11-20 20:13:19.982477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:15.068 [2024-11-20 20:13:19.982542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:15.068 [2024-11-20 20:13:19.982545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:16.127 20:13:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:16.127 20:13:20 -- common/autotest_common.sh@862 -- # return 0 00:12:16.127 20:13:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:16.127 20:13:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:16.127 20:13:20 -- common/autotest_common.sh@10 -- # set +x 00:12:16.127 20:13:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:16.127 20:13:20 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:16.127 20:13:20 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode29640 00:12:16.127 [2024-11-20 20:13:21.017325] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:16.127 20:13:21 -- target/invalid.sh@40 -- # out='request: 00:12:16.127 { 00:12:16.127 "nqn": "nqn.2016-06.io.spdk:cnode29640", 00:12:16.127 "tgt_name": "foobar", 00:12:16.127 "method": "nvmf_create_subsystem", 00:12:16.127 "req_id": 1 00:12:16.127 } 00:12:16.127 Got JSON-RPC error response 00:12:16.127 response: 00:12:16.127 { 00:12:16.127 "code": -32603, 00:12:16.127 "message": "Unable to find target foobar" 00:12:16.127 }' 00:12:16.127 20:13:21 -- target/invalid.sh@41 -- # [[ request: 00:12:16.127 { 00:12:16.127 "nqn": "nqn.2016-06.io.spdk:cnode29640", 00:12:16.127 "tgt_name": "foobar", 00:12:16.127 "method": "nvmf_create_subsystem", 00:12:16.127 "req_id": 1 00:12:16.127 } 00:12:16.127 Got JSON-RPC error response 00:12:16.127 response: 00:12:16.127 { 00:12:16.127 "code": -32603, 00:12:16.127 "message": "Unable to find target foobar" 00:12:16.127 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:16.127 20:13:21 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:16.127 20:13:21 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode5966 00:12:16.398 [2024-11-20 20:13:21.278209] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5966: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:16.398 20:13:21 -- target/invalid.sh@45 -- # out='request: 00:12:16.398 { 00:12:16.398 "nqn": "nqn.2016-06.io.spdk:cnode5966", 00:12:16.398 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:16.398 "method": "nvmf_create_subsystem", 00:12:16.398 "req_id": 1 00:12:16.398 } 00:12:16.398 Got JSON-RPC error response 00:12:16.398 response: 00:12:16.398 { 00:12:16.398 "code": -32602, 00:12:16.398 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:16.398 }' 00:12:16.398 20:13:21 -- target/invalid.sh@46 -- # [[ request: 00:12:16.398 { 00:12:16.398 "nqn": "nqn.2016-06.io.spdk:cnode5966", 00:12:16.398 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:16.398 "method": "nvmf_create_subsystem", 00:12:16.398 "req_id": 1 00:12:16.398 } 00:12:16.398 Got JSON-RPC error response 00:12:16.398 response: 00:12:16.398 { 00:12:16.398 "code": -32602, 00:12:16.398 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:16.398 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:16.398 20:13:21 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:16.398 20:13:21 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode23442 00:12:16.656 [2024-11-20 20:13:21.531001] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23442: invalid model number 'SPDK_Controller' 00:12:16.656 20:13:21 -- target/invalid.sh@50 -- # out='request: 00:12:16.656 { 00:12:16.656 "nqn": "nqn.2016-06.io.spdk:cnode23442", 00:12:16.656 "model_number": "SPDK_Controller\u001f", 00:12:16.656 "method": "nvmf_create_subsystem", 00:12:16.656 "req_id": 1 00:12:16.656 } 00:12:16.656 Got JSON-RPC error response 00:12:16.656 response: 00:12:16.656 { 00:12:16.656 "code": -32602, 00:12:16.656 "message": "Invalid MN SPDK_Controller\u001f" 00:12:16.656 }' 00:12:16.656 20:13:21 -- target/invalid.sh@51 -- # [[ request: 00:12:16.656 { 00:12:16.656 "nqn": "nqn.2016-06.io.spdk:cnode23442", 00:12:16.656 "model_number": "SPDK_Controller\u001f", 00:12:16.656 "method": "nvmf_create_subsystem", 00:12:16.656 "req_id": 1 00:12:16.656 } 00:12:16.656 Got JSON-RPC error response 00:12:16.656 response: 00:12:16.656 { 00:12:16.656 "code": -32602, 00:12:16.656 "message": "Invalid MN SPDK_Controller\u001f" 00:12:16.656 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:16.656 20:13:21 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:16.656 20:13:21 -- target/invalid.sh@19 -- # local length=21 ll 00:12:16.656 20:13:21 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:16.656 20:13:21 -- target/invalid.sh@21 -- # local chars 00:12:16.656 20:13:21 -- target/invalid.sh@22 -- # local string 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 66 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=B 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 69 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=E 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 77 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=M 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 32 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=' ' 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 78 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=N 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 73 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=I 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 121 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=y 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 53 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=5 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 74 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=J 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 86 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=V 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 75 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=K 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 63 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+='?' 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 95 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=_ 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 38 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+='&' 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # printf %x 117 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:16.656 20:13:21 -- target/invalid.sh@25 -- # string+=u 00:12:16.656 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # printf %x 62 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # string+='>' 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # printf %x 67 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # string+=C 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # printf %x 48 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # string+=0 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # printf %x 39 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # string+=\' 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # printf %x 111 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # string+=o 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # printf %x 58 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:16.657 20:13:21 -- target/invalid.sh@25 -- # string+=: 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.657 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.657 20:13:21 -- target/invalid.sh@28 -- # [[ B == \- ]] 00:12:16.657 20:13:21 -- target/invalid.sh@31 -- # echo 'BEM NIy5JVK?_&u>C0'\''o:' 00:12:16.657 20:13:21 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'BEM NIy5JVK?_&u>C0'\''o:' nqn.2016-06.io.spdk:cnode4872 00:12:16.915 [2024-11-20 20:13:21.880124] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4872: invalid serial number 'BEM NIy5JVK?_&u>C0'o:' 00:12:16.915 20:13:21 -- target/invalid.sh@54 -- # out='request: 00:12:16.915 { 00:12:16.915 "nqn": "nqn.2016-06.io.spdk:cnode4872", 00:12:16.915 "serial_number": "BEM NIy5JVK?_&u>C0'\''o:", 00:12:16.915 "method": "nvmf_create_subsystem", 00:12:16.915 "req_id": 1 00:12:16.915 } 00:12:16.915 Got JSON-RPC error response 00:12:16.915 response: 00:12:16.915 { 00:12:16.915 "code": -32602, 00:12:16.915 "message": "Invalid SN BEM NIy5JVK?_&u>C0'\''o:" 00:12:16.915 }' 00:12:16.915 20:13:21 -- target/invalid.sh@55 -- # [[ request: 00:12:16.915 { 00:12:16.915 "nqn": "nqn.2016-06.io.spdk:cnode4872", 00:12:16.915 "serial_number": "BEM NIy5JVK?_&u>C0'o:", 00:12:16.915 "method": "nvmf_create_subsystem", 00:12:16.915 "req_id": 1 00:12:16.915 } 00:12:16.915 Got JSON-RPC error response 00:12:16.915 response: 00:12:16.915 { 00:12:16.915 "code": -32602, 00:12:16.915 "message": "Invalid SN BEM NIy5JVK?_&u>C0'o:" 00:12:16.915 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:16.915 20:13:21 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:16.915 20:13:21 -- target/invalid.sh@19 -- # local length=41 ll 00:12:16.915 20:13:21 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:16.915 20:13:21 -- target/invalid.sh@21 -- # local chars 00:12:16.915 20:13:21 -- target/invalid.sh@22 -- # local string 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 78 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=N 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 104 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=h 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 62 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+='>' 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 104 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=h 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 32 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=' ' 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 117 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=u 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 101 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x65' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=e 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 77 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=M 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 79 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=O 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 34 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+='"' 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 44 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=, 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 112 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+=p 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # printf %x 35 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:16.915 20:13:21 -- target/invalid.sh@25 -- # string+='#' 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:16.915 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 44 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=, 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 103 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=g 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 56 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=8 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 32 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=' ' 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 70 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=F 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 109 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=m 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 50 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=2 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 70 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=F 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 69 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=E 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 51 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=3 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 47 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=/ 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 73 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=I 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 112 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+=p 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # printf %x 33 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:17.175 20:13:21 -- target/invalid.sh@25 -- # string+='!' 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 109 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=m 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 50 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=2 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 54 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=6 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 63 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+='?' 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 89 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=Y 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 76 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=L 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 54 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=6 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 46 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=. 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 32 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=' ' 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 89 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=Y 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 82 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=R 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 84 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=T 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 58 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=: 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # printf %x 86 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:17.175 20:13:22 -- target/invalid.sh@25 -- # string+=V 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.175 20:13:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.175 20:13:22 -- target/invalid.sh@28 -- # [[ N == \- ]] 00:12:17.175 20:13:22 -- target/invalid.sh@31 -- # echo 'Nh>h ueMO",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V' 00:12:17.175 20:13:22 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'Nh>h ueMO",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V' nqn.2016-06.io.spdk:cnode21560 00:12:17.434 [2024-11-20 20:13:22.281457] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21560: invalid model number 'Nh>h ueMO",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V' 00:12:17.434 20:13:22 -- target/invalid.sh@58 -- # out='request: 00:12:17.434 { 00:12:17.434 "nqn": "nqn.2016-06.io.spdk:cnode21560", 00:12:17.434 "model_number": "Nh>h ueMO\",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V", 00:12:17.434 "method": "nvmf_create_subsystem", 00:12:17.434 "req_id": 1 00:12:17.434 } 00:12:17.434 Got JSON-RPC error response 00:12:17.434 response: 00:12:17.434 { 00:12:17.434 "code": -32602, 00:12:17.434 "message": "Invalid MN Nh>h ueMO\",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V" 00:12:17.434 }' 00:12:17.434 20:13:22 -- target/invalid.sh@59 -- # [[ request: 00:12:17.434 { 00:12:17.434 "nqn": "nqn.2016-06.io.spdk:cnode21560", 00:12:17.434 "model_number": "Nh>h ueMO\",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V", 00:12:17.434 "method": "nvmf_create_subsystem", 00:12:17.434 "req_id": 1 00:12:17.434 } 00:12:17.434 Got JSON-RPC error response 00:12:17.434 response: 00:12:17.434 { 00:12:17.434 "code": -32602, 00:12:17.434 "message": "Invalid MN Nh>h ueMO\",p#,g8 Fm2FE3/Ip!m26?YL6. YRT:V" 00:12:17.434 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:17.434 20:13:22 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:17.692 [2024-11-20 20:13:22.570527] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:17.692 20:13:22 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:17.950 20:13:22 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:17.950 20:13:22 -- target/invalid.sh@67 -- # echo '' 00:12:17.950 20:13:22 -- target/invalid.sh@67 -- # head -n 1 00:12:17.950 20:13:22 -- target/invalid.sh@67 -- # IP= 00:12:17.950 20:13:22 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:18.208 [2024-11-20 20:13:23.104416] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:18.208 20:13:23 -- target/invalid.sh@69 -- # out='request: 00:12:18.208 { 00:12:18.208 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:18.208 "listen_address": { 00:12:18.208 "trtype": "tcp", 00:12:18.208 "traddr": "", 00:12:18.208 "trsvcid": "4421" 00:12:18.208 }, 00:12:18.208 "method": "nvmf_subsystem_remove_listener", 00:12:18.208 "req_id": 1 00:12:18.208 } 00:12:18.208 Got JSON-RPC error response 00:12:18.208 response: 00:12:18.208 { 00:12:18.208 "code": -32602, 00:12:18.208 "message": "Invalid parameters" 00:12:18.208 }' 00:12:18.208 20:13:23 -- target/invalid.sh@70 -- # [[ request: 00:12:18.208 { 00:12:18.208 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:18.208 "listen_address": { 00:12:18.208 "trtype": "tcp", 00:12:18.208 "traddr": "", 00:12:18.208 "trsvcid": "4421" 00:12:18.208 }, 00:12:18.208 "method": "nvmf_subsystem_remove_listener", 00:12:18.208 "req_id": 1 00:12:18.208 } 00:12:18.208 Got JSON-RPC error response 00:12:18.208 response: 00:12:18.208 { 00:12:18.208 "code": -32602, 00:12:18.208 "message": "Invalid parameters" 00:12:18.208 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:18.208 20:13:23 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15645 -i 0 00:12:18.465 [2024-11-20 20:13:23.353163] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15645: invalid cntlid range [0-65519] 00:12:18.465 20:13:23 -- target/invalid.sh@73 -- # out='request: 00:12:18.465 { 00:12:18.465 "nqn": "nqn.2016-06.io.spdk:cnode15645", 00:12:18.465 "min_cntlid": 0, 00:12:18.465 "method": "nvmf_create_subsystem", 00:12:18.465 "req_id": 1 00:12:18.465 } 00:12:18.465 Got JSON-RPC error response 00:12:18.465 response: 00:12:18.465 { 00:12:18.465 "code": -32602, 00:12:18.465 "message": "Invalid cntlid range [0-65519]" 00:12:18.465 }' 00:12:18.465 20:13:23 -- target/invalid.sh@74 -- # [[ request: 00:12:18.465 { 00:12:18.465 "nqn": "nqn.2016-06.io.spdk:cnode15645", 00:12:18.465 "min_cntlid": 0, 00:12:18.465 "method": "nvmf_create_subsystem", 00:12:18.465 "req_id": 1 00:12:18.465 } 00:12:18.465 Got JSON-RPC error response 00:12:18.465 response: 00:12:18.465 { 00:12:18.465 "code": -32602, 00:12:18.465 "message": "Invalid cntlid range [0-65519]" 00:12:18.465 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:18.465 20:13:23 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14656 -i 65520 00:12:18.723 [2024-11-20 20:13:23.597941] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14656: invalid cntlid range [65520-65519] 00:12:18.723 20:13:23 -- target/invalid.sh@75 -- # out='request: 00:12:18.723 { 00:12:18.723 "nqn": "nqn.2016-06.io.spdk:cnode14656", 00:12:18.723 "min_cntlid": 65520, 00:12:18.723 "method": "nvmf_create_subsystem", 00:12:18.723 "req_id": 1 00:12:18.723 } 00:12:18.723 Got JSON-RPC error response 00:12:18.723 response: 00:12:18.723 { 00:12:18.723 "code": -32602, 00:12:18.723 "message": "Invalid cntlid range [65520-65519]" 00:12:18.723 }' 00:12:18.723 20:13:23 -- target/invalid.sh@76 -- # [[ request: 00:12:18.723 { 00:12:18.723 "nqn": "nqn.2016-06.io.spdk:cnode14656", 00:12:18.723 "min_cntlid": 65520, 00:12:18.723 "method": "nvmf_create_subsystem", 00:12:18.723 "req_id": 1 00:12:18.723 } 00:12:18.723 Got JSON-RPC error response 00:12:18.723 response: 00:12:18.723 { 00:12:18.723 "code": -32602, 00:12:18.723 "message": "Invalid cntlid range [65520-65519]" 00:12:18.723 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:18.723 20:13:23 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30723 -I 0 00:12:18.982 [2024-11-20 20:13:23.842759] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30723: invalid cntlid range [1-0] 00:12:18.982 20:13:23 -- target/invalid.sh@77 -- # out='request: 00:12:18.982 { 00:12:18.982 "nqn": "nqn.2016-06.io.spdk:cnode30723", 00:12:18.982 "max_cntlid": 0, 00:12:18.982 "method": "nvmf_create_subsystem", 00:12:18.982 "req_id": 1 00:12:18.982 } 00:12:18.982 Got JSON-RPC error response 00:12:18.982 response: 00:12:18.982 { 00:12:18.982 "code": -32602, 00:12:18.982 "message": "Invalid cntlid range [1-0]" 00:12:18.982 }' 00:12:18.982 20:13:23 -- target/invalid.sh@78 -- # [[ request: 00:12:18.982 { 00:12:18.982 "nqn": "nqn.2016-06.io.spdk:cnode30723", 00:12:18.982 "max_cntlid": 0, 00:12:18.982 "method": "nvmf_create_subsystem", 00:12:18.982 "req_id": 1 00:12:18.982 } 00:12:18.982 Got JSON-RPC error response 00:12:18.982 response: 00:12:18.982 { 00:12:18.982 "code": -32602, 00:12:18.982 "message": "Invalid cntlid range [1-0]" 00:12:18.982 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:18.982 20:13:23 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14678 -I 65520 00:12:19.239 [2024-11-20 20:13:24.103670] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14678: invalid cntlid range [1-65520] 00:12:19.239 20:13:24 -- target/invalid.sh@79 -- # out='request: 00:12:19.239 { 00:12:19.239 "nqn": "nqn.2016-06.io.spdk:cnode14678", 00:12:19.240 "max_cntlid": 65520, 00:12:19.240 "method": "nvmf_create_subsystem", 00:12:19.240 "req_id": 1 00:12:19.240 } 00:12:19.240 Got JSON-RPC error response 00:12:19.240 response: 00:12:19.240 { 00:12:19.240 "code": -32602, 00:12:19.240 "message": "Invalid cntlid range [1-65520]" 00:12:19.240 }' 00:12:19.240 20:13:24 -- target/invalid.sh@80 -- # [[ request: 00:12:19.240 { 00:12:19.240 "nqn": "nqn.2016-06.io.spdk:cnode14678", 00:12:19.240 "max_cntlid": 65520, 00:12:19.240 "method": "nvmf_create_subsystem", 00:12:19.240 "req_id": 1 00:12:19.240 } 00:12:19.240 Got JSON-RPC error response 00:12:19.240 response: 00:12:19.240 { 00:12:19.240 "code": -32602, 00:12:19.240 "message": "Invalid cntlid range [1-65520]" 00:12:19.240 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:19.240 20:13:24 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6088 -i 6 -I 5 00:12:19.497 [2024-11-20 20:13:24.356538] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6088: invalid cntlid range [6-5] 00:12:19.497 20:13:24 -- target/invalid.sh@83 -- # out='request: 00:12:19.497 { 00:12:19.498 "nqn": "nqn.2016-06.io.spdk:cnode6088", 00:12:19.498 "min_cntlid": 6, 00:12:19.498 "max_cntlid": 5, 00:12:19.498 "method": "nvmf_create_subsystem", 00:12:19.498 "req_id": 1 00:12:19.498 } 00:12:19.498 Got JSON-RPC error response 00:12:19.498 response: 00:12:19.498 { 00:12:19.498 "code": -32602, 00:12:19.498 "message": "Invalid cntlid range [6-5]" 00:12:19.498 }' 00:12:19.498 20:13:24 -- target/invalid.sh@84 -- # [[ request: 00:12:19.498 { 00:12:19.498 "nqn": "nqn.2016-06.io.spdk:cnode6088", 00:12:19.498 "min_cntlid": 6, 00:12:19.498 "max_cntlid": 5, 00:12:19.498 "method": "nvmf_create_subsystem", 00:12:19.498 "req_id": 1 00:12:19.498 } 00:12:19.498 Got JSON-RPC error response 00:12:19.498 response: 00:12:19.498 { 00:12:19.498 "code": -32602, 00:12:19.498 "message": "Invalid cntlid range [6-5]" 00:12:19.498 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:19.498 20:13:24 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:19.498 20:13:24 -- target/invalid.sh@87 -- # out='request: 00:12:19.498 { 00:12:19.498 "name": "foobar", 00:12:19.498 "method": "nvmf_delete_target", 00:12:19.498 "req_id": 1 00:12:19.498 } 00:12:19.498 Got JSON-RPC error response 00:12:19.498 response: 00:12:19.498 { 00:12:19.498 "code": -32602, 00:12:19.498 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:19.498 }' 00:12:19.498 20:13:24 -- target/invalid.sh@88 -- # [[ request: 00:12:19.498 { 00:12:19.498 "name": "foobar", 00:12:19.498 "method": "nvmf_delete_target", 00:12:19.498 "req_id": 1 00:12:19.498 } 00:12:19.498 Got JSON-RPC error response 00:12:19.498 response: 00:12:19.498 { 00:12:19.498 "code": -32602, 00:12:19.498 "message": "The specified target doesn't exist, cannot delete it." 00:12:19.498 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:19.498 20:13:24 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:19.498 20:13:24 -- target/invalid.sh@91 -- # nvmftestfini 00:12:19.498 20:13:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:19.498 20:13:24 -- nvmf/common.sh@116 -- # sync 00:12:19.498 20:13:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:19.498 20:13:24 -- nvmf/common.sh@119 -- # set +e 00:12:19.498 20:13:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:19.498 20:13:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:19.498 rmmod nvme_tcp 00:12:19.498 rmmod nvme_fabrics 00:12:19.498 rmmod nvme_keyring 00:12:19.758 20:13:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:19.758 20:13:24 -- nvmf/common.sh@123 -- # set -e 00:12:19.758 20:13:24 -- nvmf/common.sh@124 -- # return 0 00:12:19.758 20:13:24 -- nvmf/common.sh@477 -- # '[' -n 3109957 ']' 00:12:19.758 20:13:24 -- nvmf/common.sh@478 -- # killprocess 3109957 00:12:19.758 20:13:24 -- common/autotest_common.sh@936 -- # '[' -z 3109957 ']' 00:12:19.758 20:13:24 -- common/autotest_common.sh@940 -- # kill -0 3109957 00:12:19.758 20:13:24 -- common/autotest_common.sh@941 -- # uname 00:12:19.758 20:13:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:19.758 20:13:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3109957 00:12:19.758 20:13:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:19.758 20:13:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:19.758 20:13:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3109957' 00:12:19.758 killing process with pid 3109957 00:12:19.758 20:13:24 -- common/autotest_common.sh@955 -- # kill 3109957 00:12:19.758 20:13:24 -- common/autotest_common.sh@960 -- # wait 3109957 00:12:20.017 20:13:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:20.017 20:13:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:20.017 20:13:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:20.017 20:13:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:20.017 20:13:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:20.017 20:13:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:20.017 20:13:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:20.017 20:13:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:21.921 20:13:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:21.921 00:12:21.921 real 0m9.608s 00:12:21.921 user 0m23.447s 00:12:21.921 sys 0m2.488s 00:12:21.921 20:13:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:21.921 20:13:26 -- common/autotest_common.sh@10 -- # set +x 00:12:21.921 ************************************ 00:12:21.921 END TEST nvmf_invalid 00:12:21.921 ************************************ 00:12:21.921 20:13:26 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:21.921 20:13:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:21.921 20:13:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:21.921 20:13:26 -- common/autotest_common.sh@10 -- # set +x 00:12:21.921 ************************************ 00:12:21.921 START TEST nvmf_abort 00:12:21.921 ************************************ 00:12:21.921 20:13:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:22.178 * Looking for test storage... 00:12:22.178 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:22.178 20:13:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:22.178 20:13:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:22.178 20:13:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:22.178 20:13:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:22.178 20:13:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:22.178 20:13:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:22.178 20:13:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:22.178 20:13:27 -- scripts/common.sh@335 -- # IFS=.-: 00:12:22.178 20:13:27 -- scripts/common.sh@335 -- # read -ra ver1 00:12:22.178 20:13:27 -- scripts/common.sh@336 -- # IFS=.-: 00:12:22.178 20:13:27 -- scripts/common.sh@336 -- # read -ra ver2 00:12:22.179 20:13:27 -- scripts/common.sh@337 -- # local 'op=<' 00:12:22.179 20:13:27 -- scripts/common.sh@339 -- # ver1_l=2 00:12:22.179 20:13:27 -- scripts/common.sh@340 -- # ver2_l=1 00:12:22.179 20:13:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:22.179 20:13:27 -- scripts/common.sh@343 -- # case "$op" in 00:12:22.179 20:13:27 -- scripts/common.sh@344 -- # : 1 00:12:22.179 20:13:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:22.179 20:13:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:22.179 20:13:27 -- scripts/common.sh@364 -- # decimal 1 00:12:22.179 20:13:27 -- scripts/common.sh@352 -- # local d=1 00:12:22.179 20:13:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:22.179 20:13:27 -- scripts/common.sh@354 -- # echo 1 00:12:22.179 20:13:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:22.179 20:13:27 -- scripts/common.sh@365 -- # decimal 2 00:12:22.179 20:13:27 -- scripts/common.sh@352 -- # local d=2 00:12:22.179 20:13:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:22.179 20:13:27 -- scripts/common.sh@354 -- # echo 2 00:12:22.179 20:13:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:22.179 20:13:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:22.179 20:13:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:22.179 20:13:27 -- scripts/common.sh@367 -- # return 0 00:12:22.179 20:13:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:22.179 20:13:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:22.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.179 --rc genhtml_branch_coverage=1 00:12:22.179 --rc genhtml_function_coverage=1 00:12:22.179 --rc genhtml_legend=1 00:12:22.179 --rc geninfo_all_blocks=1 00:12:22.179 --rc geninfo_unexecuted_blocks=1 00:12:22.179 00:12:22.179 ' 00:12:22.179 20:13:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:22.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.179 --rc genhtml_branch_coverage=1 00:12:22.179 --rc genhtml_function_coverage=1 00:12:22.179 --rc genhtml_legend=1 00:12:22.179 --rc geninfo_all_blocks=1 00:12:22.179 --rc geninfo_unexecuted_blocks=1 00:12:22.179 00:12:22.179 ' 00:12:22.179 20:13:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:22.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.179 --rc genhtml_branch_coverage=1 00:12:22.179 --rc genhtml_function_coverage=1 00:12:22.179 --rc genhtml_legend=1 00:12:22.179 --rc geninfo_all_blocks=1 00:12:22.179 --rc geninfo_unexecuted_blocks=1 00:12:22.179 00:12:22.179 ' 00:12:22.179 20:13:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:22.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.179 --rc genhtml_branch_coverage=1 00:12:22.179 --rc genhtml_function_coverage=1 00:12:22.179 --rc genhtml_legend=1 00:12:22.179 --rc geninfo_all_blocks=1 00:12:22.179 --rc geninfo_unexecuted_blocks=1 00:12:22.179 00:12:22.179 ' 00:12:22.179 20:13:27 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:22.179 20:13:27 -- nvmf/common.sh@7 -- # uname -s 00:12:22.179 20:13:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:22.179 20:13:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:22.179 20:13:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:22.179 20:13:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:22.179 20:13:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:22.179 20:13:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:22.179 20:13:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:22.179 20:13:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:22.179 20:13:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:22.179 20:13:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:22.179 20:13:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:22.179 20:13:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:22.179 20:13:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:22.179 20:13:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:22.179 20:13:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:22.179 20:13:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:22.179 20:13:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:22.179 20:13:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:22.179 20:13:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:22.179 20:13:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.179 20:13:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.179 20:13:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.179 20:13:27 -- paths/export.sh@5 -- # export PATH 00:12:22.179 20:13:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.179 20:13:27 -- nvmf/common.sh@46 -- # : 0 00:12:22.179 20:13:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:22.179 20:13:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:22.179 20:13:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:22.179 20:13:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:22.179 20:13:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:22.179 20:13:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:22.179 20:13:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:22.179 20:13:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:22.179 20:13:27 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:22.179 20:13:27 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:22.179 20:13:27 -- target/abort.sh@14 -- # nvmftestinit 00:12:22.179 20:13:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:22.179 20:13:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:22.179 20:13:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:22.179 20:13:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:22.179 20:13:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:22.179 20:13:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.179 20:13:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:22.179 20:13:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.179 20:13:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:22.179 20:13:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:22.179 20:13:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:22.179 20:13:27 -- common/autotest_common.sh@10 -- # set +x 00:12:24.082 20:13:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:24.082 20:13:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:24.082 20:13:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:24.082 20:13:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:24.082 20:13:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:24.082 20:13:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:24.082 20:13:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:24.082 20:13:29 -- nvmf/common.sh@294 -- # net_devs=() 00:12:24.082 20:13:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:24.082 20:13:29 -- nvmf/common.sh@295 -- # e810=() 00:12:24.082 20:13:29 -- nvmf/common.sh@295 -- # local -ga e810 00:12:24.082 20:13:29 -- nvmf/common.sh@296 -- # x722=() 00:12:24.082 20:13:29 -- nvmf/common.sh@296 -- # local -ga x722 00:12:24.082 20:13:29 -- nvmf/common.sh@297 -- # mlx=() 00:12:24.082 20:13:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:24.082 20:13:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:24.082 20:13:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:24.082 20:13:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:24.082 20:13:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:24.082 20:13:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:24.082 20:13:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:24.082 20:13:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:24.082 20:13:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.082 20:13:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:24.082 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:24.082 20:13:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.082 20:13:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.340 20:13:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:24.340 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:24.340 20:13:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:24.340 20:13:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.340 20:13:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.340 20:13:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.340 20:13:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.340 20:13:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:24.340 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:24.340 20:13:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.340 20:13:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.340 20:13:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.340 20:13:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.340 20:13:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.340 20:13:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:24.340 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:24.340 20:13:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.340 20:13:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:24.340 20:13:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:24.340 20:13:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:24.340 20:13:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:24.340 20:13:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:24.340 20:13:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:24.340 20:13:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:24.340 20:13:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:24.340 20:13:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:24.340 20:13:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:24.340 20:13:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:24.340 20:13:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:24.340 20:13:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:24.340 20:13:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:24.340 20:13:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:24.340 20:13:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:24.340 20:13:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:24.340 20:13:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:24.340 20:13:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:24.340 20:13:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:24.340 20:13:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:24.340 20:13:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:24.340 20:13:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:24.340 20:13:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:24.340 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:24.340 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:12:24.340 00:12:24.340 --- 10.0.0.2 ping statistics --- 00:12:24.340 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.340 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:12:24.340 20:13:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:24.340 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:24.340 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:12:24.340 00:12:24.340 --- 10.0.0.1 ping statistics --- 00:12:24.340 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.340 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:12:24.340 20:13:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:24.340 20:13:29 -- nvmf/common.sh@410 -- # return 0 00:12:24.340 20:13:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:24.340 20:13:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:24.340 20:13:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:24.341 20:13:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:24.341 20:13:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:24.341 20:13:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:24.341 20:13:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:24.341 20:13:29 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:24.341 20:13:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:24.341 20:13:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:24.341 20:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:24.341 20:13:29 -- nvmf/common.sh@469 -- # nvmfpid=3112637 00:12:24.341 20:13:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:24.341 20:13:29 -- nvmf/common.sh@470 -- # waitforlisten 3112637 00:12:24.341 20:13:29 -- common/autotest_common.sh@829 -- # '[' -z 3112637 ']' 00:12:24.341 20:13:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:24.341 20:13:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:24.341 20:13:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:24.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:24.341 20:13:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:24.341 20:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:24.341 [2024-11-20 20:13:29.324741] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:24.341 [2024-11-20 20:13:29.324818] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:24.341 EAL: No free 2048 kB hugepages reported on node 1 00:12:24.598 [2024-11-20 20:13:29.393829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:24.598 [2024-11-20 20:13:29.512938] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:24.598 [2024-11-20 20:13:29.513132] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:24.598 [2024-11-20 20:13:29.513164] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:24.598 [2024-11-20 20:13:29.513187] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:24.598 [2024-11-20 20:13:29.513305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:24.598 [2024-11-20 20:13:29.513379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:24.598 [2024-11-20 20:13:29.513369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:25.532 20:13:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:25.532 20:13:30 -- common/autotest_common.sh@862 -- # return 0 00:12:25.532 20:13:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:25.532 20:13:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:25.532 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.532 20:13:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:25.532 20:13:30 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:25.532 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.532 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.532 [2024-11-20 20:13:30.360847] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:25.532 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.532 20:13:30 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:25.532 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.532 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.532 Malloc0 00:12:25.532 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.532 20:13:30 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:25.532 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.532 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.532 Delay0 00:12:25.532 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.532 20:13:30 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:25.532 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.532 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.532 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.533 20:13:30 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:25.533 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.533 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.533 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.533 20:13:30 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:25.533 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.533 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.533 [2024-11-20 20:13:30.430225] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:25.533 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.533 20:13:30 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:25.533 20:13:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.533 20:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:25.533 20:13:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.533 20:13:30 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:25.533 EAL: No free 2048 kB hugepages reported on node 1 00:12:25.533 [2024-11-20 20:13:30.535100] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:28.063 Initializing NVMe Controllers 00:12:28.063 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:28.063 controller IO queue size 128 less than required 00:12:28.063 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:28.063 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:28.063 Initialization complete. Launching workers. 00:12:28.063 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34082 00:12:28.063 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34143, failed to submit 62 00:12:28.063 success 34082, unsuccess 61, failed 0 00:12:28.063 20:13:32 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:28.063 20:13:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.063 20:13:32 -- common/autotest_common.sh@10 -- # set +x 00:12:28.063 20:13:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.063 20:13:32 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:28.063 20:13:32 -- target/abort.sh@38 -- # nvmftestfini 00:12:28.063 20:13:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:28.063 20:13:32 -- nvmf/common.sh@116 -- # sync 00:12:28.063 20:13:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:28.063 20:13:32 -- nvmf/common.sh@119 -- # set +e 00:12:28.063 20:13:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:28.063 20:13:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:28.063 rmmod nvme_tcp 00:12:28.063 rmmod nvme_fabrics 00:12:28.063 rmmod nvme_keyring 00:12:28.063 20:13:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:28.063 20:13:32 -- nvmf/common.sh@123 -- # set -e 00:12:28.063 20:13:32 -- nvmf/common.sh@124 -- # return 0 00:12:28.063 20:13:32 -- nvmf/common.sh@477 -- # '[' -n 3112637 ']' 00:12:28.063 20:13:32 -- nvmf/common.sh@478 -- # killprocess 3112637 00:12:28.063 20:13:32 -- common/autotest_common.sh@936 -- # '[' -z 3112637 ']' 00:12:28.063 20:13:32 -- common/autotest_common.sh@940 -- # kill -0 3112637 00:12:28.063 20:13:32 -- common/autotest_common.sh@941 -- # uname 00:12:28.063 20:13:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:28.063 20:13:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3112637 00:12:28.063 20:13:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:28.063 20:13:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:28.063 20:13:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3112637' 00:12:28.063 killing process with pid 3112637 00:12:28.063 20:13:32 -- common/autotest_common.sh@955 -- # kill 3112637 00:12:28.063 20:13:32 -- common/autotest_common.sh@960 -- # wait 3112637 00:12:28.063 20:13:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:28.063 20:13:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:28.063 20:13:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:28.063 20:13:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:28.063 20:13:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:28.063 20:13:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:28.063 20:13:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:28.063 20:13:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.603 20:13:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:30.603 00:12:30.603 real 0m8.141s 00:12:30.603 user 0m13.033s 00:12:30.603 sys 0m2.566s 00:12:30.603 20:13:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:30.603 20:13:35 -- common/autotest_common.sh@10 -- # set +x 00:12:30.603 ************************************ 00:12:30.603 END TEST nvmf_abort 00:12:30.603 ************************************ 00:12:30.603 20:13:35 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:30.603 20:13:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:30.603 20:13:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:30.603 20:13:35 -- common/autotest_common.sh@10 -- # set +x 00:12:30.603 ************************************ 00:12:30.603 START TEST nvmf_ns_hotplug_stress 00:12:30.603 ************************************ 00:12:30.603 20:13:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:30.603 * Looking for test storage... 00:12:30.603 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:30.603 20:13:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:30.603 20:13:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:30.603 20:13:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:30.603 20:13:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:30.603 20:13:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:30.603 20:13:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:30.603 20:13:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:30.603 20:13:35 -- scripts/common.sh@335 -- # IFS=.-: 00:12:30.603 20:13:35 -- scripts/common.sh@335 -- # read -ra ver1 00:12:30.603 20:13:35 -- scripts/common.sh@336 -- # IFS=.-: 00:12:30.603 20:13:35 -- scripts/common.sh@336 -- # read -ra ver2 00:12:30.603 20:13:35 -- scripts/common.sh@337 -- # local 'op=<' 00:12:30.603 20:13:35 -- scripts/common.sh@339 -- # ver1_l=2 00:12:30.603 20:13:35 -- scripts/common.sh@340 -- # ver2_l=1 00:12:30.603 20:13:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:30.603 20:13:35 -- scripts/common.sh@343 -- # case "$op" in 00:12:30.603 20:13:35 -- scripts/common.sh@344 -- # : 1 00:12:30.603 20:13:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:30.603 20:13:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:30.603 20:13:35 -- scripts/common.sh@364 -- # decimal 1 00:12:30.603 20:13:35 -- scripts/common.sh@352 -- # local d=1 00:12:30.603 20:13:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:30.603 20:13:35 -- scripts/common.sh@354 -- # echo 1 00:12:30.603 20:13:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:30.603 20:13:35 -- scripts/common.sh@365 -- # decimal 2 00:12:30.603 20:13:35 -- scripts/common.sh@352 -- # local d=2 00:12:30.603 20:13:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:30.603 20:13:35 -- scripts/common.sh@354 -- # echo 2 00:12:30.603 20:13:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:30.603 20:13:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:30.603 20:13:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:30.603 20:13:35 -- scripts/common.sh@367 -- # return 0 00:12:30.603 20:13:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:30.603 20:13:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:30.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.603 --rc genhtml_branch_coverage=1 00:12:30.603 --rc genhtml_function_coverage=1 00:12:30.603 --rc genhtml_legend=1 00:12:30.603 --rc geninfo_all_blocks=1 00:12:30.603 --rc geninfo_unexecuted_blocks=1 00:12:30.603 00:12:30.603 ' 00:12:30.603 20:13:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:30.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.603 --rc genhtml_branch_coverage=1 00:12:30.603 --rc genhtml_function_coverage=1 00:12:30.603 --rc genhtml_legend=1 00:12:30.603 --rc geninfo_all_blocks=1 00:12:30.603 --rc geninfo_unexecuted_blocks=1 00:12:30.603 00:12:30.603 ' 00:12:30.603 20:13:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:30.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.603 --rc genhtml_branch_coverage=1 00:12:30.603 --rc genhtml_function_coverage=1 00:12:30.603 --rc genhtml_legend=1 00:12:30.603 --rc geninfo_all_blocks=1 00:12:30.603 --rc geninfo_unexecuted_blocks=1 00:12:30.603 00:12:30.603 ' 00:12:30.603 20:13:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:30.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.603 --rc genhtml_branch_coverage=1 00:12:30.603 --rc genhtml_function_coverage=1 00:12:30.603 --rc genhtml_legend=1 00:12:30.603 --rc geninfo_all_blocks=1 00:12:30.603 --rc geninfo_unexecuted_blocks=1 00:12:30.603 00:12:30.603 ' 00:12:30.603 20:13:35 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:30.603 20:13:35 -- nvmf/common.sh@7 -- # uname -s 00:12:30.603 20:13:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:30.603 20:13:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:30.603 20:13:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:30.603 20:13:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:30.603 20:13:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:30.603 20:13:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:30.603 20:13:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:30.603 20:13:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:30.603 20:13:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:30.603 20:13:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:30.603 20:13:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.603 20:13:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.603 20:13:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:30.603 20:13:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:30.603 20:13:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:30.603 20:13:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:30.603 20:13:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:30.603 20:13:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:30.603 20:13:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:30.603 20:13:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.603 20:13:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.603 20:13:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.603 20:13:35 -- paths/export.sh@5 -- # export PATH 00:12:30.603 20:13:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.603 20:13:35 -- nvmf/common.sh@46 -- # : 0 00:12:30.603 20:13:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:30.603 20:13:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:30.603 20:13:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:30.603 20:13:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:30.603 20:13:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:30.603 20:13:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:30.603 20:13:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:30.603 20:13:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:30.603 20:13:35 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:30.603 20:13:35 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:30.603 20:13:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:30.603 20:13:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:30.603 20:13:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:30.603 20:13:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:30.603 20:13:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:30.603 20:13:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:30.603 20:13:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:30.603 20:13:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.603 20:13:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:30.603 20:13:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:30.603 20:13:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:30.603 20:13:35 -- common/autotest_common.sh@10 -- # set +x 00:12:32.509 20:13:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:32.509 20:13:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:32.509 20:13:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:32.509 20:13:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:32.509 20:13:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:32.509 20:13:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:32.509 20:13:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:32.509 20:13:37 -- nvmf/common.sh@294 -- # net_devs=() 00:12:32.509 20:13:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:32.509 20:13:37 -- nvmf/common.sh@295 -- # e810=() 00:12:32.510 20:13:37 -- nvmf/common.sh@295 -- # local -ga e810 00:12:32.510 20:13:37 -- nvmf/common.sh@296 -- # x722=() 00:12:32.510 20:13:37 -- nvmf/common.sh@296 -- # local -ga x722 00:12:32.510 20:13:37 -- nvmf/common.sh@297 -- # mlx=() 00:12:32.510 20:13:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:32.510 20:13:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:32.510 20:13:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:32.510 20:13:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:32.510 20:13:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:32.510 20:13:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.510 20:13:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:32.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:32.510 20:13:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.510 20:13:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:32.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:32.510 20:13:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:32.510 20:13:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.510 20:13:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.510 20:13:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.510 20:13:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.510 20:13:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:32.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:32.510 20:13:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.510 20:13:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.510 20:13:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.510 20:13:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.510 20:13:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.510 20:13:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:32.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:32.510 20:13:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.510 20:13:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:32.510 20:13:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:32.510 20:13:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:32.510 20:13:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:32.510 20:13:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:32.510 20:13:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:32.510 20:13:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:32.510 20:13:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:32.510 20:13:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:32.510 20:13:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:32.510 20:13:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:32.510 20:13:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:32.510 20:13:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:32.510 20:13:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:32.510 20:13:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:32.510 20:13:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:32.510 20:13:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:32.510 20:13:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:32.510 20:13:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:32.510 20:13:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:32.510 20:13:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:32.510 20:13:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:32.510 20:13:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:32.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:32.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.342 ms 00:12:32.510 00:12:32.510 --- 10.0.0.2 ping statistics --- 00:12:32.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.510 rtt min/avg/max/mdev = 0.342/0.342/0.342/0.000 ms 00:12:32.510 20:13:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:32.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:32.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:12:32.510 00:12:32.510 --- 10.0.0.1 ping statistics --- 00:12:32.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.510 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:12:32.510 20:13:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:32.510 20:13:37 -- nvmf/common.sh@410 -- # return 0 00:12:32.510 20:13:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:32.510 20:13:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:32.510 20:13:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:32.510 20:13:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:32.510 20:13:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:32.510 20:13:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:32.510 20:13:37 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:32.510 20:13:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:32.510 20:13:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:32.510 20:13:37 -- common/autotest_common.sh@10 -- # set +x 00:12:32.510 20:13:37 -- nvmf/common.sh@469 -- # nvmfpid=3115020 00:12:32.510 20:13:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:32.510 20:13:37 -- nvmf/common.sh@470 -- # waitforlisten 3115020 00:12:32.510 20:13:37 -- common/autotest_common.sh@829 -- # '[' -z 3115020 ']' 00:12:32.510 20:13:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:32.510 20:13:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:32.510 20:13:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:32.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:32.510 20:13:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:32.510 20:13:37 -- common/autotest_common.sh@10 -- # set +x 00:12:32.770 [2024-11-20 20:13:37.573316] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:32.770 [2024-11-20 20:13:37.573409] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:32.770 EAL: No free 2048 kB hugepages reported on node 1 00:12:32.770 [2024-11-20 20:13:37.638774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:32.770 [2024-11-20 20:13:37.747645] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:32.770 [2024-11-20 20:13:37.747803] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:32.770 [2024-11-20 20:13:37.747828] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:32.770 [2024-11-20 20:13:37.747858] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:32.770 [2024-11-20 20:13:37.747962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:32.770 [2024-11-20 20:13:37.748024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:32.770 [2024-11-20 20:13:37.748031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:33.704 20:13:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:33.704 20:13:38 -- common/autotest_common.sh@862 -- # return 0 00:12:33.704 20:13:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:33.704 20:13:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:33.704 20:13:38 -- common/autotest_common.sh@10 -- # set +x 00:12:33.704 20:13:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:33.704 20:13:38 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:33.704 20:13:38 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:33.963 [2024-11-20 20:13:38.895106] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:33.963 20:13:38 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:34.221 20:13:39 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:34.479 [2024-11-20 20:13:39.410199] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:34.479 20:13:39 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:34.736 20:13:39 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:34.994 Malloc0 00:12:34.994 20:13:39 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:35.252 Delay0 00:12:35.252 20:13:40 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.510 20:13:40 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:35.769 NULL1 00:12:35.769 20:13:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:36.027 20:13:40 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3115460 00:12:36.027 20:13:40 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:36.027 20:13:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:36.027 20:13:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.027 EAL: No free 2048 kB hugepages reported on node 1 00:12:36.284 20:13:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.541 20:13:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:36.541 20:13:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:36.798 true 00:12:36.798 20:13:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:36.798 20:13:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.056 20:13:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.313 20:13:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:37.313 20:13:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:37.571 true 00:12:37.571 20:13:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:37.571 20:13:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.508 Read completed with error (sct=0, sc=11) 00:12:38.508 20:13:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.508 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.765 20:13:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:38.765 20:13:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:39.023 true 00:12:39.023 20:13:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:39.023 20:13:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.281 20:13:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.538 20:13:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:39.538 20:13:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:39.795 true 00:12:39.795 20:13:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:39.795 20:13:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.727 20:13:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.984 20:13:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:40.984 20:13:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:41.241 true 00:12:41.241 20:13:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:41.241 20:13:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.499 20:13:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.757 20:13:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:41.757 20:13:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:42.014 true 00:12:42.014 20:13:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:42.014 20:13:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.271 20:13:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.528 20:13:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:42.528 20:13:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:42.785 true 00:12:42.785 20:13:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:42.785 20:13:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.716 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.716 20:13:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.716 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.973 20:13:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:43.973 20:13:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:44.230 true 00:12:44.230 20:13:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:44.230 20:13:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.487 20:13:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.745 20:13:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:44.746 20:13:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:45.004 true 00:12:45.004 20:13:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:45.004 20:13:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.936 20:13:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.193 20:13:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:46.193 20:13:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:46.451 true 00:12:46.451 20:13:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:46.451 20:13:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.709 20:13:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.967 20:13:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:46.967 20:13:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:46.967 true 00:12:47.225 20:13:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:47.225 20:13:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.483 20:13:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.483 20:13:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:47.483 20:13:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:47.741 true 00:12:47.741 20:13:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:47.741 20:13:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.750 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.750 20:13:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.008 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.008 20:13:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:49.008 20:13:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:49.266 true 00:12:49.266 20:13:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:49.266 20:13:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.523 20:13:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.781 20:13:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:49.781 20:13:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:50.039 true 00:12:50.039 20:13:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:50.039 20:13:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.973 20:13:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.973 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.973 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.230 20:13:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:51.230 20:13:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:51.486 true 00:12:51.486 20:13:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:51.486 20:13:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.743 20:13:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.001 20:13:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:52.001 20:13:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:52.259 true 00:12:52.259 20:13:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:52.259 20:13:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.192 20:13:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.449 20:13:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:53.449 20:13:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:53.449 true 00:12:53.707 20:13:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:53.707 20:13:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.965 20:13:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.223 20:13:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:54.223 20:13:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:54.223 true 00:12:54.223 20:13:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:54.223 20:13:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.787 20:13:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.787 20:13:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:54.787 20:13:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:55.045 true 00:12:55.045 20:14:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:55.045 20:14:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.417 20:14:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.417 20:14:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:56.417 20:14:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:56.674 true 00:12:56.674 20:14:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:56.674 20:14:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.932 20:14:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.189 20:14:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:57.189 20:14:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:57.448 true 00:12:57.448 20:14:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:57.448 20:14:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.381 20:14:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.381 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:58.381 20:14:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:58.381 20:14:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:58.640 true 00:12:58.640 20:14:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:58.640 20:14:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.897 20:14:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.155 20:14:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:59.155 20:14:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:59.412 true 00:12:59.412 20:14:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:12:59.412 20:14:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.345 20:14:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.602 20:14:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:00.602 20:14:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:00.858 true 00:13:00.858 20:14:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:00.858 20:14:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.115 20:14:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.115 20:14:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:01.115 20:14:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:01.373 true 00:13:01.373 20:14:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:01.373 20:14:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.305 20:14:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.562 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.562 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.562 20:14:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:02.562 20:14:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:02.819 true 00:13:02.819 20:14:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:02.819 20:14:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.077 20:14:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.334 20:14:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:03.334 20:14:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:03.591 true 00:13:03.591 20:14:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:03.591 20:14:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.523 20:14:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.780 20:14:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:04.781 20:14:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:05.039 true 00:13:05.039 20:14:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:05.039 20:14:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.297 20:14:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.554 20:14:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:05.554 20:14:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:05.812 true 00:13:05.812 20:14:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:05.812 20:14:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.070 20:14:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.327 20:14:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:13:06.327 20:14:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:06.585 true 00:13:06.585 Initializing NVMe Controllers 00:13:06.585 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:06.585 Controller IO queue size 128, less than required. 00:13:06.585 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:06.585 Controller IO queue size 128, less than required. 00:13:06.585 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:06.585 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:06.585 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:06.585 Initialization complete. Launching workers. 00:13:06.585 ======================================================== 00:13:06.585 Latency(us) 00:13:06.585 Device Information : IOPS MiB/s Average min max 00:13:06.585 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 458.17 0.22 123468.76 2141.92 1083044.88 00:13:06.585 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10161.65 4.96 12560.71 1744.68 475708.59 00:13:06.585 ======================================================== 00:13:06.585 Total : 10619.82 5.19 17345.63 1744.68 1083044.88 00:13:06.585 00:13:06.585 20:14:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3115460 00:13:06.585 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3115460) - No such process 00:13:06.585 20:14:11 -- target/ns_hotplug_stress.sh@53 -- # wait 3115460 00:13:06.585 20:14:11 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.842 20:14:11 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.099 20:14:11 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:07.099 20:14:11 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:07.099 20:14:11 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:07.099 20:14:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.099 20:14:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:07.357 null0 00:13:07.357 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.357 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.357 20:14:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:07.614 null1 00:13:07.614 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.614 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.614 20:14:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:07.872 null2 00:13:07.872 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.872 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.872 20:14:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:08.130 null3 00:13:08.130 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:08.130 20:14:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.130 20:14:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:08.387 null4 00:13:08.387 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:08.387 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.387 20:14:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:08.644 null5 00:13:08.644 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:08.644 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.645 20:14:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:08.902 null6 00:13:08.902 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:08.902 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.903 20:14:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:09.161 null7 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.161 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@66 -- # wait 3119640 3119641 3119643 3119645 3119647 3119649 3119651 3119653 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.162 20:14:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.421 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.679 20:14:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.937 20:14:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.196 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.455 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.713 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.714 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.714 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.714 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.714 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.714 20:14:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.714 20:14:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.972 20:14:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.230 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.489 20:14:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.747 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.747 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.748 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.748 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.748 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.748 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.006 20:14:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.264 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.522 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.522 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.522 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.523 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.781 20:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.039 20:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:13.298 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.556 20:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:13.815 20:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:14.073 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.074 20:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:14.330 20:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:14.588 20:14:19 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:14.588 20:14:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:14.588 20:14:19 -- nvmf/common.sh@116 -- # sync 00:13:14.588 20:14:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:14.588 20:14:19 -- nvmf/common.sh@119 -- # set +e 00:13:14.588 20:14:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:14.588 20:14:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:14.588 rmmod nvme_tcp 00:13:14.846 rmmod nvme_fabrics 00:13:14.846 rmmod nvme_keyring 00:13:14.846 20:14:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:14.846 20:14:19 -- nvmf/common.sh@123 -- # set -e 00:13:14.846 20:14:19 -- nvmf/common.sh@124 -- # return 0 00:13:14.846 20:14:19 -- nvmf/common.sh@477 -- # '[' -n 3115020 ']' 00:13:14.846 20:14:19 -- nvmf/common.sh@478 -- # killprocess 3115020 00:13:14.846 20:14:19 -- common/autotest_common.sh@936 -- # '[' -z 3115020 ']' 00:13:14.846 20:14:19 -- common/autotest_common.sh@940 -- # kill -0 3115020 00:13:14.846 20:14:19 -- common/autotest_common.sh@941 -- # uname 00:13:14.846 20:14:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:14.846 20:14:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3115020 00:13:14.846 20:14:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:14.846 20:14:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:14.846 20:14:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3115020' 00:13:14.846 killing process with pid 3115020 00:13:14.846 20:14:19 -- common/autotest_common.sh@955 -- # kill 3115020 00:13:14.846 20:14:19 -- common/autotest_common.sh@960 -- # wait 3115020 00:13:15.105 20:14:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:15.105 20:14:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:15.105 20:14:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:15.105 20:14:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:15.105 20:14:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:15.105 20:14:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.105 20:14:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.105 20:14:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.009 20:14:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:17.009 00:13:17.009 real 0m46.937s 00:13:17.009 user 3m35.255s 00:13:17.009 sys 0m15.094s 00:13:17.009 20:14:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:17.009 20:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:17.009 ************************************ 00:13:17.009 END TEST nvmf_ns_hotplug_stress 00:13:17.009 ************************************ 00:13:17.269 20:14:22 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:17.269 20:14:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:17.269 20:14:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:17.269 20:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:17.269 ************************************ 00:13:17.269 START TEST nvmf_connect_stress 00:13:17.269 ************************************ 00:13:17.270 20:14:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:17.270 * Looking for test storage... 00:13:17.270 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:17.270 20:14:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:17.270 20:14:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:17.270 20:14:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:17.270 20:14:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:17.270 20:14:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:17.270 20:14:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:17.270 20:14:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:17.270 20:14:22 -- scripts/common.sh@335 -- # IFS=.-: 00:13:17.270 20:14:22 -- scripts/common.sh@335 -- # read -ra ver1 00:13:17.270 20:14:22 -- scripts/common.sh@336 -- # IFS=.-: 00:13:17.270 20:14:22 -- scripts/common.sh@336 -- # read -ra ver2 00:13:17.270 20:14:22 -- scripts/common.sh@337 -- # local 'op=<' 00:13:17.270 20:14:22 -- scripts/common.sh@339 -- # ver1_l=2 00:13:17.270 20:14:22 -- scripts/common.sh@340 -- # ver2_l=1 00:13:17.270 20:14:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:17.270 20:14:22 -- scripts/common.sh@343 -- # case "$op" in 00:13:17.270 20:14:22 -- scripts/common.sh@344 -- # : 1 00:13:17.270 20:14:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:17.270 20:14:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:17.270 20:14:22 -- scripts/common.sh@364 -- # decimal 1 00:13:17.270 20:14:22 -- scripts/common.sh@352 -- # local d=1 00:13:17.270 20:14:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:17.270 20:14:22 -- scripts/common.sh@354 -- # echo 1 00:13:17.270 20:14:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:17.270 20:14:22 -- scripts/common.sh@365 -- # decimal 2 00:13:17.270 20:14:22 -- scripts/common.sh@352 -- # local d=2 00:13:17.270 20:14:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:17.270 20:14:22 -- scripts/common.sh@354 -- # echo 2 00:13:17.270 20:14:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:17.270 20:14:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:17.270 20:14:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:17.270 20:14:22 -- scripts/common.sh@367 -- # return 0 00:13:17.270 20:14:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:17.270 20:14:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:17.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.270 --rc genhtml_branch_coverage=1 00:13:17.270 --rc genhtml_function_coverage=1 00:13:17.270 --rc genhtml_legend=1 00:13:17.270 --rc geninfo_all_blocks=1 00:13:17.270 --rc geninfo_unexecuted_blocks=1 00:13:17.270 00:13:17.270 ' 00:13:17.270 20:14:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:17.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.270 --rc genhtml_branch_coverage=1 00:13:17.270 --rc genhtml_function_coverage=1 00:13:17.270 --rc genhtml_legend=1 00:13:17.270 --rc geninfo_all_blocks=1 00:13:17.270 --rc geninfo_unexecuted_blocks=1 00:13:17.270 00:13:17.270 ' 00:13:17.270 20:14:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:17.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.270 --rc genhtml_branch_coverage=1 00:13:17.270 --rc genhtml_function_coverage=1 00:13:17.270 --rc genhtml_legend=1 00:13:17.270 --rc geninfo_all_blocks=1 00:13:17.270 --rc geninfo_unexecuted_blocks=1 00:13:17.270 00:13:17.270 ' 00:13:17.270 20:14:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:17.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.270 --rc genhtml_branch_coverage=1 00:13:17.270 --rc genhtml_function_coverage=1 00:13:17.270 --rc genhtml_legend=1 00:13:17.270 --rc geninfo_all_blocks=1 00:13:17.270 --rc geninfo_unexecuted_blocks=1 00:13:17.270 00:13:17.270 ' 00:13:17.270 20:14:22 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:17.270 20:14:22 -- nvmf/common.sh@7 -- # uname -s 00:13:17.270 20:14:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:17.270 20:14:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:17.270 20:14:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:17.270 20:14:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:17.270 20:14:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:17.270 20:14:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:17.270 20:14:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:17.270 20:14:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:17.270 20:14:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:17.270 20:14:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:17.270 20:14:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:17.270 20:14:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:17.270 20:14:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:17.270 20:14:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:17.270 20:14:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:17.270 20:14:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:17.270 20:14:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:17.270 20:14:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:17.270 20:14:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:17.270 20:14:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.270 20:14:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.270 20:14:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.270 20:14:22 -- paths/export.sh@5 -- # export PATH 00:13:17.271 20:14:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.271 20:14:22 -- nvmf/common.sh@46 -- # : 0 00:13:17.271 20:14:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:17.271 20:14:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:17.271 20:14:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:17.271 20:14:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:17.271 20:14:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:17.271 20:14:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:17.271 20:14:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:17.271 20:14:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:17.271 20:14:22 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:17.271 20:14:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:17.271 20:14:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:17.271 20:14:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:17.271 20:14:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:17.271 20:14:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:17.271 20:14:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.271 20:14:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.271 20:14:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.271 20:14:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:17.271 20:14:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:17.271 20:14:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:17.271 20:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:19.252 20:14:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:19.252 20:14:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:19.252 20:14:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:19.252 20:14:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:19.252 20:14:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:19.252 20:14:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:19.252 20:14:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:19.252 20:14:24 -- nvmf/common.sh@294 -- # net_devs=() 00:13:19.252 20:14:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:19.252 20:14:24 -- nvmf/common.sh@295 -- # e810=() 00:13:19.252 20:14:24 -- nvmf/common.sh@295 -- # local -ga e810 00:13:19.252 20:14:24 -- nvmf/common.sh@296 -- # x722=() 00:13:19.252 20:14:24 -- nvmf/common.sh@296 -- # local -ga x722 00:13:19.252 20:14:24 -- nvmf/common.sh@297 -- # mlx=() 00:13:19.252 20:14:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:19.252 20:14:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:19.252 20:14:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:19.253 20:14:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:19.253 20:14:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:19.253 20:14:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:19.253 20:14:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:19.253 20:14:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:19.253 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:19.253 20:14:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:19.253 20:14:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:19.253 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:19.253 20:14:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:19.253 20:14:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:19.253 20:14:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:19.253 20:14:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:19.253 20:14:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:19.253 20:14:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:19.253 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:19.253 20:14:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:19.253 20:14:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:19.253 20:14:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:19.253 20:14:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:19.253 20:14:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:19.253 20:14:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:19.253 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:19.253 20:14:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:19.253 20:14:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:19.253 20:14:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:19.253 20:14:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:19.253 20:14:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:19.253 20:14:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:19.253 20:14:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:19.253 20:14:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:19.253 20:14:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:19.253 20:14:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:19.253 20:14:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:19.253 20:14:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:19.253 20:14:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:19.253 20:14:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:19.253 20:14:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:19.253 20:14:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:19.253 20:14:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:19.253 20:14:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:19.253 20:14:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:19.253 20:14:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:19.253 20:14:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:19.253 20:14:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:19.253 20:14:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:19.253 20:14:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:19.253 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:19.253 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.363 ms 00:13:19.253 00:13:19.253 --- 10.0.0.2 ping statistics --- 00:13:19.253 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:19.253 rtt min/avg/max/mdev = 0.363/0.363/0.363/0.000 ms 00:13:19.253 20:14:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:19.253 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:19.253 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:13:19.253 00:13:19.253 --- 10.0.0.1 ping statistics --- 00:13:19.253 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:19.253 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:13:19.253 20:14:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:19.253 20:14:24 -- nvmf/common.sh@410 -- # return 0 00:13:19.253 20:14:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:19.253 20:14:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:19.253 20:14:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:19.253 20:14:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:19.253 20:14:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:19.253 20:14:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:19.513 20:14:24 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:19.513 20:14:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:19.513 20:14:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:19.513 20:14:24 -- common/autotest_common.sh@10 -- # set +x 00:13:19.513 20:14:24 -- nvmf/common.sh@469 -- # nvmfpid=3122440 00:13:19.513 20:14:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:19.513 20:14:24 -- nvmf/common.sh@470 -- # waitforlisten 3122440 00:13:19.513 20:14:24 -- common/autotest_common.sh@829 -- # '[' -z 3122440 ']' 00:13:19.513 20:14:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:19.513 20:14:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:19.513 20:14:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:19.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:19.513 20:14:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:19.513 20:14:24 -- common/autotest_common.sh@10 -- # set +x 00:13:19.513 [2024-11-20 20:14:24.347646] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:19.513 [2024-11-20 20:14:24.347728] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:19.513 EAL: No free 2048 kB hugepages reported on node 1 00:13:19.513 [2024-11-20 20:14:24.411129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:19.513 [2024-11-20 20:14:24.517552] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:19.513 [2024-11-20 20:14:24.517706] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:19.513 [2024-11-20 20:14:24.517731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:19.513 [2024-11-20 20:14:24.517750] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:19.513 [2024-11-20 20:14:24.517809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:19.513 [2024-11-20 20:14:24.517872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:19.513 [2024-11-20 20:14:24.517880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:20.449 20:14:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:20.449 20:14:25 -- common/autotest_common.sh@862 -- # return 0 00:13:20.449 20:14:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:20.449 20:14:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:20.449 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:20.449 20:14:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:20.449 20:14:25 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:20.449 20:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.449 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:20.449 [2024-11-20 20:14:25.330462] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:20.449 20:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.449 20:14:25 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:20.449 20:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.449 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:20.449 20:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.449 20:14:25 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.449 20:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.449 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:20.449 [2024-11-20 20:14:25.360247] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.449 20:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.449 20:14:25 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:20.449 20:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.449 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:20.449 NULL1 00:13:20.449 20:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.449 20:14:25 -- target/connect_stress.sh@21 -- # PERF_PID=3122598 00:13:20.449 20:14:25 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:20.449 20:14:25 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:20.449 20:14:25 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:20.449 20:14:25 -- target/connect_stress.sh@28 -- # cat 00:13:20.449 20:14:25 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:20.449 20:14:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.449 20:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.449 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:21.015 20:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.015 20:14:25 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:21.015 20:14:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.015 20:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.015 20:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:21.273 20:14:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.273 20:14:26 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:21.273 20:14:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.273 20:14:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.273 20:14:26 -- common/autotest_common.sh@10 -- # set +x 00:13:21.531 20:14:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.531 20:14:26 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:21.531 20:14:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.531 20:14:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.531 20:14:26 -- common/autotest_common.sh@10 -- # set +x 00:13:21.789 20:14:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.789 20:14:26 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:21.789 20:14:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.789 20:14:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.789 20:14:26 -- common/autotest_common.sh@10 -- # set +x 00:13:22.047 20:14:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.047 20:14:27 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:22.047 20:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.047 20:14:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.047 20:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:22.613 20:14:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.613 20:14:27 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:22.613 20:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.613 20:14:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.613 20:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:22.871 20:14:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.871 20:14:27 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:22.871 20:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.871 20:14:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.871 20:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:23.129 20:14:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.129 20:14:27 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:23.129 20:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.129 20:14:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.129 20:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:23.387 20:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.387 20:14:28 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:23.387 20:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.387 20:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.387 20:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:23.645 20:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.645 20:14:28 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:23.645 20:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.645 20:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.645 20:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:24.211 20:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.211 20:14:28 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:24.211 20:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.211 20:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.211 20:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:24.469 20:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.469 20:14:29 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:24.469 20:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.469 20:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.469 20:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:24.726 20:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.726 20:14:29 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:24.726 20:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.726 20:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.726 20:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:24.984 20:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.984 20:14:29 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:24.984 20:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.984 20:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.984 20:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:25.242 20:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.242 20:14:30 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:25.242 20:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.242 20:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.242 20:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:25.807 20:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.807 20:14:30 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:25.807 20:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.807 20:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.807 20:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:26.064 20:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.064 20:14:30 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:26.064 20:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.064 20:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.064 20:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:26.322 20:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.322 20:14:31 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:26.322 20:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.322 20:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.322 20:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:26.580 20:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.580 20:14:31 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:26.580 20:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.580 20:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.580 20:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:26.838 20:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.838 20:14:31 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:26.838 20:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.838 20:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.838 20:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:27.403 20:14:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.403 20:14:32 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:27.403 20:14:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.403 20:14:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.403 20:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:27.660 20:14:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.660 20:14:32 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:27.660 20:14:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.660 20:14:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.660 20:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:27.917 20:14:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.917 20:14:32 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:27.917 20:14:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.917 20:14:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.917 20:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:28.176 20:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.176 20:14:33 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:28.176 20:14:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.176 20:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.176 20:14:33 -- common/autotest_common.sh@10 -- # set +x 00:13:28.434 20:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.434 20:14:33 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:28.434 20:14:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.434 20:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.434 20:14:33 -- common/autotest_common.sh@10 -- # set +x 00:13:28.999 20:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.999 20:14:33 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:28.999 20:14:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.999 20:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.999 20:14:33 -- common/autotest_common.sh@10 -- # set +x 00:13:29.257 20:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.257 20:14:34 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:29.257 20:14:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.257 20:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.257 20:14:34 -- common/autotest_common.sh@10 -- # set +x 00:13:29.515 20:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.515 20:14:34 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:29.515 20:14:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.515 20:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.515 20:14:34 -- common/autotest_common.sh@10 -- # set +x 00:13:29.774 20:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.774 20:14:34 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:29.774 20:14:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.774 20:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.774 20:14:34 -- common/autotest_common.sh@10 -- # set +x 00:13:30.032 20:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.032 20:14:35 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:30.032 20:14:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.032 20:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.032 20:14:35 -- common/autotest_common.sh@10 -- # set +x 00:13:30.598 20:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.598 20:14:35 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:30.598 20:14:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.598 20:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.598 20:14:35 -- common/autotest_common.sh@10 -- # set +x 00:13:30.598 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:30.856 20:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.856 20:14:35 -- target/connect_stress.sh@34 -- # kill -0 3122598 00:13:30.856 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3122598) - No such process 00:13:30.856 20:14:35 -- target/connect_stress.sh@38 -- # wait 3122598 00:13:30.856 20:14:35 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:30.856 20:14:35 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:30.856 20:14:35 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:30.856 20:14:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:30.856 20:14:35 -- nvmf/common.sh@116 -- # sync 00:13:30.856 20:14:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:30.856 20:14:35 -- nvmf/common.sh@119 -- # set +e 00:13:30.856 20:14:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:30.856 20:14:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:30.856 rmmod nvme_tcp 00:13:30.856 rmmod nvme_fabrics 00:13:30.856 rmmod nvme_keyring 00:13:30.856 20:14:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:30.856 20:14:35 -- nvmf/common.sh@123 -- # set -e 00:13:30.856 20:14:35 -- nvmf/common.sh@124 -- # return 0 00:13:30.856 20:14:35 -- nvmf/common.sh@477 -- # '[' -n 3122440 ']' 00:13:30.856 20:14:35 -- nvmf/common.sh@478 -- # killprocess 3122440 00:13:30.856 20:14:35 -- common/autotest_common.sh@936 -- # '[' -z 3122440 ']' 00:13:30.856 20:14:35 -- common/autotest_common.sh@940 -- # kill -0 3122440 00:13:30.856 20:14:35 -- common/autotest_common.sh@941 -- # uname 00:13:30.856 20:14:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:30.856 20:14:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3122440 00:13:30.856 20:14:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:30.856 20:14:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:30.856 20:14:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3122440' 00:13:30.856 killing process with pid 3122440 00:13:30.856 20:14:35 -- common/autotest_common.sh@955 -- # kill 3122440 00:13:30.856 20:14:35 -- common/autotest_common.sh@960 -- # wait 3122440 00:13:31.116 20:14:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:31.116 20:14:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:31.116 20:14:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:31.116 20:14:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:31.116 20:14:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:31.116 20:14:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:31.116 20:14:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:31.116 20:14:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:33.653 20:14:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:33.653 00:13:33.653 real 0m16.036s 00:13:33.653 user 0m40.623s 00:13:33.653 sys 0m5.858s 00:13:33.653 20:14:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:33.653 20:14:38 -- common/autotest_common.sh@10 -- # set +x 00:13:33.653 ************************************ 00:13:33.653 END TEST nvmf_connect_stress 00:13:33.653 ************************************ 00:13:33.653 20:14:38 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:33.653 20:14:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:33.653 20:14:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:33.653 20:14:38 -- common/autotest_common.sh@10 -- # set +x 00:13:33.653 ************************************ 00:13:33.653 START TEST nvmf_fused_ordering 00:13:33.653 ************************************ 00:13:33.653 20:14:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:33.653 * Looking for test storage... 00:13:33.653 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:33.653 20:14:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:33.653 20:14:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:33.653 20:14:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:33.653 20:14:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:33.653 20:14:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:33.653 20:14:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:33.653 20:14:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:33.653 20:14:38 -- scripts/common.sh@335 -- # IFS=.-: 00:13:33.653 20:14:38 -- scripts/common.sh@335 -- # read -ra ver1 00:13:33.653 20:14:38 -- scripts/common.sh@336 -- # IFS=.-: 00:13:33.653 20:14:38 -- scripts/common.sh@336 -- # read -ra ver2 00:13:33.653 20:14:38 -- scripts/common.sh@337 -- # local 'op=<' 00:13:33.653 20:14:38 -- scripts/common.sh@339 -- # ver1_l=2 00:13:33.653 20:14:38 -- scripts/common.sh@340 -- # ver2_l=1 00:13:33.653 20:14:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:33.653 20:14:38 -- scripts/common.sh@343 -- # case "$op" in 00:13:33.653 20:14:38 -- scripts/common.sh@344 -- # : 1 00:13:33.653 20:14:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:33.653 20:14:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:33.653 20:14:38 -- scripts/common.sh@364 -- # decimal 1 00:13:33.653 20:14:38 -- scripts/common.sh@352 -- # local d=1 00:13:33.653 20:14:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:33.653 20:14:38 -- scripts/common.sh@354 -- # echo 1 00:13:33.653 20:14:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:33.653 20:14:38 -- scripts/common.sh@365 -- # decimal 2 00:13:33.653 20:14:38 -- scripts/common.sh@352 -- # local d=2 00:13:33.653 20:14:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:33.653 20:14:38 -- scripts/common.sh@354 -- # echo 2 00:13:33.653 20:14:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:33.653 20:14:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:33.653 20:14:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:33.653 20:14:38 -- scripts/common.sh@367 -- # return 0 00:13:33.653 20:14:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:33.653 20:14:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:33.653 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.653 --rc genhtml_branch_coverage=1 00:13:33.653 --rc genhtml_function_coverage=1 00:13:33.653 --rc genhtml_legend=1 00:13:33.653 --rc geninfo_all_blocks=1 00:13:33.653 --rc geninfo_unexecuted_blocks=1 00:13:33.653 00:13:33.653 ' 00:13:33.653 20:14:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:33.653 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.653 --rc genhtml_branch_coverage=1 00:13:33.653 --rc genhtml_function_coverage=1 00:13:33.653 --rc genhtml_legend=1 00:13:33.653 --rc geninfo_all_blocks=1 00:13:33.653 --rc geninfo_unexecuted_blocks=1 00:13:33.653 00:13:33.653 ' 00:13:33.654 20:14:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:33.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.654 --rc genhtml_branch_coverage=1 00:13:33.654 --rc genhtml_function_coverage=1 00:13:33.654 --rc genhtml_legend=1 00:13:33.654 --rc geninfo_all_blocks=1 00:13:33.654 --rc geninfo_unexecuted_blocks=1 00:13:33.654 00:13:33.654 ' 00:13:33.654 20:14:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:33.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.654 --rc genhtml_branch_coverage=1 00:13:33.654 --rc genhtml_function_coverage=1 00:13:33.654 --rc genhtml_legend=1 00:13:33.654 --rc geninfo_all_blocks=1 00:13:33.654 --rc geninfo_unexecuted_blocks=1 00:13:33.654 00:13:33.654 ' 00:13:33.654 20:14:38 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:33.654 20:14:38 -- nvmf/common.sh@7 -- # uname -s 00:13:33.654 20:14:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:33.654 20:14:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:33.654 20:14:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:33.654 20:14:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:33.654 20:14:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:33.654 20:14:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:33.654 20:14:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:33.654 20:14:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:33.654 20:14:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:33.654 20:14:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:33.654 20:14:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:33.654 20:14:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:33.654 20:14:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:33.654 20:14:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:33.654 20:14:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:33.654 20:14:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:33.654 20:14:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:33.654 20:14:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:33.654 20:14:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:33.654 20:14:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.654 20:14:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.654 20:14:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.654 20:14:38 -- paths/export.sh@5 -- # export PATH 00:13:33.654 20:14:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.654 20:14:38 -- nvmf/common.sh@46 -- # : 0 00:13:33.654 20:14:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:33.654 20:14:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:33.654 20:14:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:33.654 20:14:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:33.654 20:14:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:33.654 20:14:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:33.654 20:14:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:33.654 20:14:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:33.654 20:14:38 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:33.654 20:14:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:33.654 20:14:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:33.654 20:14:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:33.654 20:14:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:33.654 20:14:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:33.654 20:14:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:33.654 20:14:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:33.654 20:14:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:33.654 20:14:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:33.654 20:14:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:33.654 20:14:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:33.654 20:14:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.555 20:14:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:35.555 20:14:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:35.555 20:14:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:35.555 20:14:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:35.555 20:14:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:35.555 20:14:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:35.555 20:14:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:35.555 20:14:40 -- nvmf/common.sh@294 -- # net_devs=() 00:13:35.555 20:14:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:35.555 20:14:40 -- nvmf/common.sh@295 -- # e810=() 00:13:35.555 20:14:40 -- nvmf/common.sh@295 -- # local -ga e810 00:13:35.555 20:14:40 -- nvmf/common.sh@296 -- # x722=() 00:13:35.555 20:14:40 -- nvmf/common.sh@296 -- # local -ga x722 00:13:35.555 20:14:40 -- nvmf/common.sh@297 -- # mlx=() 00:13:35.555 20:14:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:35.555 20:14:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:35.555 20:14:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:35.555 20:14:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:35.555 20:14:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:35.555 20:14:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.555 20:14:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:35.555 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:35.555 20:14:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.555 20:14:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:35.555 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:35.555 20:14:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:35.555 20:14:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.555 20:14:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.555 20:14:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.555 20:14:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.555 20:14:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:35.555 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:35.555 20:14:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.555 20:14:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.555 20:14:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.555 20:14:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.555 20:14:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.555 20:14:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:35.555 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:35.555 20:14:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.555 20:14:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:35.555 20:14:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:35.555 20:14:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:35.555 20:14:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:35.555 20:14:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:35.555 20:14:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:35.555 20:14:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:35.555 20:14:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:35.555 20:14:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:35.555 20:14:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:35.555 20:14:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:35.555 20:14:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:35.555 20:14:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:35.555 20:14:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:35.555 20:14:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:35.555 20:14:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:35.555 20:14:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:35.555 20:14:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:35.555 20:14:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:35.555 20:14:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:35.555 20:14:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:35.555 20:14:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:35.555 20:14:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:35.555 20:14:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:35.555 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:35.555 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:13:35.555 00:13:35.555 --- 10.0.0.2 ping statistics --- 00:13:35.555 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.555 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:13:35.555 20:14:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:35.555 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:35.556 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:13:35.556 00:13:35.556 --- 10.0.0.1 ping statistics --- 00:13:35.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.556 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:13:35.556 20:14:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:35.556 20:14:40 -- nvmf/common.sh@410 -- # return 0 00:13:35.556 20:14:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:35.556 20:14:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:35.556 20:14:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:35.556 20:14:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:35.556 20:14:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:35.556 20:14:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:35.556 20:14:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:35.556 20:14:40 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:35.556 20:14:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:35.556 20:14:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:35.556 20:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:35.556 20:14:40 -- nvmf/common.sh@469 -- # nvmfpid=3125873 00:13:35.556 20:14:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:35.556 20:14:40 -- nvmf/common.sh@470 -- # waitforlisten 3125873 00:13:35.556 20:14:40 -- common/autotest_common.sh@829 -- # '[' -z 3125873 ']' 00:13:35.556 20:14:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:35.556 20:14:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:35.556 20:14:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:35.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:35.556 20:14:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:35.556 20:14:40 -- common/autotest_common.sh@10 -- # set +x 00:13:35.556 [2024-11-20 20:14:40.451672] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:35.556 [2024-11-20 20:14:40.451749] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:35.556 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.556 [2024-11-20 20:14:40.516423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:35.814 [2024-11-20 20:14:40.623615] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:35.814 [2024-11-20 20:14:40.623772] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:35.814 [2024-11-20 20:14:40.623798] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:35.814 [2024-11-20 20:14:40.623815] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:35.814 [2024-11-20 20:14:40.623869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:36.746 20:14:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:36.746 20:14:41 -- common/autotest_common.sh@862 -- # return 0 00:13:36.746 20:14:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:36.746 20:14:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 20:14:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:36.746 20:14:41 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:36.746 20:14:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 [2024-11-20 20:14:41.446536] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:36.746 20:14:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.746 20:14:41 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:36.746 20:14:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 20:14:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.746 20:14:41 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:36.746 20:14:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 [2024-11-20 20:14:41.462704] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:36.746 20:14:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.746 20:14:41 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:36.746 20:14:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 NULL1 00:13:36.746 20:14:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.746 20:14:41 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:36.746 20:14:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 20:14:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.746 20:14:41 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:36.746 20:14:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.746 20:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:36.746 20:14:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.746 20:14:41 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:36.746 [2024-11-20 20:14:41.507583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:36.746 [2024-11-20 20:14:41.507624] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3125977 ] 00:13:36.746 EAL: No free 2048 kB hugepages reported on node 1 00:13:37.004 Attached to nqn.2016-06.io.spdk:cnode1 00:13:37.004 Namespace ID: 1 size: 1GB 00:13:37.004 fused_ordering(0) 00:13:37.004 fused_ordering(1) 00:13:37.004 fused_ordering(2) 00:13:37.004 fused_ordering(3) 00:13:37.004 fused_ordering(4) 00:13:37.004 fused_ordering(5) 00:13:37.004 fused_ordering(6) 00:13:37.004 fused_ordering(7) 00:13:37.004 fused_ordering(8) 00:13:37.004 fused_ordering(9) 00:13:37.004 fused_ordering(10) 00:13:37.004 fused_ordering(11) 00:13:37.004 fused_ordering(12) 00:13:37.004 fused_ordering(13) 00:13:37.004 fused_ordering(14) 00:13:37.004 fused_ordering(15) 00:13:37.004 fused_ordering(16) 00:13:37.004 fused_ordering(17) 00:13:37.004 fused_ordering(18) 00:13:37.004 fused_ordering(19) 00:13:37.004 fused_ordering(20) 00:13:37.004 fused_ordering(21) 00:13:37.004 fused_ordering(22) 00:13:37.004 fused_ordering(23) 00:13:37.004 fused_ordering(24) 00:13:37.004 fused_ordering(25) 00:13:37.004 fused_ordering(26) 00:13:37.004 fused_ordering(27) 00:13:37.004 fused_ordering(28) 00:13:37.004 fused_ordering(29) 00:13:37.004 fused_ordering(30) 00:13:37.004 fused_ordering(31) 00:13:37.004 fused_ordering(32) 00:13:37.004 fused_ordering(33) 00:13:37.004 fused_ordering(34) 00:13:37.004 fused_ordering(35) 00:13:37.004 fused_ordering(36) 00:13:37.004 fused_ordering(37) 00:13:37.004 fused_ordering(38) 00:13:37.004 fused_ordering(39) 00:13:37.004 fused_ordering(40) 00:13:37.004 fused_ordering(41) 00:13:37.004 fused_ordering(42) 00:13:37.004 fused_ordering(43) 00:13:37.004 fused_ordering(44) 00:13:37.004 fused_ordering(45) 00:13:37.004 fused_ordering(46) 00:13:37.004 fused_ordering(47) 00:13:37.004 fused_ordering(48) 00:13:37.004 fused_ordering(49) 00:13:37.004 fused_ordering(50) 00:13:37.004 fused_ordering(51) 00:13:37.004 fused_ordering(52) 00:13:37.004 fused_ordering(53) 00:13:37.004 fused_ordering(54) 00:13:37.004 fused_ordering(55) 00:13:37.004 fused_ordering(56) 00:13:37.004 fused_ordering(57) 00:13:37.004 fused_ordering(58) 00:13:37.004 fused_ordering(59) 00:13:37.004 fused_ordering(60) 00:13:37.004 fused_ordering(61) 00:13:37.004 fused_ordering(62) 00:13:37.004 fused_ordering(63) 00:13:37.004 fused_ordering(64) 00:13:37.004 fused_ordering(65) 00:13:37.004 fused_ordering(66) 00:13:37.004 fused_ordering(67) 00:13:37.004 fused_ordering(68) 00:13:37.004 fused_ordering(69) 00:13:37.004 fused_ordering(70) 00:13:37.004 fused_ordering(71) 00:13:37.004 fused_ordering(72) 00:13:37.004 fused_ordering(73) 00:13:37.004 fused_ordering(74) 00:13:37.004 fused_ordering(75) 00:13:37.004 fused_ordering(76) 00:13:37.004 fused_ordering(77) 00:13:37.004 fused_ordering(78) 00:13:37.004 fused_ordering(79) 00:13:37.004 fused_ordering(80) 00:13:37.004 fused_ordering(81) 00:13:37.004 fused_ordering(82) 00:13:37.004 fused_ordering(83) 00:13:37.004 fused_ordering(84) 00:13:37.004 fused_ordering(85) 00:13:37.004 fused_ordering(86) 00:13:37.004 fused_ordering(87) 00:13:37.004 fused_ordering(88) 00:13:37.004 fused_ordering(89) 00:13:37.004 fused_ordering(90) 00:13:37.004 fused_ordering(91) 00:13:37.004 fused_ordering(92) 00:13:37.004 fused_ordering(93) 00:13:37.004 fused_ordering(94) 00:13:37.004 fused_ordering(95) 00:13:37.004 fused_ordering(96) 00:13:37.004 fused_ordering(97) 00:13:37.004 fused_ordering(98) 00:13:37.004 fused_ordering(99) 00:13:37.004 fused_ordering(100) 00:13:37.004 fused_ordering(101) 00:13:37.004 fused_ordering(102) 00:13:37.004 fused_ordering(103) 00:13:37.004 fused_ordering(104) 00:13:37.004 fused_ordering(105) 00:13:37.004 fused_ordering(106) 00:13:37.004 fused_ordering(107) 00:13:37.004 fused_ordering(108) 00:13:37.004 fused_ordering(109) 00:13:37.004 fused_ordering(110) 00:13:37.004 fused_ordering(111) 00:13:37.004 fused_ordering(112) 00:13:37.004 fused_ordering(113) 00:13:37.004 fused_ordering(114) 00:13:37.004 fused_ordering(115) 00:13:37.004 fused_ordering(116) 00:13:37.004 fused_ordering(117) 00:13:37.004 fused_ordering(118) 00:13:37.004 fused_ordering(119) 00:13:37.004 fused_ordering(120) 00:13:37.004 fused_ordering(121) 00:13:37.004 fused_ordering(122) 00:13:37.004 fused_ordering(123) 00:13:37.004 fused_ordering(124) 00:13:37.004 fused_ordering(125) 00:13:37.004 fused_ordering(126) 00:13:37.004 fused_ordering(127) 00:13:37.004 fused_ordering(128) 00:13:37.004 fused_ordering(129) 00:13:37.004 fused_ordering(130) 00:13:37.004 fused_ordering(131) 00:13:37.004 fused_ordering(132) 00:13:37.004 fused_ordering(133) 00:13:37.004 fused_ordering(134) 00:13:37.004 fused_ordering(135) 00:13:37.004 fused_ordering(136) 00:13:37.004 fused_ordering(137) 00:13:37.004 fused_ordering(138) 00:13:37.004 fused_ordering(139) 00:13:37.004 fused_ordering(140) 00:13:37.004 fused_ordering(141) 00:13:37.004 fused_ordering(142) 00:13:37.004 fused_ordering(143) 00:13:37.004 fused_ordering(144) 00:13:37.004 fused_ordering(145) 00:13:37.004 fused_ordering(146) 00:13:37.004 fused_ordering(147) 00:13:37.004 fused_ordering(148) 00:13:37.004 fused_ordering(149) 00:13:37.004 fused_ordering(150) 00:13:37.004 fused_ordering(151) 00:13:37.004 fused_ordering(152) 00:13:37.004 fused_ordering(153) 00:13:37.004 fused_ordering(154) 00:13:37.004 fused_ordering(155) 00:13:37.004 fused_ordering(156) 00:13:37.004 fused_ordering(157) 00:13:37.004 fused_ordering(158) 00:13:37.004 fused_ordering(159) 00:13:37.004 fused_ordering(160) 00:13:37.004 fused_ordering(161) 00:13:37.004 fused_ordering(162) 00:13:37.004 fused_ordering(163) 00:13:37.004 fused_ordering(164) 00:13:37.004 fused_ordering(165) 00:13:37.004 fused_ordering(166) 00:13:37.004 fused_ordering(167) 00:13:37.004 fused_ordering(168) 00:13:37.004 fused_ordering(169) 00:13:37.004 fused_ordering(170) 00:13:37.004 fused_ordering(171) 00:13:37.004 fused_ordering(172) 00:13:37.004 fused_ordering(173) 00:13:37.004 fused_ordering(174) 00:13:37.004 fused_ordering(175) 00:13:37.004 fused_ordering(176) 00:13:37.004 fused_ordering(177) 00:13:37.004 fused_ordering(178) 00:13:37.004 fused_ordering(179) 00:13:37.004 fused_ordering(180) 00:13:37.004 fused_ordering(181) 00:13:37.004 fused_ordering(182) 00:13:37.004 fused_ordering(183) 00:13:37.004 fused_ordering(184) 00:13:37.004 fused_ordering(185) 00:13:37.004 fused_ordering(186) 00:13:37.004 fused_ordering(187) 00:13:37.004 fused_ordering(188) 00:13:37.004 fused_ordering(189) 00:13:37.004 fused_ordering(190) 00:13:37.004 fused_ordering(191) 00:13:37.004 fused_ordering(192) 00:13:37.004 fused_ordering(193) 00:13:37.004 fused_ordering(194) 00:13:37.004 fused_ordering(195) 00:13:37.004 fused_ordering(196) 00:13:37.004 fused_ordering(197) 00:13:37.004 fused_ordering(198) 00:13:37.004 fused_ordering(199) 00:13:37.004 fused_ordering(200) 00:13:37.004 fused_ordering(201) 00:13:37.004 fused_ordering(202) 00:13:37.004 fused_ordering(203) 00:13:37.004 fused_ordering(204) 00:13:37.004 fused_ordering(205) 00:13:37.569 fused_ordering(206) 00:13:37.569 fused_ordering(207) 00:13:37.569 fused_ordering(208) 00:13:37.569 fused_ordering(209) 00:13:37.569 fused_ordering(210) 00:13:37.569 fused_ordering(211) 00:13:37.569 fused_ordering(212) 00:13:37.569 fused_ordering(213) 00:13:37.569 fused_ordering(214) 00:13:37.569 fused_ordering(215) 00:13:37.569 fused_ordering(216) 00:13:37.569 fused_ordering(217) 00:13:37.569 fused_ordering(218) 00:13:37.569 fused_ordering(219) 00:13:37.569 fused_ordering(220) 00:13:37.569 fused_ordering(221) 00:13:37.569 fused_ordering(222) 00:13:37.569 fused_ordering(223) 00:13:37.569 fused_ordering(224) 00:13:37.569 fused_ordering(225) 00:13:37.569 fused_ordering(226) 00:13:37.569 fused_ordering(227) 00:13:37.569 fused_ordering(228) 00:13:37.569 fused_ordering(229) 00:13:37.569 fused_ordering(230) 00:13:37.569 fused_ordering(231) 00:13:37.569 fused_ordering(232) 00:13:37.569 fused_ordering(233) 00:13:37.569 fused_ordering(234) 00:13:37.569 fused_ordering(235) 00:13:37.569 fused_ordering(236) 00:13:37.569 fused_ordering(237) 00:13:37.570 fused_ordering(238) 00:13:37.570 fused_ordering(239) 00:13:37.570 fused_ordering(240) 00:13:37.570 fused_ordering(241) 00:13:37.570 fused_ordering(242) 00:13:37.570 fused_ordering(243) 00:13:37.570 fused_ordering(244) 00:13:37.570 fused_ordering(245) 00:13:37.570 fused_ordering(246) 00:13:37.570 fused_ordering(247) 00:13:37.570 fused_ordering(248) 00:13:37.570 fused_ordering(249) 00:13:37.570 fused_ordering(250) 00:13:37.570 fused_ordering(251) 00:13:37.570 fused_ordering(252) 00:13:37.570 fused_ordering(253) 00:13:37.570 fused_ordering(254) 00:13:37.570 fused_ordering(255) 00:13:37.570 fused_ordering(256) 00:13:37.570 fused_ordering(257) 00:13:37.570 fused_ordering(258) 00:13:37.570 fused_ordering(259) 00:13:37.570 fused_ordering(260) 00:13:37.570 fused_ordering(261) 00:13:37.570 fused_ordering(262) 00:13:37.570 fused_ordering(263) 00:13:37.570 fused_ordering(264) 00:13:37.570 fused_ordering(265) 00:13:37.570 fused_ordering(266) 00:13:37.570 fused_ordering(267) 00:13:37.570 fused_ordering(268) 00:13:37.570 fused_ordering(269) 00:13:37.570 fused_ordering(270) 00:13:37.570 fused_ordering(271) 00:13:37.570 fused_ordering(272) 00:13:37.570 fused_ordering(273) 00:13:37.570 fused_ordering(274) 00:13:37.570 fused_ordering(275) 00:13:37.570 fused_ordering(276) 00:13:37.570 fused_ordering(277) 00:13:37.570 fused_ordering(278) 00:13:37.570 fused_ordering(279) 00:13:37.570 fused_ordering(280) 00:13:37.570 fused_ordering(281) 00:13:37.570 fused_ordering(282) 00:13:37.570 fused_ordering(283) 00:13:37.570 fused_ordering(284) 00:13:37.570 fused_ordering(285) 00:13:37.570 fused_ordering(286) 00:13:37.570 fused_ordering(287) 00:13:37.570 fused_ordering(288) 00:13:37.570 fused_ordering(289) 00:13:37.570 fused_ordering(290) 00:13:37.570 fused_ordering(291) 00:13:37.570 fused_ordering(292) 00:13:37.570 fused_ordering(293) 00:13:37.570 fused_ordering(294) 00:13:37.570 fused_ordering(295) 00:13:37.570 fused_ordering(296) 00:13:37.570 fused_ordering(297) 00:13:37.570 fused_ordering(298) 00:13:37.570 fused_ordering(299) 00:13:37.570 fused_ordering(300) 00:13:37.570 fused_ordering(301) 00:13:37.570 fused_ordering(302) 00:13:37.570 fused_ordering(303) 00:13:37.570 fused_ordering(304) 00:13:37.570 fused_ordering(305) 00:13:37.570 fused_ordering(306) 00:13:37.570 fused_ordering(307) 00:13:37.570 fused_ordering(308) 00:13:37.570 fused_ordering(309) 00:13:37.570 fused_ordering(310) 00:13:37.570 fused_ordering(311) 00:13:37.570 fused_ordering(312) 00:13:37.570 fused_ordering(313) 00:13:37.570 fused_ordering(314) 00:13:37.570 fused_ordering(315) 00:13:37.570 fused_ordering(316) 00:13:37.570 fused_ordering(317) 00:13:37.570 fused_ordering(318) 00:13:37.570 fused_ordering(319) 00:13:37.570 fused_ordering(320) 00:13:37.570 fused_ordering(321) 00:13:37.570 fused_ordering(322) 00:13:37.570 fused_ordering(323) 00:13:37.570 fused_ordering(324) 00:13:37.570 fused_ordering(325) 00:13:37.570 fused_ordering(326) 00:13:37.570 fused_ordering(327) 00:13:37.570 fused_ordering(328) 00:13:37.570 fused_ordering(329) 00:13:37.570 fused_ordering(330) 00:13:37.570 fused_ordering(331) 00:13:37.570 fused_ordering(332) 00:13:37.570 fused_ordering(333) 00:13:37.570 fused_ordering(334) 00:13:37.570 fused_ordering(335) 00:13:37.570 fused_ordering(336) 00:13:37.570 fused_ordering(337) 00:13:37.570 fused_ordering(338) 00:13:37.570 fused_ordering(339) 00:13:37.570 fused_ordering(340) 00:13:37.570 fused_ordering(341) 00:13:37.570 fused_ordering(342) 00:13:37.570 fused_ordering(343) 00:13:37.570 fused_ordering(344) 00:13:37.570 fused_ordering(345) 00:13:37.570 fused_ordering(346) 00:13:37.570 fused_ordering(347) 00:13:37.570 fused_ordering(348) 00:13:37.570 fused_ordering(349) 00:13:37.570 fused_ordering(350) 00:13:37.570 fused_ordering(351) 00:13:37.570 fused_ordering(352) 00:13:37.570 fused_ordering(353) 00:13:37.570 fused_ordering(354) 00:13:37.570 fused_ordering(355) 00:13:37.570 fused_ordering(356) 00:13:37.570 fused_ordering(357) 00:13:37.570 fused_ordering(358) 00:13:37.570 fused_ordering(359) 00:13:37.570 fused_ordering(360) 00:13:37.570 fused_ordering(361) 00:13:37.570 fused_ordering(362) 00:13:37.570 fused_ordering(363) 00:13:37.570 fused_ordering(364) 00:13:37.570 fused_ordering(365) 00:13:37.570 fused_ordering(366) 00:13:37.570 fused_ordering(367) 00:13:37.570 fused_ordering(368) 00:13:37.570 fused_ordering(369) 00:13:37.570 fused_ordering(370) 00:13:37.570 fused_ordering(371) 00:13:37.570 fused_ordering(372) 00:13:37.570 fused_ordering(373) 00:13:37.570 fused_ordering(374) 00:13:37.570 fused_ordering(375) 00:13:37.570 fused_ordering(376) 00:13:37.570 fused_ordering(377) 00:13:37.570 fused_ordering(378) 00:13:37.570 fused_ordering(379) 00:13:37.570 fused_ordering(380) 00:13:37.570 fused_ordering(381) 00:13:37.570 fused_ordering(382) 00:13:37.570 fused_ordering(383) 00:13:37.570 fused_ordering(384) 00:13:37.570 fused_ordering(385) 00:13:37.570 fused_ordering(386) 00:13:37.570 fused_ordering(387) 00:13:37.570 fused_ordering(388) 00:13:37.570 fused_ordering(389) 00:13:37.570 fused_ordering(390) 00:13:37.570 fused_ordering(391) 00:13:37.570 fused_ordering(392) 00:13:37.570 fused_ordering(393) 00:13:37.570 fused_ordering(394) 00:13:37.570 fused_ordering(395) 00:13:37.570 fused_ordering(396) 00:13:37.570 fused_ordering(397) 00:13:37.570 fused_ordering(398) 00:13:37.570 fused_ordering(399) 00:13:37.570 fused_ordering(400) 00:13:37.570 fused_ordering(401) 00:13:37.570 fused_ordering(402) 00:13:37.570 fused_ordering(403) 00:13:37.570 fused_ordering(404) 00:13:37.570 fused_ordering(405) 00:13:37.570 fused_ordering(406) 00:13:37.570 fused_ordering(407) 00:13:37.570 fused_ordering(408) 00:13:37.570 fused_ordering(409) 00:13:37.570 fused_ordering(410) 00:13:37.828 fused_ordering(411) 00:13:37.828 fused_ordering(412) 00:13:37.828 fused_ordering(413) 00:13:37.828 fused_ordering(414) 00:13:37.828 fused_ordering(415) 00:13:37.828 fused_ordering(416) 00:13:37.828 fused_ordering(417) 00:13:37.828 fused_ordering(418) 00:13:37.828 fused_ordering(419) 00:13:37.828 fused_ordering(420) 00:13:37.828 fused_ordering(421) 00:13:37.828 fused_ordering(422) 00:13:37.828 fused_ordering(423) 00:13:37.828 fused_ordering(424) 00:13:37.828 fused_ordering(425) 00:13:37.828 fused_ordering(426) 00:13:37.828 fused_ordering(427) 00:13:37.828 fused_ordering(428) 00:13:37.828 fused_ordering(429) 00:13:37.828 fused_ordering(430) 00:13:37.828 fused_ordering(431) 00:13:37.828 fused_ordering(432) 00:13:37.828 fused_ordering(433) 00:13:37.828 fused_ordering(434) 00:13:37.828 fused_ordering(435) 00:13:37.828 fused_ordering(436) 00:13:37.828 fused_ordering(437) 00:13:37.828 fused_ordering(438) 00:13:37.828 fused_ordering(439) 00:13:37.828 fused_ordering(440) 00:13:37.828 fused_ordering(441) 00:13:37.828 fused_ordering(442) 00:13:37.828 fused_ordering(443) 00:13:37.828 fused_ordering(444) 00:13:37.828 fused_ordering(445) 00:13:37.828 fused_ordering(446) 00:13:37.828 fused_ordering(447) 00:13:37.828 fused_ordering(448) 00:13:37.828 fused_ordering(449) 00:13:37.828 fused_ordering(450) 00:13:37.828 fused_ordering(451) 00:13:37.828 fused_ordering(452) 00:13:37.828 fused_ordering(453) 00:13:37.828 fused_ordering(454) 00:13:37.828 fused_ordering(455) 00:13:37.828 fused_ordering(456) 00:13:37.828 fused_ordering(457) 00:13:37.828 fused_ordering(458) 00:13:37.828 fused_ordering(459) 00:13:37.828 fused_ordering(460) 00:13:37.828 fused_ordering(461) 00:13:37.828 fused_ordering(462) 00:13:37.828 fused_ordering(463) 00:13:37.828 fused_ordering(464) 00:13:37.828 fused_ordering(465) 00:13:37.828 fused_ordering(466) 00:13:37.828 fused_ordering(467) 00:13:37.828 fused_ordering(468) 00:13:37.828 fused_ordering(469) 00:13:37.828 fused_ordering(470) 00:13:37.828 fused_ordering(471) 00:13:37.828 fused_ordering(472) 00:13:37.828 fused_ordering(473) 00:13:37.828 fused_ordering(474) 00:13:37.828 fused_ordering(475) 00:13:37.828 fused_ordering(476) 00:13:37.828 fused_ordering(477) 00:13:37.828 fused_ordering(478) 00:13:37.828 fused_ordering(479) 00:13:37.828 fused_ordering(480) 00:13:37.828 fused_ordering(481) 00:13:37.828 fused_ordering(482) 00:13:37.828 fused_ordering(483) 00:13:37.828 fused_ordering(484) 00:13:37.828 fused_ordering(485) 00:13:37.828 fused_ordering(486) 00:13:37.828 fused_ordering(487) 00:13:37.828 fused_ordering(488) 00:13:37.828 fused_ordering(489) 00:13:37.828 fused_ordering(490) 00:13:37.828 fused_ordering(491) 00:13:37.828 fused_ordering(492) 00:13:37.828 fused_ordering(493) 00:13:37.828 fused_ordering(494) 00:13:37.828 fused_ordering(495) 00:13:37.828 fused_ordering(496) 00:13:37.828 fused_ordering(497) 00:13:37.828 fused_ordering(498) 00:13:37.828 fused_ordering(499) 00:13:37.828 fused_ordering(500) 00:13:37.828 fused_ordering(501) 00:13:37.828 fused_ordering(502) 00:13:37.828 fused_ordering(503) 00:13:37.828 fused_ordering(504) 00:13:37.828 fused_ordering(505) 00:13:37.828 fused_ordering(506) 00:13:37.828 fused_ordering(507) 00:13:37.828 fused_ordering(508) 00:13:37.828 fused_ordering(509) 00:13:37.828 fused_ordering(510) 00:13:37.828 fused_ordering(511) 00:13:37.828 fused_ordering(512) 00:13:37.828 fused_ordering(513) 00:13:37.828 fused_ordering(514) 00:13:37.828 fused_ordering(515) 00:13:37.828 fused_ordering(516) 00:13:37.828 fused_ordering(517) 00:13:37.828 fused_ordering(518) 00:13:37.828 fused_ordering(519) 00:13:37.828 fused_ordering(520) 00:13:37.828 fused_ordering(521) 00:13:37.828 fused_ordering(522) 00:13:37.828 fused_ordering(523) 00:13:37.828 fused_ordering(524) 00:13:37.828 fused_ordering(525) 00:13:37.828 fused_ordering(526) 00:13:37.828 fused_ordering(527) 00:13:37.828 fused_ordering(528) 00:13:37.828 fused_ordering(529) 00:13:37.828 fused_ordering(530) 00:13:37.828 fused_ordering(531) 00:13:37.828 fused_ordering(532) 00:13:37.828 fused_ordering(533) 00:13:37.828 fused_ordering(534) 00:13:37.828 fused_ordering(535) 00:13:37.828 fused_ordering(536) 00:13:37.828 fused_ordering(537) 00:13:37.828 fused_ordering(538) 00:13:37.828 fused_ordering(539) 00:13:37.828 fused_ordering(540) 00:13:37.828 fused_ordering(541) 00:13:37.828 fused_ordering(542) 00:13:37.828 fused_ordering(543) 00:13:37.828 fused_ordering(544) 00:13:37.828 fused_ordering(545) 00:13:37.828 fused_ordering(546) 00:13:37.828 fused_ordering(547) 00:13:37.828 fused_ordering(548) 00:13:37.828 fused_ordering(549) 00:13:37.828 fused_ordering(550) 00:13:37.828 fused_ordering(551) 00:13:37.828 fused_ordering(552) 00:13:37.828 fused_ordering(553) 00:13:37.828 fused_ordering(554) 00:13:37.828 fused_ordering(555) 00:13:37.828 fused_ordering(556) 00:13:37.828 fused_ordering(557) 00:13:37.828 fused_ordering(558) 00:13:37.828 fused_ordering(559) 00:13:37.828 fused_ordering(560) 00:13:37.828 fused_ordering(561) 00:13:37.828 fused_ordering(562) 00:13:37.828 fused_ordering(563) 00:13:37.828 fused_ordering(564) 00:13:37.828 fused_ordering(565) 00:13:37.828 fused_ordering(566) 00:13:37.828 fused_ordering(567) 00:13:37.828 fused_ordering(568) 00:13:37.828 fused_ordering(569) 00:13:37.828 fused_ordering(570) 00:13:37.828 fused_ordering(571) 00:13:37.828 fused_ordering(572) 00:13:37.828 fused_ordering(573) 00:13:37.828 fused_ordering(574) 00:13:37.828 fused_ordering(575) 00:13:37.828 fused_ordering(576) 00:13:37.828 fused_ordering(577) 00:13:37.828 fused_ordering(578) 00:13:37.828 fused_ordering(579) 00:13:37.828 fused_ordering(580) 00:13:37.828 fused_ordering(581) 00:13:37.828 fused_ordering(582) 00:13:37.828 fused_ordering(583) 00:13:37.828 fused_ordering(584) 00:13:37.828 fused_ordering(585) 00:13:37.828 fused_ordering(586) 00:13:37.828 fused_ordering(587) 00:13:37.828 fused_ordering(588) 00:13:37.828 fused_ordering(589) 00:13:37.828 fused_ordering(590) 00:13:37.828 fused_ordering(591) 00:13:37.828 fused_ordering(592) 00:13:37.828 fused_ordering(593) 00:13:37.828 fused_ordering(594) 00:13:37.828 fused_ordering(595) 00:13:37.828 fused_ordering(596) 00:13:37.828 fused_ordering(597) 00:13:37.828 fused_ordering(598) 00:13:37.828 fused_ordering(599) 00:13:37.828 fused_ordering(600) 00:13:37.828 fused_ordering(601) 00:13:37.828 fused_ordering(602) 00:13:37.828 fused_ordering(603) 00:13:37.828 fused_ordering(604) 00:13:37.828 fused_ordering(605) 00:13:37.828 fused_ordering(606) 00:13:37.828 fused_ordering(607) 00:13:37.828 fused_ordering(608) 00:13:37.828 fused_ordering(609) 00:13:37.828 fused_ordering(610) 00:13:37.828 fused_ordering(611) 00:13:37.828 fused_ordering(612) 00:13:37.828 fused_ordering(613) 00:13:37.828 fused_ordering(614) 00:13:37.828 fused_ordering(615) 00:13:38.394 fused_ordering(616) 00:13:38.394 fused_ordering(617) 00:13:38.394 fused_ordering(618) 00:13:38.394 fused_ordering(619) 00:13:38.394 fused_ordering(620) 00:13:38.394 fused_ordering(621) 00:13:38.394 fused_ordering(622) 00:13:38.394 fused_ordering(623) 00:13:38.394 fused_ordering(624) 00:13:38.394 fused_ordering(625) 00:13:38.394 fused_ordering(626) 00:13:38.394 fused_ordering(627) 00:13:38.394 fused_ordering(628) 00:13:38.394 fused_ordering(629) 00:13:38.394 fused_ordering(630) 00:13:38.394 fused_ordering(631) 00:13:38.394 fused_ordering(632) 00:13:38.394 fused_ordering(633) 00:13:38.394 fused_ordering(634) 00:13:38.394 fused_ordering(635) 00:13:38.394 fused_ordering(636) 00:13:38.394 fused_ordering(637) 00:13:38.394 fused_ordering(638) 00:13:38.394 fused_ordering(639) 00:13:38.394 fused_ordering(640) 00:13:38.394 fused_ordering(641) 00:13:38.394 fused_ordering(642) 00:13:38.394 fused_ordering(643) 00:13:38.394 fused_ordering(644) 00:13:38.394 fused_ordering(645) 00:13:38.394 fused_ordering(646) 00:13:38.394 fused_ordering(647) 00:13:38.394 fused_ordering(648) 00:13:38.394 fused_ordering(649) 00:13:38.394 fused_ordering(650) 00:13:38.394 fused_ordering(651) 00:13:38.394 fused_ordering(652) 00:13:38.394 fused_ordering(653) 00:13:38.394 fused_ordering(654) 00:13:38.394 fused_ordering(655) 00:13:38.394 fused_ordering(656) 00:13:38.394 fused_ordering(657) 00:13:38.394 fused_ordering(658) 00:13:38.394 fused_ordering(659) 00:13:38.394 fused_ordering(660) 00:13:38.394 fused_ordering(661) 00:13:38.394 fused_ordering(662) 00:13:38.394 fused_ordering(663) 00:13:38.394 fused_ordering(664) 00:13:38.394 fused_ordering(665) 00:13:38.394 fused_ordering(666) 00:13:38.394 fused_ordering(667) 00:13:38.394 fused_ordering(668) 00:13:38.394 fused_ordering(669) 00:13:38.394 fused_ordering(670) 00:13:38.394 fused_ordering(671) 00:13:38.394 fused_ordering(672) 00:13:38.394 fused_ordering(673) 00:13:38.394 fused_ordering(674) 00:13:38.394 fused_ordering(675) 00:13:38.394 fused_ordering(676) 00:13:38.394 fused_ordering(677) 00:13:38.394 fused_ordering(678) 00:13:38.394 fused_ordering(679) 00:13:38.394 fused_ordering(680) 00:13:38.394 fused_ordering(681) 00:13:38.394 fused_ordering(682) 00:13:38.394 fused_ordering(683) 00:13:38.394 fused_ordering(684) 00:13:38.394 fused_ordering(685) 00:13:38.394 fused_ordering(686) 00:13:38.394 fused_ordering(687) 00:13:38.394 fused_ordering(688) 00:13:38.394 fused_ordering(689) 00:13:38.394 fused_ordering(690) 00:13:38.394 fused_ordering(691) 00:13:38.394 fused_ordering(692) 00:13:38.394 fused_ordering(693) 00:13:38.394 fused_ordering(694) 00:13:38.394 fused_ordering(695) 00:13:38.394 fused_ordering(696) 00:13:38.394 fused_ordering(697) 00:13:38.394 fused_ordering(698) 00:13:38.394 fused_ordering(699) 00:13:38.394 fused_ordering(700) 00:13:38.394 fused_ordering(701) 00:13:38.394 fused_ordering(702) 00:13:38.394 fused_ordering(703) 00:13:38.394 fused_ordering(704) 00:13:38.394 fused_ordering(705) 00:13:38.394 fused_ordering(706) 00:13:38.394 fused_ordering(707) 00:13:38.394 fused_ordering(708) 00:13:38.394 fused_ordering(709) 00:13:38.394 fused_ordering(710) 00:13:38.394 fused_ordering(711) 00:13:38.394 fused_ordering(712) 00:13:38.394 fused_ordering(713) 00:13:38.394 fused_ordering(714) 00:13:38.394 fused_ordering(715) 00:13:38.394 fused_ordering(716) 00:13:38.394 fused_ordering(717) 00:13:38.394 fused_ordering(718) 00:13:38.394 fused_ordering(719) 00:13:38.394 fused_ordering(720) 00:13:38.394 fused_ordering(721) 00:13:38.394 fused_ordering(722) 00:13:38.394 fused_ordering(723) 00:13:38.394 fused_ordering(724) 00:13:38.394 fused_ordering(725) 00:13:38.394 fused_ordering(726) 00:13:38.394 fused_ordering(727) 00:13:38.394 fused_ordering(728) 00:13:38.394 fused_ordering(729) 00:13:38.394 fused_ordering(730) 00:13:38.394 fused_ordering(731) 00:13:38.394 fused_ordering(732) 00:13:38.394 fused_ordering(733) 00:13:38.394 fused_ordering(734) 00:13:38.394 fused_ordering(735) 00:13:38.394 fused_ordering(736) 00:13:38.394 fused_ordering(737) 00:13:38.394 fused_ordering(738) 00:13:38.394 fused_ordering(739) 00:13:38.394 fused_ordering(740) 00:13:38.394 fused_ordering(741) 00:13:38.394 fused_ordering(742) 00:13:38.394 fused_ordering(743) 00:13:38.394 fused_ordering(744) 00:13:38.394 fused_ordering(745) 00:13:38.394 fused_ordering(746) 00:13:38.394 fused_ordering(747) 00:13:38.394 fused_ordering(748) 00:13:38.394 fused_ordering(749) 00:13:38.394 fused_ordering(750) 00:13:38.394 fused_ordering(751) 00:13:38.394 fused_ordering(752) 00:13:38.394 fused_ordering(753) 00:13:38.394 fused_ordering(754) 00:13:38.394 fused_ordering(755) 00:13:38.394 fused_ordering(756) 00:13:38.394 fused_ordering(757) 00:13:38.394 fused_ordering(758) 00:13:38.394 fused_ordering(759) 00:13:38.394 fused_ordering(760) 00:13:38.394 fused_ordering(761) 00:13:38.394 fused_ordering(762) 00:13:38.394 fused_ordering(763) 00:13:38.394 fused_ordering(764) 00:13:38.394 fused_ordering(765) 00:13:38.394 fused_ordering(766) 00:13:38.394 fused_ordering(767) 00:13:38.394 fused_ordering(768) 00:13:38.394 fused_ordering(769) 00:13:38.394 fused_ordering(770) 00:13:38.394 fused_ordering(771) 00:13:38.394 fused_ordering(772) 00:13:38.395 fused_ordering(773) 00:13:38.395 fused_ordering(774) 00:13:38.395 fused_ordering(775) 00:13:38.395 fused_ordering(776) 00:13:38.395 fused_ordering(777) 00:13:38.395 fused_ordering(778) 00:13:38.395 fused_ordering(779) 00:13:38.395 fused_ordering(780) 00:13:38.395 fused_ordering(781) 00:13:38.395 fused_ordering(782) 00:13:38.395 fused_ordering(783) 00:13:38.395 fused_ordering(784) 00:13:38.395 fused_ordering(785) 00:13:38.395 fused_ordering(786) 00:13:38.395 fused_ordering(787) 00:13:38.395 fused_ordering(788) 00:13:38.395 fused_ordering(789) 00:13:38.395 fused_ordering(790) 00:13:38.395 fused_ordering(791) 00:13:38.395 fused_ordering(792) 00:13:38.395 fused_ordering(793) 00:13:38.395 fused_ordering(794) 00:13:38.395 fused_ordering(795) 00:13:38.395 fused_ordering(796) 00:13:38.395 fused_ordering(797) 00:13:38.395 fused_ordering(798) 00:13:38.395 fused_ordering(799) 00:13:38.395 fused_ordering(800) 00:13:38.395 fused_ordering(801) 00:13:38.395 fused_ordering(802) 00:13:38.395 fused_ordering(803) 00:13:38.395 fused_ordering(804) 00:13:38.395 fused_ordering(805) 00:13:38.395 fused_ordering(806) 00:13:38.395 fused_ordering(807) 00:13:38.395 fused_ordering(808) 00:13:38.395 fused_ordering(809) 00:13:38.395 fused_ordering(810) 00:13:38.395 fused_ordering(811) 00:13:38.395 fused_ordering(812) 00:13:38.395 fused_ordering(813) 00:13:38.395 fused_ordering(814) 00:13:38.395 fused_ordering(815) 00:13:38.395 fused_ordering(816) 00:13:38.395 fused_ordering(817) 00:13:38.395 fused_ordering(818) 00:13:38.395 fused_ordering(819) 00:13:38.395 fused_ordering(820) 00:13:39.327 fused_ordering(821) 00:13:39.328 fused_ordering(822) 00:13:39.328 fused_ordering(823) 00:13:39.328 fused_ordering(824) 00:13:39.328 fused_ordering(825) 00:13:39.328 fused_ordering(826) 00:13:39.328 fused_ordering(827) 00:13:39.328 fused_ordering(828) 00:13:39.328 fused_ordering(829) 00:13:39.328 fused_ordering(830) 00:13:39.328 fused_ordering(831) 00:13:39.328 fused_ordering(832) 00:13:39.328 fused_ordering(833) 00:13:39.328 fused_ordering(834) 00:13:39.328 fused_ordering(835) 00:13:39.328 fused_ordering(836) 00:13:39.328 fused_ordering(837) 00:13:39.328 fused_ordering(838) 00:13:39.328 fused_ordering(839) 00:13:39.328 fused_ordering(840) 00:13:39.328 fused_ordering(841) 00:13:39.328 fused_ordering(842) 00:13:39.328 fused_ordering(843) 00:13:39.328 fused_ordering(844) 00:13:39.328 fused_ordering(845) 00:13:39.328 fused_ordering(846) 00:13:39.328 fused_ordering(847) 00:13:39.328 fused_ordering(848) 00:13:39.328 fused_ordering(849) 00:13:39.328 fused_ordering(850) 00:13:39.328 fused_ordering(851) 00:13:39.328 fused_ordering(852) 00:13:39.328 fused_ordering(853) 00:13:39.328 fused_ordering(854) 00:13:39.328 fused_ordering(855) 00:13:39.328 fused_ordering(856) 00:13:39.328 fused_ordering(857) 00:13:39.328 fused_ordering(858) 00:13:39.328 fused_ordering(859) 00:13:39.328 fused_ordering(860) 00:13:39.328 fused_ordering(861) 00:13:39.328 fused_ordering(862) 00:13:39.328 fused_ordering(863) 00:13:39.328 fused_ordering(864) 00:13:39.328 fused_ordering(865) 00:13:39.328 fused_ordering(866) 00:13:39.328 fused_ordering(867) 00:13:39.328 fused_ordering(868) 00:13:39.328 fused_ordering(869) 00:13:39.328 fused_ordering(870) 00:13:39.328 fused_ordering(871) 00:13:39.328 fused_ordering(872) 00:13:39.328 fused_ordering(873) 00:13:39.328 fused_ordering(874) 00:13:39.328 fused_ordering(875) 00:13:39.328 fused_ordering(876) 00:13:39.328 fused_ordering(877) 00:13:39.328 fused_ordering(878) 00:13:39.328 fused_ordering(879) 00:13:39.328 fused_ordering(880) 00:13:39.328 fused_ordering(881) 00:13:39.328 fused_ordering(882) 00:13:39.328 fused_ordering(883) 00:13:39.328 fused_ordering(884) 00:13:39.328 fused_ordering(885) 00:13:39.328 fused_ordering(886) 00:13:39.328 fused_ordering(887) 00:13:39.328 fused_ordering(888) 00:13:39.328 fused_ordering(889) 00:13:39.328 fused_ordering(890) 00:13:39.328 fused_ordering(891) 00:13:39.328 fused_ordering(892) 00:13:39.328 fused_ordering(893) 00:13:39.328 fused_ordering(894) 00:13:39.328 fused_ordering(895) 00:13:39.328 fused_ordering(896) 00:13:39.328 fused_ordering(897) 00:13:39.328 fused_ordering(898) 00:13:39.328 fused_ordering(899) 00:13:39.328 fused_ordering(900) 00:13:39.328 fused_ordering(901) 00:13:39.328 fused_ordering(902) 00:13:39.328 fused_ordering(903) 00:13:39.328 fused_ordering(904) 00:13:39.328 fused_ordering(905) 00:13:39.328 fused_ordering(906) 00:13:39.328 fused_ordering(907) 00:13:39.328 fused_ordering(908) 00:13:39.328 fused_ordering(909) 00:13:39.328 fused_ordering(910) 00:13:39.328 fused_ordering(911) 00:13:39.328 fused_ordering(912) 00:13:39.328 fused_ordering(913) 00:13:39.328 fused_ordering(914) 00:13:39.328 fused_ordering(915) 00:13:39.328 fused_ordering(916) 00:13:39.328 fused_ordering(917) 00:13:39.328 fused_ordering(918) 00:13:39.328 fused_ordering(919) 00:13:39.328 fused_ordering(920) 00:13:39.328 fused_ordering(921) 00:13:39.328 fused_ordering(922) 00:13:39.328 fused_ordering(923) 00:13:39.328 fused_ordering(924) 00:13:39.328 fused_ordering(925) 00:13:39.328 fused_ordering(926) 00:13:39.328 fused_ordering(927) 00:13:39.328 fused_ordering(928) 00:13:39.328 fused_ordering(929) 00:13:39.328 fused_ordering(930) 00:13:39.328 fused_ordering(931) 00:13:39.328 fused_ordering(932) 00:13:39.328 fused_ordering(933) 00:13:39.328 fused_ordering(934) 00:13:39.328 fused_ordering(935) 00:13:39.328 fused_ordering(936) 00:13:39.328 fused_ordering(937) 00:13:39.328 fused_ordering(938) 00:13:39.328 fused_ordering(939) 00:13:39.328 fused_ordering(940) 00:13:39.328 fused_ordering(941) 00:13:39.328 fused_ordering(942) 00:13:39.328 fused_ordering(943) 00:13:39.328 fused_ordering(944) 00:13:39.328 fused_ordering(945) 00:13:39.328 fused_ordering(946) 00:13:39.328 fused_ordering(947) 00:13:39.328 fused_ordering(948) 00:13:39.328 fused_ordering(949) 00:13:39.328 fused_ordering(950) 00:13:39.328 fused_ordering(951) 00:13:39.328 fused_ordering(952) 00:13:39.328 fused_ordering(953) 00:13:39.328 fused_ordering(954) 00:13:39.328 fused_ordering(955) 00:13:39.328 fused_ordering(956) 00:13:39.328 fused_ordering(957) 00:13:39.328 fused_ordering(958) 00:13:39.328 fused_ordering(959) 00:13:39.328 fused_ordering(960) 00:13:39.328 fused_ordering(961) 00:13:39.328 fused_ordering(962) 00:13:39.328 fused_ordering(963) 00:13:39.328 fused_ordering(964) 00:13:39.328 fused_ordering(965) 00:13:39.328 fused_ordering(966) 00:13:39.328 fused_ordering(967) 00:13:39.328 fused_ordering(968) 00:13:39.328 fused_ordering(969) 00:13:39.328 fused_ordering(970) 00:13:39.328 fused_ordering(971) 00:13:39.328 fused_ordering(972) 00:13:39.328 fused_ordering(973) 00:13:39.328 fused_ordering(974) 00:13:39.328 fused_ordering(975) 00:13:39.328 fused_ordering(976) 00:13:39.328 fused_ordering(977) 00:13:39.328 fused_ordering(978) 00:13:39.328 fused_ordering(979) 00:13:39.328 fused_ordering(980) 00:13:39.328 fused_ordering(981) 00:13:39.328 fused_ordering(982) 00:13:39.328 fused_ordering(983) 00:13:39.328 fused_ordering(984) 00:13:39.328 fused_ordering(985) 00:13:39.328 fused_ordering(986) 00:13:39.328 fused_ordering(987) 00:13:39.328 fused_ordering(988) 00:13:39.328 fused_ordering(989) 00:13:39.328 fused_ordering(990) 00:13:39.328 fused_ordering(991) 00:13:39.328 fused_ordering(992) 00:13:39.328 fused_ordering(993) 00:13:39.328 fused_ordering(994) 00:13:39.328 fused_ordering(995) 00:13:39.328 fused_ordering(996) 00:13:39.328 fused_ordering(997) 00:13:39.328 fused_ordering(998) 00:13:39.328 fused_ordering(999) 00:13:39.328 fused_ordering(1000) 00:13:39.328 fused_ordering(1001) 00:13:39.328 fused_ordering(1002) 00:13:39.328 fused_ordering(1003) 00:13:39.328 fused_ordering(1004) 00:13:39.328 fused_ordering(1005) 00:13:39.328 fused_ordering(1006) 00:13:39.328 fused_ordering(1007) 00:13:39.328 fused_ordering(1008) 00:13:39.328 fused_ordering(1009) 00:13:39.328 fused_ordering(1010) 00:13:39.328 fused_ordering(1011) 00:13:39.328 fused_ordering(1012) 00:13:39.328 fused_ordering(1013) 00:13:39.328 fused_ordering(1014) 00:13:39.328 fused_ordering(1015) 00:13:39.328 fused_ordering(1016) 00:13:39.328 fused_ordering(1017) 00:13:39.328 fused_ordering(1018) 00:13:39.328 fused_ordering(1019) 00:13:39.328 fused_ordering(1020) 00:13:39.328 fused_ordering(1021) 00:13:39.328 fused_ordering(1022) 00:13:39.328 fused_ordering(1023) 00:13:39.328 20:14:44 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:39.328 20:14:44 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:39.328 20:14:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:39.328 20:14:44 -- nvmf/common.sh@116 -- # sync 00:13:39.328 20:14:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:39.328 20:14:44 -- nvmf/common.sh@119 -- # set +e 00:13:39.328 20:14:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:39.328 20:14:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:39.328 rmmod nvme_tcp 00:13:39.328 rmmod nvme_fabrics 00:13:39.328 rmmod nvme_keyring 00:13:39.328 20:14:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:39.328 20:14:44 -- nvmf/common.sh@123 -- # set -e 00:13:39.328 20:14:44 -- nvmf/common.sh@124 -- # return 0 00:13:39.328 20:14:44 -- nvmf/common.sh@477 -- # '[' -n 3125873 ']' 00:13:39.328 20:14:44 -- nvmf/common.sh@478 -- # killprocess 3125873 00:13:39.328 20:14:44 -- common/autotest_common.sh@936 -- # '[' -z 3125873 ']' 00:13:39.328 20:14:44 -- common/autotest_common.sh@940 -- # kill -0 3125873 00:13:39.328 20:14:44 -- common/autotest_common.sh@941 -- # uname 00:13:39.328 20:14:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:39.328 20:14:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3125873 00:13:39.328 20:14:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:39.328 20:14:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:39.328 20:14:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3125873' 00:13:39.328 killing process with pid 3125873 00:13:39.328 20:14:44 -- common/autotest_common.sh@955 -- # kill 3125873 00:13:39.328 20:14:44 -- common/autotest_common.sh@960 -- # wait 3125873 00:13:39.587 20:14:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:39.587 20:14:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:39.587 20:14:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:39.587 20:14:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:39.587 20:14:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:39.587 20:14:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.587 20:14:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.587 20:14:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.120 20:14:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:42.120 00:13:42.120 real 0m8.452s 00:13:42.120 user 0m6.177s 00:13:42.120 sys 0m3.445s 00:13:42.120 20:14:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:42.120 20:14:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.120 ************************************ 00:13:42.120 END TEST nvmf_fused_ordering 00:13:42.120 ************************************ 00:13:42.120 20:14:46 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:42.120 20:14:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:42.120 20:14:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:42.120 20:14:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.120 ************************************ 00:13:42.120 START TEST nvmf_delete_subsystem 00:13:42.120 ************************************ 00:13:42.120 20:14:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:42.120 * Looking for test storage... 00:13:42.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:42.120 20:14:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:42.120 20:14:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:42.120 20:14:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:42.120 20:14:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:42.120 20:14:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:42.120 20:14:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:42.120 20:14:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:42.120 20:14:46 -- scripts/common.sh@335 -- # IFS=.-: 00:13:42.120 20:14:46 -- scripts/common.sh@335 -- # read -ra ver1 00:13:42.120 20:14:46 -- scripts/common.sh@336 -- # IFS=.-: 00:13:42.120 20:14:46 -- scripts/common.sh@336 -- # read -ra ver2 00:13:42.120 20:14:46 -- scripts/common.sh@337 -- # local 'op=<' 00:13:42.120 20:14:46 -- scripts/common.sh@339 -- # ver1_l=2 00:13:42.120 20:14:46 -- scripts/common.sh@340 -- # ver2_l=1 00:13:42.120 20:14:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:42.120 20:14:46 -- scripts/common.sh@343 -- # case "$op" in 00:13:42.120 20:14:46 -- scripts/common.sh@344 -- # : 1 00:13:42.120 20:14:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:42.120 20:14:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:42.120 20:14:46 -- scripts/common.sh@364 -- # decimal 1 00:13:42.120 20:14:46 -- scripts/common.sh@352 -- # local d=1 00:13:42.120 20:14:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:42.120 20:14:46 -- scripts/common.sh@354 -- # echo 1 00:13:42.120 20:14:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:42.120 20:14:46 -- scripts/common.sh@365 -- # decimal 2 00:13:42.120 20:14:46 -- scripts/common.sh@352 -- # local d=2 00:13:42.120 20:14:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:42.120 20:14:46 -- scripts/common.sh@354 -- # echo 2 00:13:42.120 20:14:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:42.120 20:14:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:42.120 20:14:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:42.120 20:14:46 -- scripts/common.sh@367 -- # return 0 00:13:42.120 20:14:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:42.120 20:14:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.120 --rc genhtml_branch_coverage=1 00:13:42.120 --rc genhtml_function_coverage=1 00:13:42.120 --rc genhtml_legend=1 00:13:42.120 --rc geninfo_all_blocks=1 00:13:42.120 --rc geninfo_unexecuted_blocks=1 00:13:42.120 00:13:42.120 ' 00:13:42.120 20:14:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.120 --rc genhtml_branch_coverage=1 00:13:42.120 --rc genhtml_function_coverage=1 00:13:42.120 --rc genhtml_legend=1 00:13:42.120 --rc geninfo_all_blocks=1 00:13:42.120 --rc geninfo_unexecuted_blocks=1 00:13:42.120 00:13:42.120 ' 00:13:42.120 20:14:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.120 --rc genhtml_branch_coverage=1 00:13:42.120 --rc genhtml_function_coverage=1 00:13:42.120 --rc genhtml_legend=1 00:13:42.120 --rc geninfo_all_blocks=1 00:13:42.120 --rc geninfo_unexecuted_blocks=1 00:13:42.120 00:13:42.120 ' 00:13:42.120 20:14:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.120 --rc genhtml_branch_coverage=1 00:13:42.120 --rc genhtml_function_coverage=1 00:13:42.120 --rc genhtml_legend=1 00:13:42.120 --rc geninfo_all_blocks=1 00:13:42.120 --rc geninfo_unexecuted_blocks=1 00:13:42.120 00:13:42.120 ' 00:13:42.120 20:14:46 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:42.120 20:14:46 -- nvmf/common.sh@7 -- # uname -s 00:13:42.120 20:14:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:42.120 20:14:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:42.120 20:14:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:42.120 20:14:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:42.120 20:14:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:42.120 20:14:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:42.120 20:14:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:42.120 20:14:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:42.120 20:14:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:42.120 20:14:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:42.121 20:14:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.121 20:14:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.121 20:14:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:42.121 20:14:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:42.121 20:14:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:42.121 20:14:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:42.121 20:14:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:42.121 20:14:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:42.121 20:14:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:42.121 20:14:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.121 20:14:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.121 20:14:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.121 20:14:46 -- paths/export.sh@5 -- # export PATH 00:13:42.121 20:14:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.121 20:14:46 -- nvmf/common.sh@46 -- # : 0 00:13:42.121 20:14:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:42.121 20:14:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:42.121 20:14:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:42.121 20:14:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:42.121 20:14:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:42.121 20:14:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:42.121 20:14:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:42.121 20:14:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:42.121 20:14:46 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:42.121 20:14:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:42.121 20:14:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:42.121 20:14:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:42.121 20:14:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:42.121 20:14:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:42.121 20:14:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.121 20:14:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.121 20:14:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.121 20:14:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:42.121 20:14:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:42.121 20:14:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:42.121 20:14:46 -- common/autotest_common.sh@10 -- # set +x 00:13:44.022 20:14:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:44.022 20:14:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:44.022 20:14:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:44.022 20:14:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:44.022 20:14:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:44.022 20:14:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:44.022 20:14:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:44.022 20:14:48 -- nvmf/common.sh@294 -- # net_devs=() 00:13:44.022 20:14:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:44.022 20:14:48 -- nvmf/common.sh@295 -- # e810=() 00:13:44.022 20:14:48 -- nvmf/common.sh@295 -- # local -ga e810 00:13:44.022 20:14:48 -- nvmf/common.sh@296 -- # x722=() 00:13:44.022 20:14:48 -- nvmf/common.sh@296 -- # local -ga x722 00:13:44.022 20:14:48 -- nvmf/common.sh@297 -- # mlx=() 00:13:44.022 20:14:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:44.022 20:14:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:44.022 20:14:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:44.022 20:14:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:44.022 20:14:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:44.022 20:14:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.022 20:14:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:44.022 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:44.022 20:14:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.022 20:14:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:44.022 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:44.022 20:14:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:44.022 20:14:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.022 20:14:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.022 20:14:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.022 20:14:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.022 20:14:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:44.022 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:44.022 20:14:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.022 20:14:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.022 20:14:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.022 20:14:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.022 20:14:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.022 20:14:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:44.022 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:44.022 20:14:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.022 20:14:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:44.022 20:14:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:44.022 20:14:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:44.022 20:14:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:44.022 20:14:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:44.022 20:14:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:44.022 20:14:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:44.022 20:14:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:44.022 20:14:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:44.022 20:14:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:44.022 20:14:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:44.022 20:14:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:44.022 20:14:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:44.022 20:14:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:44.022 20:14:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:44.022 20:14:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:44.022 20:14:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:44.022 20:14:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:44.022 20:14:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:44.022 20:14:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:44.022 20:14:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:44.022 20:14:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:44.022 20:14:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:44.022 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:44.022 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:13:44.022 00:13:44.022 --- 10.0.0.2 ping statistics --- 00:13:44.022 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.022 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:13:44.022 20:14:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:44.022 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:44.022 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:13:44.022 00:13:44.022 --- 10.0.0.1 ping statistics --- 00:13:44.022 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.022 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:13:44.022 20:14:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:44.022 20:14:48 -- nvmf/common.sh@410 -- # return 0 00:13:44.022 20:14:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:44.022 20:14:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:44.022 20:14:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:44.022 20:14:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:44.022 20:14:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:44.022 20:14:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:44.022 20:14:48 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:44.022 20:14:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:44.022 20:14:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:44.022 20:14:48 -- common/autotest_common.sh@10 -- # set +x 00:13:44.022 20:14:48 -- nvmf/common.sh@469 -- # nvmfpid=3128308 00:13:44.022 20:14:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:44.022 20:14:48 -- nvmf/common.sh@470 -- # waitforlisten 3128308 00:13:44.022 20:14:48 -- common/autotest_common.sh@829 -- # '[' -z 3128308 ']' 00:13:44.022 20:14:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:44.022 20:14:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:44.022 20:14:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:44.022 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:44.022 20:14:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:44.022 20:14:48 -- common/autotest_common.sh@10 -- # set +x 00:13:44.022 [2024-11-20 20:14:49.024666] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:44.022 [2024-11-20 20:14:49.024734] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:44.022 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.281 [2024-11-20 20:14:49.091290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:44.281 [2024-11-20 20:14:49.205822] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:44.281 [2024-11-20 20:14:49.205973] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:44.281 [2024-11-20 20:14:49.205991] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:44.281 [2024-11-20 20:14:49.206004] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:44.281 [2024-11-20 20:14:49.206086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:44.281 [2024-11-20 20:14:49.206094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:45.215 20:14:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:45.215 20:14:50 -- common/autotest_common.sh@862 -- # return 0 00:13:45.215 20:14:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:45.215 20:14:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 20:14:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:45.215 20:14:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 [2024-11-20 20:14:50.093560] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:45.215 20:14:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:45.215 20:14:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 20:14:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:45.215 20:14:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 [2024-11-20 20:14:50.110180] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.215 20:14:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:45.215 20:14:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 NULL1 00:13:45.215 20:14:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:45.215 20:14:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 Delay0 00:13:45.215 20:14:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.215 20:14:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.215 20:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:45.215 20:14:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@28 -- # perf_pid=3128464 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:45.215 20:14:50 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:45.215 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.215 [2024-11-20 20:14:50.184524] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:47.112 20:14:52 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:47.112 20:14:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.112 20:14:52 -- common/autotest_common.sh@10 -- # set +x 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 [2024-11-20 20:14:52.305810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f4068000c00 is same with the state(5) to be set 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.370 starting I/O failed: -6 00:13:47.370 Write completed with error (sct=0, sc=8) 00:13:47.370 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 Write completed with error (sct=0, sc=8) 00:13:47.371 Read completed with error (sct=0, sc=8) 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:47.371 starting I/O failed: -6 00:13:48.304 [2024-11-20 20:14:53.284095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bf4960 is same with the state(5) to be set 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Write completed with error (sct=0, sc=8) 00:13:48.304 Read completed with error (sct=0, sc=8) 00:13:48.304 [2024-11-20 20:14:53.306932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f406800c480 is same with the state(5) to be set 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 [2024-11-20 20:14:53.308132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bdba20 is same with the state(5) to be set 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 [2024-11-20 20:14:53.308632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bdb4c0 is same with the state(5) to be set 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Write completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 Read completed with error (sct=0, sc=8) 00:13:48.305 [2024-11-20 20:14:53.309763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f406800bf20 is same with the state(5) to be set 00:13:48.305 [2024-11-20 20:14:53.310197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bf4960 (9): Bad file descriptor 00:13:48.305 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:48.305 20:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.305 20:14:53 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:48.305 20:14:53 -- target/delete_subsystem.sh@35 -- # kill -0 3128464 00:13:48.305 20:14:53 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:48.305 Initializing NVMe Controllers 00:13:48.305 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:48.305 Controller IO queue size 128, less than required. 00:13:48.305 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:48.305 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:48.305 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:48.305 Initialization complete. Launching workers. 00:13:48.305 ======================================================== 00:13:48.305 Latency(us) 00:13:48.305 Device Information : IOPS MiB/s Average min max 00:13:48.305 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 174.16 0.09 931397.92 560.97 1013324.68 00:13:48.305 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 176.64 0.09 881594.74 613.12 1011484.52 00:13:48.305 ======================================================== 00:13:48.305 Total : 350.80 0.17 906320.22 560.97 1013324.68 00:13:48.305 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@35 -- # kill -0 3128464 00:13:48.871 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3128464) - No such process 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@45 -- # NOT wait 3128464 00:13:48.871 20:14:53 -- common/autotest_common.sh@650 -- # local es=0 00:13:48.871 20:14:53 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3128464 00:13:48.871 20:14:53 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:48.871 20:14:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:48.871 20:14:53 -- common/autotest_common.sh@642 -- # type -t wait 00:13:48.871 20:14:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:48.871 20:14:53 -- common/autotest_common.sh@653 -- # wait 3128464 00:13:48.871 20:14:53 -- common/autotest_common.sh@653 -- # es=1 00:13:48.871 20:14:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:48.871 20:14:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:48.871 20:14:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:48.871 20:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.871 20:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:48.871 20:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:48.871 20:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.871 20:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:48.871 [2024-11-20 20:14:53.834008] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.871 20:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.871 20:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.871 20:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:48.871 20:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@54 -- # perf_pid=3128884 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.871 20:14:53 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:48.871 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.871 [2024-11-20 20:14:53.896790] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:49.438 20:14:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.438 20:14:54 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:49.438 20:14:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:50.003 20:14:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.003 20:14:54 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:50.003 20:14:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:50.597 20:14:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.597 20:14:55 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:50.597 20:14:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:50.873 20:14:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.873 20:14:55 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:50.873 20:14:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:51.441 20:14:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:51.441 20:14:56 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:51.441 20:14:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:52.006 20:14:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:52.006 20:14:56 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:52.006 20:14:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:52.265 Initializing NVMe Controllers 00:13:52.265 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:52.265 Controller IO queue size 128, less than required. 00:13:52.265 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:52.265 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:52.265 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:52.265 Initialization complete. Launching workers. 00:13:52.265 ======================================================== 00:13:52.265 Latency(us) 00:13:52.265 Device Information : IOPS MiB/s Average min max 00:13:52.265 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1005284.91 1000287.80 1014288.98 00:13:52.265 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004143.49 1000171.57 1011731.42 00:13:52.265 ======================================================== 00:13:52.265 Total : 256.00 0.12 1004714.20 1000171.57 1014288.98 00:13:52.265 00:13:52.523 20:14:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:52.523 20:14:57 -- target/delete_subsystem.sh@57 -- # kill -0 3128884 00:13:52.523 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3128884) - No such process 00:13:52.523 20:14:57 -- target/delete_subsystem.sh@67 -- # wait 3128884 00:13:52.523 20:14:57 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:52.523 20:14:57 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:52.523 20:14:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:52.523 20:14:57 -- nvmf/common.sh@116 -- # sync 00:13:52.523 20:14:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:52.523 20:14:57 -- nvmf/common.sh@119 -- # set +e 00:13:52.523 20:14:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:52.523 20:14:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:52.523 rmmod nvme_tcp 00:13:52.523 rmmod nvme_fabrics 00:13:52.523 rmmod nvme_keyring 00:13:52.523 20:14:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:52.523 20:14:57 -- nvmf/common.sh@123 -- # set -e 00:13:52.523 20:14:57 -- nvmf/common.sh@124 -- # return 0 00:13:52.523 20:14:57 -- nvmf/common.sh@477 -- # '[' -n 3128308 ']' 00:13:52.523 20:14:57 -- nvmf/common.sh@478 -- # killprocess 3128308 00:13:52.523 20:14:57 -- common/autotest_common.sh@936 -- # '[' -z 3128308 ']' 00:13:52.523 20:14:57 -- common/autotest_common.sh@940 -- # kill -0 3128308 00:13:52.523 20:14:57 -- common/autotest_common.sh@941 -- # uname 00:13:52.523 20:14:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.523 20:14:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3128308 00:13:52.523 20:14:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:52.523 20:14:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:52.523 20:14:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3128308' 00:13:52.523 killing process with pid 3128308 00:13:52.523 20:14:57 -- common/autotest_common.sh@955 -- # kill 3128308 00:13:52.523 20:14:57 -- common/autotest_common.sh@960 -- # wait 3128308 00:13:52.781 20:14:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:52.781 20:14:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:52.781 20:14:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:52.781 20:14:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.781 20:14:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:52.781 20:14:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.781 20:14:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.781 20:14:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.314 20:14:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:55.314 00:13:55.314 real 0m13.170s 00:13:55.314 user 0m29.679s 00:13:55.314 sys 0m2.884s 00:13:55.314 20:14:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:55.314 20:14:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.314 ************************************ 00:13:55.314 END TEST nvmf_delete_subsystem 00:13:55.314 ************************************ 00:13:55.314 20:14:59 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:55.314 20:14:59 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:55.314 20:14:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:55.314 20:14:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:55.314 20:14:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.314 ************************************ 00:13:55.314 START TEST nvmf_nvme_cli 00:13:55.314 ************************************ 00:13:55.314 20:14:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:55.314 * Looking for test storage... 00:13:55.314 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:55.314 20:14:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:55.314 20:14:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:55.314 20:14:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:55.314 20:14:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:55.314 20:14:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:55.314 20:14:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:55.314 20:14:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:55.314 20:14:59 -- scripts/common.sh@335 -- # IFS=.-: 00:13:55.314 20:14:59 -- scripts/common.sh@335 -- # read -ra ver1 00:13:55.314 20:14:59 -- scripts/common.sh@336 -- # IFS=.-: 00:13:55.314 20:14:59 -- scripts/common.sh@336 -- # read -ra ver2 00:13:55.314 20:14:59 -- scripts/common.sh@337 -- # local 'op=<' 00:13:55.314 20:14:59 -- scripts/common.sh@339 -- # ver1_l=2 00:13:55.314 20:14:59 -- scripts/common.sh@340 -- # ver2_l=1 00:13:55.314 20:14:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:55.314 20:14:59 -- scripts/common.sh@343 -- # case "$op" in 00:13:55.314 20:14:59 -- scripts/common.sh@344 -- # : 1 00:13:55.314 20:14:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:55.314 20:14:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:55.314 20:14:59 -- scripts/common.sh@364 -- # decimal 1 00:13:55.314 20:14:59 -- scripts/common.sh@352 -- # local d=1 00:13:55.314 20:14:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:55.314 20:14:59 -- scripts/common.sh@354 -- # echo 1 00:13:55.314 20:14:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:55.315 20:14:59 -- scripts/common.sh@365 -- # decimal 2 00:13:55.315 20:14:59 -- scripts/common.sh@352 -- # local d=2 00:13:55.315 20:14:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:55.315 20:14:59 -- scripts/common.sh@354 -- # echo 2 00:13:55.315 20:14:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:55.315 20:14:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:55.315 20:14:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:55.315 20:14:59 -- scripts/common.sh@367 -- # return 0 00:13:55.315 20:14:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:55.315 20:14:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:55.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.315 --rc genhtml_branch_coverage=1 00:13:55.315 --rc genhtml_function_coverage=1 00:13:55.315 --rc genhtml_legend=1 00:13:55.315 --rc geninfo_all_blocks=1 00:13:55.315 --rc geninfo_unexecuted_blocks=1 00:13:55.315 00:13:55.315 ' 00:13:55.315 20:14:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:55.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.315 --rc genhtml_branch_coverage=1 00:13:55.315 --rc genhtml_function_coverage=1 00:13:55.315 --rc genhtml_legend=1 00:13:55.315 --rc geninfo_all_blocks=1 00:13:55.315 --rc geninfo_unexecuted_blocks=1 00:13:55.315 00:13:55.315 ' 00:13:55.315 20:14:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:55.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.315 --rc genhtml_branch_coverage=1 00:13:55.315 --rc genhtml_function_coverage=1 00:13:55.315 --rc genhtml_legend=1 00:13:55.315 --rc geninfo_all_blocks=1 00:13:55.315 --rc geninfo_unexecuted_blocks=1 00:13:55.315 00:13:55.315 ' 00:13:55.315 20:14:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:55.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.315 --rc genhtml_branch_coverage=1 00:13:55.315 --rc genhtml_function_coverage=1 00:13:55.315 --rc genhtml_legend=1 00:13:55.315 --rc geninfo_all_blocks=1 00:13:55.315 --rc geninfo_unexecuted_blocks=1 00:13:55.315 00:13:55.315 ' 00:13:55.315 20:14:59 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:55.315 20:14:59 -- nvmf/common.sh@7 -- # uname -s 00:13:55.315 20:14:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:55.315 20:14:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:55.315 20:14:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:55.315 20:14:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:55.315 20:14:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:55.315 20:14:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:55.315 20:14:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:55.315 20:14:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:55.315 20:14:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:55.315 20:14:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:55.315 20:14:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.315 20:14:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.315 20:14:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:55.315 20:14:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:55.315 20:14:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:55.315 20:14:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:55.315 20:14:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:55.315 20:14:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:55.315 20:14:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:55.315 20:14:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.315 20:14:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.315 20:14:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.315 20:14:59 -- paths/export.sh@5 -- # export PATH 00:13:55.315 20:14:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.315 20:14:59 -- nvmf/common.sh@46 -- # : 0 00:13:55.315 20:14:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:55.315 20:14:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:55.315 20:14:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:55.315 20:14:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:55.315 20:14:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:55.315 20:14:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:55.315 20:14:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:55.315 20:14:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:55.315 20:14:59 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:55.315 20:14:59 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:55.315 20:14:59 -- target/nvme_cli.sh@14 -- # devs=() 00:13:55.315 20:14:59 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:55.315 20:14:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:55.315 20:14:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:55.315 20:14:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:55.315 20:14:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:55.315 20:14:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:55.315 20:14:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:55.315 20:14:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:55.315 20:14:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.315 20:14:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:55.315 20:14:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:55.315 20:14:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:55.315 20:14:59 -- common/autotest_common.sh@10 -- # set +x 00:13:57.216 20:15:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:57.216 20:15:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:57.216 20:15:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:57.216 20:15:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:57.216 20:15:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:57.216 20:15:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:57.216 20:15:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:57.216 20:15:01 -- nvmf/common.sh@294 -- # net_devs=() 00:13:57.216 20:15:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:57.216 20:15:01 -- nvmf/common.sh@295 -- # e810=() 00:13:57.216 20:15:01 -- nvmf/common.sh@295 -- # local -ga e810 00:13:57.216 20:15:01 -- nvmf/common.sh@296 -- # x722=() 00:13:57.216 20:15:01 -- nvmf/common.sh@296 -- # local -ga x722 00:13:57.216 20:15:01 -- nvmf/common.sh@297 -- # mlx=() 00:13:57.216 20:15:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:57.216 20:15:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:57.216 20:15:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:57.216 20:15:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:57.216 20:15:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:57.216 20:15:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.216 20:15:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:57.216 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:57.216 20:15:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.216 20:15:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:57.216 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:57.216 20:15:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:57.216 20:15:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:57.216 20:15:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.216 20:15:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.217 20:15:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.217 20:15:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.217 20:15:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:57.217 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:57.217 20:15:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.217 20:15:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.217 20:15:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.217 20:15:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.217 20:15:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.217 20:15:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:57.217 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:57.217 20:15:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.217 20:15:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:57.217 20:15:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:57.217 20:15:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:57.217 20:15:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:57.217 20:15:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:57.217 20:15:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:57.217 20:15:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:57.217 20:15:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:57.217 20:15:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:57.217 20:15:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:57.217 20:15:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:57.217 20:15:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:57.217 20:15:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:57.217 20:15:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:57.217 20:15:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:57.217 20:15:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:57.217 20:15:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:57.217 20:15:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:57.217 20:15:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:57.217 20:15:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:57.217 20:15:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:57.217 20:15:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:57.217 20:15:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:57.217 20:15:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:57.217 20:15:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:57.217 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:57.217 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.289 ms 00:13:57.217 00:13:57.217 --- 10.0.0.2 ping statistics --- 00:13:57.217 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.217 rtt min/avg/max/mdev = 0.289/0.289/0.289/0.000 ms 00:13:57.217 20:15:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:57.217 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:57.217 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:13:57.217 00:13:57.217 --- 10.0.0.1 ping statistics --- 00:13:57.217 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.217 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:13:57.217 20:15:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:57.217 20:15:02 -- nvmf/common.sh@410 -- # return 0 00:13:57.217 20:15:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:57.217 20:15:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:57.217 20:15:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:57.217 20:15:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:57.217 20:15:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:57.217 20:15:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:57.217 20:15:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:57.217 20:15:02 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:57.217 20:15:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:57.217 20:15:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:57.217 20:15:02 -- common/autotest_common.sh@10 -- # set +x 00:13:57.217 20:15:02 -- nvmf/common.sh@469 -- # nvmfpid=3131486 00:13:57.217 20:15:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:57.217 20:15:02 -- nvmf/common.sh@470 -- # waitforlisten 3131486 00:13:57.217 20:15:02 -- common/autotest_common.sh@829 -- # '[' -z 3131486 ']' 00:13:57.217 20:15:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.217 20:15:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:57.217 20:15:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.217 20:15:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:57.217 20:15:02 -- common/autotest_common.sh@10 -- # set +x 00:13:57.217 [2024-11-20 20:15:02.171448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:57.217 [2024-11-20 20:15:02.171517] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:57.217 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.217 [2024-11-20 20:15:02.234849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:57.475 [2024-11-20 20:15:02.347089] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:57.475 [2024-11-20 20:15:02.347265] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.475 [2024-11-20 20:15:02.347286] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.475 [2024-11-20 20:15:02.347301] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.475 [2024-11-20 20:15:02.347390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:57.475 [2024-11-20 20:15:02.347459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:57.475 [2024-11-20 20:15:02.347553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:57.475 [2024-11-20 20:15:02.347555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:58.408 20:15:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.408 20:15:03 -- common/autotest_common.sh@862 -- # return 0 00:13:58.408 20:15:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.408 20:15:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 20:15:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.408 20:15:03 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 [2024-11-20 20:15:03.212822] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 Malloc0 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 Malloc1 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 [2024-11-20 20:15:03.299663] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:58.408 20:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.408 20:15:03 -- common/autotest_common.sh@10 -- # set +x 00:13:58.408 20:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.408 20:15:03 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:58.666 00:13:58.666 Discovery Log Number of Records 2, Generation counter 2 00:13:58.666 =====Discovery Log Entry 0====== 00:13:58.666 trtype: tcp 00:13:58.666 adrfam: ipv4 00:13:58.666 subtype: current discovery subsystem 00:13:58.666 treq: not required 00:13:58.666 portid: 0 00:13:58.666 trsvcid: 4420 00:13:58.666 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:58.666 traddr: 10.0.0.2 00:13:58.666 eflags: explicit discovery connections, duplicate discovery information 00:13:58.666 sectype: none 00:13:58.666 =====Discovery Log Entry 1====== 00:13:58.666 trtype: tcp 00:13:58.666 adrfam: ipv4 00:13:58.666 subtype: nvme subsystem 00:13:58.666 treq: not required 00:13:58.666 portid: 0 00:13:58.666 trsvcid: 4420 00:13:58.666 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:58.666 traddr: 10.0.0.2 00:13:58.666 eflags: none 00:13:58.666 sectype: none 00:13:58.666 20:15:03 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:58.666 20:15:03 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:58.666 20:15:03 -- nvmf/common.sh@510 -- # local dev _ 00:13:58.666 20:15:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.666 20:15:03 -- nvmf/common.sh@509 -- # nvme list 00:13:58.666 20:15:03 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:58.666 20:15:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.666 20:15:03 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:58.666 20:15:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.666 20:15:03 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:58.666 20:15:03 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:59.231 20:15:04 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:59.231 20:15:04 -- common/autotest_common.sh@1187 -- # local i=0 00:13:59.231 20:15:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:59.231 20:15:04 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:59.231 20:15:04 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:59.231 20:15:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:01.130 20:15:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:01.130 20:15:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:01.130 20:15:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:01.130 20:15:06 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:01.130 20:15:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:01.130 20:15:06 -- common/autotest_common.sh@1197 -- # return 0 00:14:01.130 20:15:06 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:01.130 20:15:06 -- nvmf/common.sh@510 -- # local dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@509 -- # nvme list 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:01.130 /dev/nvme0n2 ]] 00:14:01.130 20:15:06 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:01.130 20:15:06 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:01.130 20:15:06 -- nvmf/common.sh@510 -- # local dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@509 -- # nvme list 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:01.130 20:15:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:01.130 20:15:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:01.130 20:15:06 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:01.130 20:15:06 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:01.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:01.389 20:15:06 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:01.389 20:15:06 -- common/autotest_common.sh@1208 -- # local i=0 00:14:01.389 20:15:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:01.389 20:15:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:01.389 20:15:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:01.389 20:15:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:01.389 20:15:06 -- common/autotest_common.sh@1220 -- # return 0 00:14:01.389 20:15:06 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:01.389 20:15:06 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:01.389 20:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.389 20:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:01.389 20:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.389 20:15:06 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:01.389 20:15:06 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:01.389 20:15:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:01.389 20:15:06 -- nvmf/common.sh@116 -- # sync 00:14:01.389 20:15:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:01.389 20:15:06 -- nvmf/common.sh@119 -- # set +e 00:14:01.389 20:15:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:01.389 20:15:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:01.389 rmmod nvme_tcp 00:14:01.389 rmmod nvme_fabrics 00:14:01.389 rmmod nvme_keyring 00:14:01.389 20:15:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:01.389 20:15:06 -- nvmf/common.sh@123 -- # set -e 00:14:01.389 20:15:06 -- nvmf/common.sh@124 -- # return 0 00:14:01.389 20:15:06 -- nvmf/common.sh@477 -- # '[' -n 3131486 ']' 00:14:01.389 20:15:06 -- nvmf/common.sh@478 -- # killprocess 3131486 00:14:01.389 20:15:06 -- common/autotest_common.sh@936 -- # '[' -z 3131486 ']' 00:14:01.389 20:15:06 -- common/autotest_common.sh@940 -- # kill -0 3131486 00:14:01.389 20:15:06 -- common/autotest_common.sh@941 -- # uname 00:14:01.389 20:15:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:01.389 20:15:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3131486 00:14:01.389 20:15:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:01.389 20:15:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:01.389 20:15:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3131486' 00:14:01.389 killing process with pid 3131486 00:14:01.389 20:15:06 -- common/autotest_common.sh@955 -- # kill 3131486 00:14:01.389 20:15:06 -- common/autotest_common.sh@960 -- # wait 3131486 00:14:01.648 20:15:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:01.648 20:15:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:01.648 20:15:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:01.649 20:15:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:01.649 20:15:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:01.649 20:15:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.649 20:15:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.649 20:15:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:04.184 20:15:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:04.184 00:14:04.184 real 0m8.858s 00:14:04.184 user 0m17.664s 00:14:04.184 sys 0m2.222s 00:14:04.184 20:15:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:04.184 20:15:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.184 ************************************ 00:14:04.184 END TEST nvmf_nvme_cli 00:14:04.184 ************************************ 00:14:04.184 20:15:08 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:04.184 20:15:08 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:04.184 20:15:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:04.184 20:15:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:04.184 20:15:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.184 ************************************ 00:14:04.184 START TEST nvmf_host_management 00:14:04.184 ************************************ 00:14:04.184 20:15:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:04.184 * Looking for test storage... 00:14:04.184 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:04.184 20:15:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:04.184 20:15:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:04.184 20:15:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:04.184 20:15:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:04.184 20:15:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:04.184 20:15:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:04.184 20:15:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:04.184 20:15:08 -- scripts/common.sh@335 -- # IFS=.-: 00:14:04.184 20:15:08 -- scripts/common.sh@335 -- # read -ra ver1 00:14:04.184 20:15:08 -- scripts/common.sh@336 -- # IFS=.-: 00:14:04.184 20:15:08 -- scripts/common.sh@336 -- # read -ra ver2 00:14:04.184 20:15:08 -- scripts/common.sh@337 -- # local 'op=<' 00:14:04.184 20:15:08 -- scripts/common.sh@339 -- # ver1_l=2 00:14:04.184 20:15:08 -- scripts/common.sh@340 -- # ver2_l=1 00:14:04.184 20:15:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:04.184 20:15:08 -- scripts/common.sh@343 -- # case "$op" in 00:14:04.184 20:15:08 -- scripts/common.sh@344 -- # : 1 00:14:04.184 20:15:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:04.184 20:15:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:04.184 20:15:08 -- scripts/common.sh@364 -- # decimal 1 00:14:04.184 20:15:08 -- scripts/common.sh@352 -- # local d=1 00:14:04.184 20:15:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:04.184 20:15:08 -- scripts/common.sh@354 -- # echo 1 00:14:04.184 20:15:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:04.184 20:15:08 -- scripts/common.sh@365 -- # decimal 2 00:14:04.184 20:15:08 -- scripts/common.sh@352 -- # local d=2 00:14:04.184 20:15:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:04.184 20:15:08 -- scripts/common.sh@354 -- # echo 2 00:14:04.184 20:15:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:04.184 20:15:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:04.184 20:15:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:04.184 20:15:08 -- scripts/common.sh@367 -- # return 0 00:14:04.184 20:15:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:04.184 20:15:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:04.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.184 --rc genhtml_branch_coverage=1 00:14:04.184 --rc genhtml_function_coverage=1 00:14:04.184 --rc genhtml_legend=1 00:14:04.184 --rc geninfo_all_blocks=1 00:14:04.184 --rc geninfo_unexecuted_blocks=1 00:14:04.184 00:14:04.184 ' 00:14:04.184 20:15:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:04.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.184 --rc genhtml_branch_coverage=1 00:14:04.184 --rc genhtml_function_coverage=1 00:14:04.184 --rc genhtml_legend=1 00:14:04.184 --rc geninfo_all_blocks=1 00:14:04.184 --rc geninfo_unexecuted_blocks=1 00:14:04.184 00:14:04.184 ' 00:14:04.184 20:15:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:04.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.184 --rc genhtml_branch_coverage=1 00:14:04.184 --rc genhtml_function_coverage=1 00:14:04.184 --rc genhtml_legend=1 00:14:04.184 --rc geninfo_all_blocks=1 00:14:04.184 --rc geninfo_unexecuted_blocks=1 00:14:04.184 00:14:04.184 ' 00:14:04.184 20:15:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:04.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:04.184 --rc genhtml_branch_coverage=1 00:14:04.184 --rc genhtml_function_coverage=1 00:14:04.184 --rc genhtml_legend=1 00:14:04.184 --rc geninfo_all_blocks=1 00:14:04.184 --rc geninfo_unexecuted_blocks=1 00:14:04.184 00:14:04.184 ' 00:14:04.185 20:15:08 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:04.185 20:15:08 -- nvmf/common.sh@7 -- # uname -s 00:14:04.185 20:15:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:04.185 20:15:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:04.185 20:15:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:04.185 20:15:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:04.185 20:15:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:04.185 20:15:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:04.185 20:15:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:04.185 20:15:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:04.185 20:15:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:04.185 20:15:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:04.185 20:15:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:04.185 20:15:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:04.185 20:15:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:04.185 20:15:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:04.185 20:15:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:04.185 20:15:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:04.185 20:15:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:04.185 20:15:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:04.185 20:15:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:04.185 20:15:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.185 20:15:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.185 20:15:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.185 20:15:08 -- paths/export.sh@5 -- # export PATH 00:14:04.185 20:15:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:04.185 20:15:08 -- nvmf/common.sh@46 -- # : 0 00:14:04.185 20:15:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:04.185 20:15:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:04.185 20:15:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:04.185 20:15:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:04.185 20:15:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:04.185 20:15:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:04.185 20:15:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:04.185 20:15:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:04.185 20:15:08 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:04.185 20:15:08 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:04.185 20:15:08 -- target/host_management.sh@104 -- # nvmftestinit 00:14:04.185 20:15:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:04.185 20:15:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:04.185 20:15:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:04.185 20:15:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:04.185 20:15:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:04.185 20:15:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:04.185 20:15:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:04.185 20:15:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:04.185 20:15:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:04.185 20:15:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:04.185 20:15:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:04.185 20:15:08 -- common/autotest_common.sh@10 -- # set +x 00:14:06.125 20:15:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:06.125 20:15:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:06.125 20:15:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:06.125 20:15:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:06.126 20:15:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:06.126 20:15:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:06.126 20:15:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:06.126 20:15:10 -- nvmf/common.sh@294 -- # net_devs=() 00:14:06.126 20:15:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:06.126 20:15:10 -- nvmf/common.sh@295 -- # e810=() 00:14:06.126 20:15:10 -- nvmf/common.sh@295 -- # local -ga e810 00:14:06.126 20:15:10 -- nvmf/common.sh@296 -- # x722=() 00:14:06.126 20:15:10 -- nvmf/common.sh@296 -- # local -ga x722 00:14:06.126 20:15:10 -- nvmf/common.sh@297 -- # mlx=() 00:14:06.126 20:15:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:06.126 20:15:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:06.126 20:15:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:06.126 20:15:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:06.126 20:15:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:06.126 20:15:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.126 20:15:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:06.126 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:06.126 20:15:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.126 20:15:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:06.126 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:06.126 20:15:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:06.126 20:15:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.126 20:15:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.126 20:15:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.126 20:15:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.126 20:15:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:06.126 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:06.126 20:15:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.126 20:15:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.126 20:15:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.126 20:15:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.126 20:15:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.126 20:15:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:06.126 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:06.126 20:15:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.126 20:15:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:06.126 20:15:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:06.126 20:15:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:06.126 20:15:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:06.126 20:15:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:06.126 20:15:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:06.126 20:15:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:06.126 20:15:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:06.126 20:15:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:06.126 20:15:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:06.126 20:15:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:06.126 20:15:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:06.126 20:15:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:06.126 20:15:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:06.126 20:15:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:06.126 20:15:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:06.126 20:15:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:06.126 20:15:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:06.126 20:15:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:06.126 20:15:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:06.126 20:15:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:06.126 20:15:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:06.126 20:15:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:06.126 20:15:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:06.126 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:06.126 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:14:06.126 00:14:06.126 --- 10.0.0.2 ping statistics --- 00:14:06.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.126 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:14:06.126 20:15:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:06.126 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:06.126 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:14:06.126 00:14:06.126 --- 10.0.0.1 ping statistics --- 00:14:06.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.126 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:14:06.126 20:15:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:06.126 20:15:11 -- nvmf/common.sh@410 -- # return 0 00:14:06.126 20:15:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:06.126 20:15:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:06.126 20:15:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:06.126 20:15:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:06.126 20:15:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:06.126 20:15:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:06.126 20:15:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:06.126 20:15:11 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:06.126 20:15:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:06.126 20:15:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:06.126 20:15:11 -- common/autotest_common.sh@10 -- # set +x 00:14:06.126 ************************************ 00:14:06.126 START TEST nvmf_host_management 00:14:06.126 ************************************ 00:14:06.126 20:15:11 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:06.126 20:15:11 -- target/host_management.sh@69 -- # starttarget 00:14:06.126 20:15:11 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:06.126 20:15:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:06.126 20:15:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:06.126 20:15:11 -- common/autotest_common.sh@10 -- # set +x 00:14:06.126 20:15:11 -- nvmf/common.sh@469 -- # nvmfpid=3134536 00:14:06.126 20:15:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:06.126 20:15:11 -- nvmf/common.sh@470 -- # waitforlisten 3134536 00:14:06.126 20:15:11 -- common/autotest_common.sh@829 -- # '[' -z 3134536 ']' 00:14:06.126 20:15:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:06.126 20:15:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:06.127 20:15:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:06.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:06.127 20:15:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:06.127 20:15:11 -- common/autotest_common.sh@10 -- # set +x 00:14:06.385 [2024-11-20 20:15:11.183810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:06.385 [2024-11-20 20:15:11.183885] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:06.385 EAL: No free 2048 kB hugepages reported on node 1 00:14:06.385 [2024-11-20 20:15:11.255318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:06.385 [2024-11-20 20:15:11.364240] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:06.385 [2024-11-20 20:15:11.364391] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:06.385 [2024-11-20 20:15:11.364407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:06.385 [2024-11-20 20:15:11.364420] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:06.385 [2024-11-20 20:15:11.364504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:06.385 [2024-11-20 20:15:11.364561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:06.385 [2024-11-20 20:15:11.364627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:06.385 [2024-11-20 20:15:11.364630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:07.320 20:15:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:07.320 20:15:12 -- common/autotest_common.sh@862 -- # return 0 00:14:07.320 20:15:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:07.320 20:15:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:07.320 20:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:07.320 20:15:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:07.320 20:15:12 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:07.320 20:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.320 20:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:07.320 [2024-11-20 20:15:12.183614] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:07.320 20:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.320 20:15:12 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:07.320 20:15:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:07.320 20:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:07.320 20:15:12 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:07.320 20:15:12 -- target/host_management.sh@23 -- # cat 00:14:07.320 20:15:12 -- target/host_management.sh@30 -- # rpc_cmd 00:14:07.320 20:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.320 20:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:07.320 Malloc0 00:14:07.320 [2024-11-20 20:15:12.242702] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:07.320 20:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.320 20:15:12 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:07.320 20:15:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:07.320 20:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:07.320 20:15:12 -- target/host_management.sh@73 -- # perfpid=3134715 00:14:07.320 20:15:12 -- target/host_management.sh@74 -- # waitforlisten 3134715 /var/tmp/bdevperf.sock 00:14:07.320 20:15:12 -- common/autotest_common.sh@829 -- # '[' -z 3134715 ']' 00:14:07.320 20:15:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:07.320 20:15:12 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:07.320 20:15:12 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:07.320 20:15:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:07.320 20:15:12 -- nvmf/common.sh@520 -- # config=() 00:14:07.320 20:15:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:07.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:07.320 20:15:12 -- nvmf/common.sh@520 -- # local subsystem config 00:14:07.320 20:15:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:07.320 20:15:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:07.320 20:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:07.320 20:15:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:07.320 { 00:14:07.320 "params": { 00:14:07.320 "name": "Nvme$subsystem", 00:14:07.320 "trtype": "$TEST_TRANSPORT", 00:14:07.320 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:07.320 "adrfam": "ipv4", 00:14:07.320 "trsvcid": "$NVMF_PORT", 00:14:07.320 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:07.320 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:07.320 "hdgst": ${hdgst:-false}, 00:14:07.320 "ddgst": ${ddgst:-false} 00:14:07.320 }, 00:14:07.320 "method": "bdev_nvme_attach_controller" 00:14:07.320 } 00:14:07.320 EOF 00:14:07.320 )") 00:14:07.320 20:15:12 -- nvmf/common.sh@542 -- # cat 00:14:07.320 20:15:12 -- nvmf/common.sh@544 -- # jq . 00:14:07.320 20:15:12 -- nvmf/common.sh@545 -- # IFS=, 00:14:07.320 20:15:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:07.320 "params": { 00:14:07.321 "name": "Nvme0", 00:14:07.321 "trtype": "tcp", 00:14:07.321 "traddr": "10.0.0.2", 00:14:07.321 "adrfam": "ipv4", 00:14:07.321 "trsvcid": "4420", 00:14:07.321 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:07.321 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:07.321 "hdgst": false, 00:14:07.321 "ddgst": false 00:14:07.321 }, 00:14:07.321 "method": "bdev_nvme_attach_controller" 00:14:07.321 }' 00:14:07.321 [2024-11-20 20:15:12.317777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:07.321 [2024-11-20 20:15:12.317863] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3134715 ] 00:14:07.321 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.580 [2024-11-20 20:15:12.378306] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:07.580 [2024-11-20 20:15:12.486848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:07.838 Running I/O for 10 seconds... 00:14:08.407 20:15:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:08.407 20:15:13 -- common/autotest_common.sh@862 -- # return 0 00:14:08.407 20:15:13 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:08.407 20:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.407 20:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:08.407 20:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.407 20:15:13 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:08.407 20:15:13 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:08.407 20:15:13 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:08.407 20:15:13 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:08.407 20:15:13 -- target/host_management.sh@52 -- # local ret=1 00:14:08.407 20:15:13 -- target/host_management.sh@53 -- # local i 00:14:08.407 20:15:13 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:08.407 20:15:13 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:08.407 20:15:13 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:08.407 20:15:13 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:08.407 20:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.407 20:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:08.407 20:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.407 20:15:13 -- target/host_management.sh@55 -- # read_io_count=2145 00:14:08.407 20:15:13 -- target/host_management.sh@58 -- # '[' 2145 -ge 100 ']' 00:14:08.407 20:15:13 -- target/host_management.sh@59 -- # ret=0 00:14:08.407 20:15:13 -- target/host_management.sh@60 -- # break 00:14:08.407 20:15:13 -- target/host_management.sh@64 -- # return 0 00:14:08.407 20:15:13 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:08.407 20:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.407 20:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:08.407 [2024-11-20 20:15:13.371041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.407 [2024-11-20 20:15:13.371151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.407 [2024-11-20 20:15:13.371178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.407 [2024-11-20 20:15:13.371190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1589e60 is same with the state(5) to be set 00:14:08.408 [2024-11-20 20:15:13.371827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.371866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.371893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.371914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.371931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.371945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.371960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.371973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.371988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.408 [2024-11-20 20:15:13.372434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.408 [2024-11-20 20:15:13.372447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.372986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.372999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.409 [2024-11-20 20:15:13.373633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.409 [2024-11-20 20:15:13.373647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.410 [2024-11-20 20:15:13.373661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.410 [2024-11-20 20:15:13.373674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.410 [2024-11-20 20:15:13.373688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.410 [2024-11-20 20:15:13.373701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.410 [2024-11-20 20:15:13.373715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.410 [2024-11-20 20:15:13.373728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.410 [2024-11-20 20:15:13.373742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.410 [2024-11-20 20:15:13.373755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.410 [2024-11-20 20:15:13.373770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:08.410 [2024-11-20 20:15:13.373784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:08.410 [2024-11-20 20:15:13.373871] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12a0030 was disconnected and freed. reset controller. 00:14:08.410 20:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.410 [2024-11-20 20:15:13.375079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:08.410 20:15:13 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:08.410 20:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.410 20:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:08.410 task offset: 25856 on job bdev=Nvme0n1 fails 00:14:08.410 00:14:08.410 Latency(us) 00:14:08.410 [2024-11-20T19:15:13.449Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:08.410 [2024-11-20T19:15:13.449Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:08.410 [2024-11-20T19:15:13.449Z] Job: Nvme0n1 ended in about 0.59 seconds with error 00:14:08.410 Verification LBA range: start 0x0 length 0x400 00:14:08.410 Nvme0n1 : 0.59 3884.53 242.78 109.18 0.00 15773.58 2475.80 22816.24 00:14:08.410 [2024-11-20T19:15:13.449Z] =================================================================================================================== 00:14:08.410 [2024-11-20T19:15:13.449Z] Total : 3884.53 242.78 109.18 0.00 15773.58 2475.80 22816.24 00:14:08.410 [2024-11-20 20:15:13.376995] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:08.410 [2024-11-20 20:15:13.377036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12a2160 (9): Bad file descriptor 00:14:08.410 20:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.410 20:15:13 -- target/host_management.sh@87 -- # sleep 1 00:14:08.410 [2024-11-20 20:15:13.429421] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:09.349 20:15:14 -- target/host_management.sh@91 -- # kill -9 3134715 00:14:09.349 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3134715) - No such process 00:14:09.349 20:15:14 -- target/host_management.sh@91 -- # true 00:14:09.349 20:15:14 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:09.608 20:15:14 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:09.608 20:15:14 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:09.608 20:15:14 -- nvmf/common.sh@520 -- # config=() 00:14:09.608 20:15:14 -- nvmf/common.sh@520 -- # local subsystem config 00:14:09.608 20:15:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:09.608 20:15:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:09.608 { 00:14:09.608 "params": { 00:14:09.608 "name": "Nvme$subsystem", 00:14:09.608 "trtype": "$TEST_TRANSPORT", 00:14:09.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:09.608 "adrfam": "ipv4", 00:14:09.608 "trsvcid": "$NVMF_PORT", 00:14:09.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:09.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:09.608 "hdgst": ${hdgst:-false}, 00:14:09.608 "ddgst": ${ddgst:-false} 00:14:09.608 }, 00:14:09.608 "method": "bdev_nvme_attach_controller" 00:14:09.608 } 00:14:09.608 EOF 00:14:09.608 )") 00:14:09.608 20:15:14 -- nvmf/common.sh@542 -- # cat 00:14:09.608 20:15:14 -- nvmf/common.sh@544 -- # jq . 00:14:09.608 20:15:14 -- nvmf/common.sh@545 -- # IFS=, 00:14:09.608 20:15:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:09.608 "params": { 00:14:09.608 "name": "Nvme0", 00:14:09.608 "trtype": "tcp", 00:14:09.608 "traddr": "10.0.0.2", 00:14:09.608 "adrfam": "ipv4", 00:14:09.608 "trsvcid": "4420", 00:14:09.608 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:09.608 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:09.608 "hdgst": false, 00:14:09.608 "ddgst": false 00:14:09.608 }, 00:14:09.608 "method": "bdev_nvme_attach_controller" 00:14:09.608 }' 00:14:09.608 [2024-11-20 20:15:14.427104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:09.608 [2024-11-20 20:15:14.427180] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3134981 ] 00:14:09.608 EAL: No free 2048 kB hugepages reported on node 1 00:14:09.608 [2024-11-20 20:15:14.487147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:09.608 [2024-11-20 20:15:14.597578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:09.867 Running I/O for 1 seconds... 00:14:10.808 00:14:10.808 Latency(us) 00:14:10.808 [2024-11-20T19:15:15.847Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:10.808 [2024-11-20T19:15:15.847Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:10.808 Verification LBA range: start 0x0 length 0x400 00:14:10.808 Nvme0n1 : 1.05 3635.64 227.23 0.00 0.00 16657.55 3203.98 44273.21 00:14:10.808 [2024-11-20T19:15:15.847Z] =================================================================================================================== 00:14:10.808 [2024-11-20T19:15:15.847Z] Total : 3635.64 227.23 0.00 0.00 16657.55 3203.98 44273.21 00:14:11.067 20:15:16 -- target/host_management.sh@101 -- # stoptarget 00:14:11.067 20:15:16 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:11.067 20:15:16 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:11.325 20:15:16 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:11.325 20:15:16 -- target/host_management.sh@40 -- # nvmftestfini 00:14:11.325 20:15:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:11.325 20:15:16 -- nvmf/common.sh@116 -- # sync 00:14:11.325 20:15:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:11.325 20:15:16 -- nvmf/common.sh@119 -- # set +e 00:14:11.325 20:15:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:11.325 20:15:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:11.325 rmmod nvme_tcp 00:14:11.325 rmmod nvme_fabrics 00:14:11.325 rmmod nvme_keyring 00:14:11.325 20:15:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:11.325 20:15:16 -- nvmf/common.sh@123 -- # set -e 00:14:11.325 20:15:16 -- nvmf/common.sh@124 -- # return 0 00:14:11.325 20:15:16 -- nvmf/common.sh@477 -- # '[' -n 3134536 ']' 00:14:11.325 20:15:16 -- nvmf/common.sh@478 -- # killprocess 3134536 00:14:11.325 20:15:16 -- common/autotest_common.sh@936 -- # '[' -z 3134536 ']' 00:14:11.325 20:15:16 -- common/autotest_common.sh@940 -- # kill -0 3134536 00:14:11.325 20:15:16 -- common/autotest_common.sh@941 -- # uname 00:14:11.325 20:15:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:11.325 20:15:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3134536 00:14:11.325 20:15:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:11.325 20:15:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:11.325 20:15:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3134536' 00:14:11.325 killing process with pid 3134536 00:14:11.325 20:15:16 -- common/autotest_common.sh@955 -- # kill 3134536 00:14:11.325 20:15:16 -- common/autotest_common.sh@960 -- # wait 3134536 00:14:11.584 [2024-11-20 20:15:16.448471] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:11.584 20:15:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:11.584 20:15:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:11.584 20:15:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:11.584 20:15:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:11.584 20:15:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:11.584 20:15:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:11.584 20:15:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:11.584 20:15:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:13.490 20:15:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:13.490 00:14:13.490 real 0m7.388s 00:14:13.490 user 0m22.643s 00:14:13.490 sys 0m1.604s 00:14:13.490 20:15:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:13.490 20:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:13.490 ************************************ 00:14:13.490 END TEST nvmf_host_management 00:14:13.490 ************************************ 00:14:13.749 20:15:18 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:13.749 00:14:13.749 real 0m9.859s 00:14:13.749 user 0m23.515s 00:14:13.749 sys 0m3.144s 00:14:13.749 20:15:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:13.749 20:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:13.749 ************************************ 00:14:13.749 END TEST nvmf_host_management 00:14:13.749 ************************************ 00:14:13.749 20:15:18 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:13.749 20:15:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:13.749 20:15:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:13.749 20:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:13.749 ************************************ 00:14:13.749 START TEST nvmf_lvol 00:14:13.749 ************************************ 00:14:13.749 20:15:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:13.749 * Looking for test storage... 00:14:13.749 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:13.749 20:15:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:13.749 20:15:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:13.749 20:15:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:13.749 20:15:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:13.749 20:15:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:13.749 20:15:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:13.749 20:15:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:13.749 20:15:18 -- scripts/common.sh@335 -- # IFS=.-: 00:14:13.749 20:15:18 -- scripts/common.sh@335 -- # read -ra ver1 00:14:13.749 20:15:18 -- scripts/common.sh@336 -- # IFS=.-: 00:14:13.749 20:15:18 -- scripts/common.sh@336 -- # read -ra ver2 00:14:13.749 20:15:18 -- scripts/common.sh@337 -- # local 'op=<' 00:14:13.749 20:15:18 -- scripts/common.sh@339 -- # ver1_l=2 00:14:13.749 20:15:18 -- scripts/common.sh@340 -- # ver2_l=1 00:14:13.749 20:15:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:13.749 20:15:18 -- scripts/common.sh@343 -- # case "$op" in 00:14:13.749 20:15:18 -- scripts/common.sh@344 -- # : 1 00:14:13.749 20:15:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:13.749 20:15:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:13.749 20:15:18 -- scripts/common.sh@364 -- # decimal 1 00:14:13.749 20:15:18 -- scripts/common.sh@352 -- # local d=1 00:14:13.749 20:15:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:13.749 20:15:18 -- scripts/common.sh@354 -- # echo 1 00:14:13.749 20:15:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:13.749 20:15:18 -- scripts/common.sh@365 -- # decimal 2 00:14:13.749 20:15:18 -- scripts/common.sh@352 -- # local d=2 00:14:13.749 20:15:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:13.749 20:15:18 -- scripts/common.sh@354 -- # echo 2 00:14:13.749 20:15:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:13.749 20:15:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:13.749 20:15:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:13.749 20:15:18 -- scripts/common.sh@367 -- # return 0 00:14:13.749 20:15:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:13.749 20:15:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:13.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.749 --rc genhtml_branch_coverage=1 00:14:13.749 --rc genhtml_function_coverage=1 00:14:13.749 --rc genhtml_legend=1 00:14:13.749 --rc geninfo_all_blocks=1 00:14:13.749 --rc geninfo_unexecuted_blocks=1 00:14:13.749 00:14:13.749 ' 00:14:13.749 20:15:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:13.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.749 --rc genhtml_branch_coverage=1 00:14:13.749 --rc genhtml_function_coverage=1 00:14:13.750 --rc genhtml_legend=1 00:14:13.750 --rc geninfo_all_blocks=1 00:14:13.750 --rc geninfo_unexecuted_blocks=1 00:14:13.750 00:14:13.750 ' 00:14:13.750 20:15:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:13.750 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.750 --rc genhtml_branch_coverage=1 00:14:13.750 --rc genhtml_function_coverage=1 00:14:13.750 --rc genhtml_legend=1 00:14:13.750 --rc geninfo_all_blocks=1 00:14:13.750 --rc geninfo_unexecuted_blocks=1 00:14:13.750 00:14:13.750 ' 00:14:13.750 20:15:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:13.750 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:13.750 --rc genhtml_branch_coverage=1 00:14:13.750 --rc genhtml_function_coverage=1 00:14:13.750 --rc genhtml_legend=1 00:14:13.750 --rc geninfo_all_blocks=1 00:14:13.750 --rc geninfo_unexecuted_blocks=1 00:14:13.750 00:14:13.750 ' 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:13.750 20:15:18 -- nvmf/common.sh@7 -- # uname -s 00:14:13.750 20:15:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:13.750 20:15:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:13.750 20:15:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:13.750 20:15:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:13.750 20:15:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:13.750 20:15:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:13.750 20:15:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:13.750 20:15:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:13.750 20:15:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:13.750 20:15:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:13.750 20:15:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:13.750 20:15:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:13.750 20:15:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:13.750 20:15:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:13.750 20:15:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:13.750 20:15:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:13.750 20:15:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:13.750 20:15:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:13.750 20:15:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:13.750 20:15:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.750 20:15:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.750 20:15:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.750 20:15:18 -- paths/export.sh@5 -- # export PATH 00:14:13.750 20:15:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.750 20:15:18 -- nvmf/common.sh@46 -- # : 0 00:14:13.750 20:15:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:13.750 20:15:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:13.750 20:15:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:13.750 20:15:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:13.750 20:15:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:13.750 20:15:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:13.750 20:15:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:13.750 20:15:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:13.750 20:15:18 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:13.750 20:15:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:13.750 20:15:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:13.750 20:15:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:13.750 20:15:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:13.750 20:15:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:13.750 20:15:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:13.750 20:15:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:13.750 20:15:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:13.750 20:15:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:13.750 20:15:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:13.750 20:15:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:13.750 20:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:15.674 20:15:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:15.674 20:15:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:15.674 20:15:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:15.674 20:15:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:15.674 20:15:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:15.674 20:15:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:15.674 20:15:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:15.674 20:15:20 -- nvmf/common.sh@294 -- # net_devs=() 00:14:15.674 20:15:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:15.674 20:15:20 -- nvmf/common.sh@295 -- # e810=() 00:14:15.674 20:15:20 -- nvmf/common.sh@295 -- # local -ga e810 00:14:15.674 20:15:20 -- nvmf/common.sh@296 -- # x722=() 00:14:15.674 20:15:20 -- nvmf/common.sh@296 -- # local -ga x722 00:14:15.674 20:15:20 -- nvmf/common.sh@297 -- # mlx=() 00:14:15.674 20:15:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:15.674 20:15:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:15.674 20:15:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:15.674 20:15:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:15.674 20:15:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:15.674 20:15:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:15.674 20:15:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:15.674 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:15.674 20:15:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:15.674 20:15:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:15.932 20:15:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:15.932 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:15.932 20:15:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:15.932 20:15:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:15.932 20:15:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:15.932 20:15:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:15.932 20:15:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:15.932 20:15:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:15.932 20:15:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:15.932 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:15.932 20:15:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:15.932 20:15:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:15.932 20:15:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:15.932 20:15:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:15.932 20:15:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:15.933 20:15:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:15.933 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:15.933 20:15:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:15.933 20:15:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:15.933 20:15:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:15.933 20:15:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:15.933 20:15:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:15.933 20:15:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:15.933 20:15:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:15.933 20:15:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:15.933 20:15:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:15.933 20:15:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:15.933 20:15:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:15.933 20:15:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:15.933 20:15:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:15.933 20:15:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:15.933 20:15:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:15.933 20:15:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:15.933 20:15:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:15.933 20:15:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:15.933 20:15:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:15.933 20:15:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:15.933 20:15:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:15.933 20:15:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:15.933 20:15:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:15.933 20:15:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:15.933 20:15:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:15.933 20:15:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:15.933 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:15.933 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:14:15.933 00:14:15.933 --- 10.0.0.2 ping statistics --- 00:14:15.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:15.933 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:14:15.933 20:15:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:15.933 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:15.933 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:14:15.933 00:14:15.933 --- 10.0.0.1 ping statistics --- 00:14:15.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:15.933 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:14:15.933 20:15:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:15.933 20:15:20 -- nvmf/common.sh@410 -- # return 0 00:14:15.933 20:15:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:15.933 20:15:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:15.933 20:15:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:15.933 20:15:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:15.933 20:15:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:15.933 20:15:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:15.933 20:15:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:15.933 20:15:20 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:15.933 20:15:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:15.933 20:15:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:15.933 20:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:15.933 20:15:20 -- nvmf/common.sh@469 -- # nvmfpid=3137122 00:14:15.933 20:15:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:15.933 20:15:20 -- nvmf/common.sh@470 -- # waitforlisten 3137122 00:14:15.933 20:15:20 -- common/autotest_common.sh@829 -- # '[' -z 3137122 ']' 00:14:15.933 20:15:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:15.933 20:15:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:15.933 20:15:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:15.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:15.933 20:15:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:15.933 20:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:15.933 [2024-11-20 20:15:20.897786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:15.933 [2024-11-20 20:15:20.897853] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:15.933 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.933 [2024-11-20 20:15:20.964698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:16.192 [2024-11-20 20:15:21.079743] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:16.192 [2024-11-20 20:15:21.079918] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:16.192 [2024-11-20 20:15:21.079951] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:16.192 [2024-11-20 20:15:21.079964] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:16.192 [2024-11-20 20:15:21.080092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:16.192 [2024-11-20 20:15:21.080149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:16.192 [2024-11-20 20:15:21.080152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:17.129 20:15:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:17.129 20:15:21 -- common/autotest_common.sh@862 -- # return 0 00:14:17.129 20:15:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:17.129 20:15:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:17.129 20:15:21 -- common/autotest_common.sh@10 -- # set +x 00:14:17.129 20:15:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:17.129 20:15:21 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:17.129 [2024-11-20 20:15:22.165458] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:17.389 20:15:22 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:17.708 20:15:22 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:17.708 20:15:22 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:17.991 20:15:22 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:17.991 20:15:22 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:17.991 20:15:22 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:18.249 20:15:23 -- target/nvmf_lvol.sh@29 -- # lvs=cab8964d-40bb-48f7-a23c-d8168229f90a 00:14:18.249 20:15:23 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u cab8964d-40bb-48f7-a23c-d8168229f90a lvol 20 00:14:18.816 20:15:23 -- target/nvmf_lvol.sh@32 -- # lvol=b7313024-af5c-4d10-8f10-212ec9d077c1 00:14:18.816 20:15:23 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:18.816 20:15:23 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b7313024-af5c-4d10-8f10-212ec9d077c1 00:14:19.074 20:15:24 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:19.332 [2024-11-20 20:15:24.288250] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:19.332 20:15:24 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:19.590 20:15:24 -- target/nvmf_lvol.sh@42 -- # perf_pid=3137661 00:14:19.590 20:15:24 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:19.590 20:15:24 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:19.590 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.970 20:15:25 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot b7313024-af5c-4d10-8f10-212ec9d077c1 MY_SNAPSHOT 00:14:20.970 20:15:25 -- target/nvmf_lvol.sh@47 -- # snapshot=b99d4b48-4417-4efa-a759-8de74b21907d 00:14:20.970 20:15:25 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize b7313024-af5c-4d10-8f10-212ec9d077c1 30 00:14:21.228 20:15:26 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone b99d4b48-4417-4efa-a759-8de74b21907d MY_CLONE 00:14:21.486 20:15:26 -- target/nvmf_lvol.sh@49 -- # clone=c82743cf-d848-4486-8280-4c6629ab04ef 00:14:21.486 20:15:26 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate c82743cf-d848-4486-8280-4c6629ab04ef 00:14:22.054 20:15:27 -- target/nvmf_lvol.sh@53 -- # wait 3137661 00:14:30.177 Initializing NVMe Controllers 00:14:30.177 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:30.177 Controller IO queue size 128, less than required. 00:14:30.177 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:30.177 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:30.177 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:30.177 Initialization complete. Launching workers. 00:14:30.177 ======================================================== 00:14:30.177 Latency(us) 00:14:30.177 Device Information : IOPS MiB/s Average min max 00:14:30.177 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10701.10 41.80 11963.61 1539.82 62623.14 00:14:30.177 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10834.80 42.32 11816.55 1987.51 61275.92 00:14:30.177 ======================================================== 00:14:30.177 Total : 21535.90 84.12 11889.62 1539.82 62623.14 00:14:30.177 00:14:30.177 20:15:34 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:30.177 20:15:35 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b7313024-af5c-4d10-8f10-212ec9d077c1 00:14:30.434 20:15:35 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u cab8964d-40bb-48f7-a23c-d8168229f90a 00:14:30.692 20:15:35 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:30.692 20:15:35 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:30.692 20:15:35 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:30.692 20:15:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:30.692 20:15:35 -- nvmf/common.sh@116 -- # sync 00:14:30.692 20:15:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:30.692 20:15:35 -- nvmf/common.sh@119 -- # set +e 00:14:30.692 20:15:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:30.692 20:15:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:30.692 rmmod nvme_tcp 00:14:30.692 rmmod nvme_fabrics 00:14:30.952 rmmod nvme_keyring 00:14:30.952 20:15:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:30.952 20:15:35 -- nvmf/common.sh@123 -- # set -e 00:14:30.952 20:15:35 -- nvmf/common.sh@124 -- # return 0 00:14:30.952 20:15:35 -- nvmf/common.sh@477 -- # '[' -n 3137122 ']' 00:14:30.952 20:15:35 -- nvmf/common.sh@478 -- # killprocess 3137122 00:14:30.952 20:15:35 -- common/autotest_common.sh@936 -- # '[' -z 3137122 ']' 00:14:30.952 20:15:35 -- common/autotest_common.sh@940 -- # kill -0 3137122 00:14:30.952 20:15:35 -- common/autotest_common.sh@941 -- # uname 00:14:30.952 20:15:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:30.952 20:15:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3137122 00:14:30.952 20:15:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:30.952 20:15:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:30.952 20:15:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3137122' 00:14:30.952 killing process with pid 3137122 00:14:30.952 20:15:35 -- common/autotest_common.sh@955 -- # kill 3137122 00:14:30.952 20:15:35 -- common/autotest_common.sh@960 -- # wait 3137122 00:14:31.210 20:15:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:31.210 20:15:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:31.210 20:15:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:31.210 20:15:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:31.210 20:15:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:31.210 20:15:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:31.210 20:15:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:31.210 20:15:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:33.748 20:15:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:33.748 00:14:33.748 real 0m19.611s 00:14:33.748 user 1m6.985s 00:14:33.748 sys 0m5.314s 00:14:33.748 20:15:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:33.748 20:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:33.748 ************************************ 00:14:33.748 END TEST nvmf_lvol 00:14:33.748 ************************************ 00:14:33.748 20:15:38 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:33.748 20:15:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:33.748 20:15:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:33.748 20:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:33.748 ************************************ 00:14:33.748 START TEST nvmf_lvs_grow 00:14:33.748 ************************************ 00:14:33.748 20:15:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:33.748 * Looking for test storage... 00:14:33.748 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:33.748 20:15:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:33.748 20:15:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:33.748 20:15:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:33.748 20:15:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:33.748 20:15:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:33.748 20:15:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:33.748 20:15:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:33.748 20:15:38 -- scripts/common.sh@335 -- # IFS=.-: 00:14:33.748 20:15:38 -- scripts/common.sh@335 -- # read -ra ver1 00:14:33.748 20:15:38 -- scripts/common.sh@336 -- # IFS=.-: 00:14:33.748 20:15:38 -- scripts/common.sh@336 -- # read -ra ver2 00:14:33.748 20:15:38 -- scripts/common.sh@337 -- # local 'op=<' 00:14:33.748 20:15:38 -- scripts/common.sh@339 -- # ver1_l=2 00:14:33.748 20:15:38 -- scripts/common.sh@340 -- # ver2_l=1 00:14:33.748 20:15:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:33.748 20:15:38 -- scripts/common.sh@343 -- # case "$op" in 00:14:33.748 20:15:38 -- scripts/common.sh@344 -- # : 1 00:14:33.748 20:15:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:33.748 20:15:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:33.748 20:15:38 -- scripts/common.sh@364 -- # decimal 1 00:14:33.748 20:15:38 -- scripts/common.sh@352 -- # local d=1 00:14:33.748 20:15:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:33.748 20:15:38 -- scripts/common.sh@354 -- # echo 1 00:14:33.748 20:15:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:33.748 20:15:38 -- scripts/common.sh@365 -- # decimal 2 00:14:33.748 20:15:38 -- scripts/common.sh@352 -- # local d=2 00:14:33.748 20:15:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:33.748 20:15:38 -- scripts/common.sh@354 -- # echo 2 00:14:33.748 20:15:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:33.748 20:15:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:33.748 20:15:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:33.748 20:15:38 -- scripts/common.sh@367 -- # return 0 00:14:33.748 20:15:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:33.748 20:15:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:33.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.748 --rc genhtml_branch_coverage=1 00:14:33.748 --rc genhtml_function_coverage=1 00:14:33.748 --rc genhtml_legend=1 00:14:33.748 --rc geninfo_all_blocks=1 00:14:33.748 --rc geninfo_unexecuted_blocks=1 00:14:33.748 00:14:33.748 ' 00:14:33.748 20:15:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:33.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.748 --rc genhtml_branch_coverage=1 00:14:33.748 --rc genhtml_function_coverage=1 00:14:33.748 --rc genhtml_legend=1 00:14:33.748 --rc geninfo_all_blocks=1 00:14:33.748 --rc geninfo_unexecuted_blocks=1 00:14:33.748 00:14:33.748 ' 00:14:33.748 20:15:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:33.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.748 --rc genhtml_branch_coverage=1 00:14:33.748 --rc genhtml_function_coverage=1 00:14:33.748 --rc genhtml_legend=1 00:14:33.748 --rc geninfo_all_blocks=1 00:14:33.748 --rc geninfo_unexecuted_blocks=1 00:14:33.748 00:14:33.748 ' 00:14:33.748 20:15:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:33.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:33.748 --rc genhtml_branch_coverage=1 00:14:33.748 --rc genhtml_function_coverage=1 00:14:33.748 --rc genhtml_legend=1 00:14:33.748 --rc geninfo_all_blocks=1 00:14:33.748 --rc geninfo_unexecuted_blocks=1 00:14:33.748 00:14:33.748 ' 00:14:33.748 20:15:38 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:33.748 20:15:38 -- nvmf/common.sh@7 -- # uname -s 00:14:33.748 20:15:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:33.748 20:15:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:33.748 20:15:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:33.748 20:15:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:33.748 20:15:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:33.748 20:15:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:33.748 20:15:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:33.748 20:15:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:33.748 20:15:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:33.748 20:15:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:33.748 20:15:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:33.748 20:15:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:33.748 20:15:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:33.748 20:15:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:33.748 20:15:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:33.748 20:15:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:33.748 20:15:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:33.748 20:15:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:33.748 20:15:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:33.748 20:15:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.748 20:15:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.748 20:15:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.748 20:15:38 -- paths/export.sh@5 -- # export PATH 00:14:33.749 20:15:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.749 20:15:38 -- nvmf/common.sh@46 -- # : 0 00:14:33.749 20:15:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:33.749 20:15:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:33.749 20:15:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:33.749 20:15:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:33.749 20:15:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:33.749 20:15:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:33.749 20:15:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:33.749 20:15:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:33.749 20:15:38 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:33.749 20:15:38 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:33.749 20:15:38 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:33.749 20:15:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:33.749 20:15:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:33.749 20:15:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:33.749 20:15:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:33.749 20:15:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:33.749 20:15:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.749 20:15:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.749 20:15:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:33.749 20:15:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:33.749 20:15:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:33.749 20:15:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:33.749 20:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:35.656 20:15:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:35.656 20:15:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:35.657 20:15:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:35.657 20:15:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:35.657 20:15:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:35.657 20:15:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:35.657 20:15:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:35.657 20:15:40 -- nvmf/common.sh@294 -- # net_devs=() 00:14:35.657 20:15:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:35.657 20:15:40 -- nvmf/common.sh@295 -- # e810=() 00:14:35.657 20:15:40 -- nvmf/common.sh@295 -- # local -ga e810 00:14:35.657 20:15:40 -- nvmf/common.sh@296 -- # x722=() 00:14:35.657 20:15:40 -- nvmf/common.sh@296 -- # local -ga x722 00:14:35.657 20:15:40 -- nvmf/common.sh@297 -- # mlx=() 00:14:35.657 20:15:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:35.657 20:15:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:35.657 20:15:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:35.657 20:15:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:35.657 20:15:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:35.657 20:15:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:35.657 20:15:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:35.657 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:35.657 20:15:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:35.657 20:15:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:35.657 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:35.657 20:15:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:35.657 20:15:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:35.657 20:15:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:35.657 20:15:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:35.657 20:15:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:35.657 20:15:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:35.657 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:35.657 20:15:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:35.657 20:15:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:35.657 20:15:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:35.657 20:15:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:35.657 20:15:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:35.657 20:15:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:35.657 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:35.657 20:15:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:35.657 20:15:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:35.657 20:15:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:35.657 20:15:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:35.657 20:15:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:35.657 20:15:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:35.657 20:15:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:35.657 20:15:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:35.657 20:15:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:35.657 20:15:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:35.657 20:15:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:35.657 20:15:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:35.657 20:15:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:35.657 20:15:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:35.657 20:15:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:35.657 20:15:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:35.657 20:15:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:35.657 20:15:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:35.657 20:15:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:35.657 20:15:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:35.657 20:15:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:35.657 20:15:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:35.657 20:15:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:35.657 20:15:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:35.657 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:35.657 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:14:35.657 00:14:35.657 --- 10.0.0.2 ping statistics --- 00:14:35.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.657 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:14:35.657 20:15:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:35.657 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:35.657 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.196 ms 00:14:35.657 00:14:35.657 --- 10.0.0.1 ping statistics --- 00:14:35.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.657 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:14:35.657 20:15:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:35.657 20:15:40 -- nvmf/common.sh@410 -- # return 0 00:14:35.657 20:15:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:35.657 20:15:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:35.657 20:15:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:35.657 20:15:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:35.657 20:15:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:35.657 20:15:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:35.657 20:15:40 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:35.657 20:15:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:35.657 20:15:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:35.657 20:15:40 -- common/autotest_common.sh@10 -- # set +x 00:14:35.657 20:15:40 -- nvmf/common.sh@469 -- # nvmfpid=3141010 00:14:35.657 20:15:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:35.657 20:15:40 -- nvmf/common.sh@470 -- # waitforlisten 3141010 00:14:35.657 20:15:40 -- common/autotest_common.sh@829 -- # '[' -z 3141010 ']' 00:14:35.657 20:15:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:35.657 20:15:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:35.657 20:15:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:35.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:35.657 20:15:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:35.657 20:15:40 -- common/autotest_common.sh@10 -- # set +x 00:14:35.657 [2024-11-20 20:15:40.658536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:35.657 [2024-11-20 20:15:40.658608] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:35.657 EAL: No free 2048 kB hugepages reported on node 1 00:14:35.917 [2024-11-20 20:15:40.725888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:35.917 [2024-11-20 20:15:40.840588] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:35.917 [2024-11-20 20:15:40.840740] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:35.917 [2024-11-20 20:15:40.840757] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:35.917 [2024-11-20 20:15:40.840769] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:35.917 [2024-11-20 20:15:40.840802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:36.854 20:15:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:36.854 20:15:41 -- common/autotest_common.sh@862 -- # return 0 00:14:36.854 20:15:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:36.854 20:15:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:36.854 20:15:41 -- common/autotest_common.sh@10 -- # set +x 00:14:36.854 20:15:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:36.854 20:15:41 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:37.113 [2024-11-20 20:15:41.923043] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:37.113 20:15:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:37.113 20:15:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:37.113 20:15:41 -- common/autotest_common.sh@10 -- # set +x 00:14:37.113 ************************************ 00:14:37.113 START TEST lvs_grow_clean 00:14:37.113 ************************************ 00:14:37.113 20:15:41 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:37.113 20:15:41 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:37.371 20:15:42 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:37.371 20:15:42 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:37.629 20:15:42 -- target/nvmf_lvs_grow.sh@28 -- # lvs=45a8aad9-3903-4532-b889-35e0ef59570a 00:14:37.629 20:15:42 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:37.629 20:15:42 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:37.888 20:15:42 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:37.888 20:15:42 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:37.888 20:15:42 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 45a8aad9-3903-4532-b889-35e0ef59570a lvol 150 00:14:38.148 20:15:43 -- target/nvmf_lvs_grow.sh@33 -- # lvol=21ea3995-2374-4fb4-929e-50a6099793e0 00:14:38.148 20:15:43 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:38.148 20:15:43 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:38.408 [2024-11-20 20:15:43.290461] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:38.408 [2024-11-20 20:15:43.290546] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:38.408 true 00:14:38.408 20:15:43 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:38.408 20:15:43 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:38.667 20:15:43 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:38.667 20:15:43 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:38.925 20:15:43 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 21ea3995-2374-4fb4-929e-50a6099793e0 00:14:39.186 20:15:44 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:39.447 [2024-11-20 20:15:44.349822] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:39.447 20:15:44 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:39.706 20:15:44 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3141464 00:14:39.706 20:15:44 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:39.706 20:15:44 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3141464 /var/tmp/bdevperf.sock 00:14:39.706 20:15:44 -- common/autotest_common.sh@829 -- # '[' -z 3141464 ']' 00:14:39.706 20:15:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:39.706 20:15:44 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:39.706 20:15:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:39.706 20:15:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:39.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:39.706 20:15:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:39.706 20:15:44 -- common/autotest_common.sh@10 -- # set +x 00:14:39.706 [2024-11-20 20:15:44.657248] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:39.706 [2024-11-20 20:15:44.657322] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3141464 ] 00:14:39.706 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.706 [2024-11-20 20:15:44.719219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:39.965 [2024-11-20 20:15:44.833896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:40.900 20:15:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:40.900 20:15:45 -- common/autotest_common.sh@862 -- # return 0 00:14:40.900 20:15:45 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:41.158 Nvme0n1 00:14:41.158 20:15:45 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:41.417 [ 00:14:41.417 { 00:14:41.417 "name": "Nvme0n1", 00:14:41.417 "aliases": [ 00:14:41.417 "21ea3995-2374-4fb4-929e-50a6099793e0" 00:14:41.417 ], 00:14:41.417 "product_name": "NVMe disk", 00:14:41.417 "block_size": 4096, 00:14:41.417 "num_blocks": 38912, 00:14:41.417 "uuid": "21ea3995-2374-4fb4-929e-50a6099793e0", 00:14:41.417 "assigned_rate_limits": { 00:14:41.417 "rw_ios_per_sec": 0, 00:14:41.417 "rw_mbytes_per_sec": 0, 00:14:41.417 "r_mbytes_per_sec": 0, 00:14:41.417 "w_mbytes_per_sec": 0 00:14:41.417 }, 00:14:41.417 "claimed": false, 00:14:41.417 "zoned": false, 00:14:41.417 "supported_io_types": { 00:14:41.417 "read": true, 00:14:41.417 "write": true, 00:14:41.417 "unmap": true, 00:14:41.417 "write_zeroes": true, 00:14:41.417 "flush": true, 00:14:41.417 "reset": true, 00:14:41.417 "compare": true, 00:14:41.417 "compare_and_write": true, 00:14:41.417 "abort": true, 00:14:41.417 "nvme_admin": true, 00:14:41.417 "nvme_io": true 00:14:41.417 }, 00:14:41.417 "driver_specific": { 00:14:41.417 "nvme": [ 00:14:41.417 { 00:14:41.417 "trid": { 00:14:41.417 "trtype": "TCP", 00:14:41.417 "adrfam": "IPv4", 00:14:41.417 "traddr": "10.0.0.2", 00:14:41.417 "trsvcid": "4420", 00:14:41.417 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:41.417 }, 00:14:41.417 "ctrlr_data": { 00:14:41.417 "cntlid": 1, 00:14:41.417 "vendor_id": "0x8086", 00:14:41.417 "model_number": "SPDK bdev Controller", 00:14:41.417 "serial_number": "SPDK0", 00:14:41.417 "firmware_revision": "24.01.1", 00:14:41.417 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:41.417 "oacs": { 00:14:41.417 "security": 0, 00:14:41.417 "format": 0, 00:14:41.417 "firmware": 0, 00:14:41.417 "ns_manage": 0 00:14:41.417 }, 00:14:41.417 "multi_ctrlr": true, 00:14:41.417 "ana_reporting": false 00:14:41.417 }, 00:14:41.417 "vs": { 00:14:41.417 "nvme_version": "1.3" 00:14:41.417 }, 00:14:41.417 "ns_data": { 00:14:41.417 "id": 1, 00:14:41.417 "can_share": true 00:14:41.417 } 00:14:41.417 } 00:14:41.417 ], 00:14:41.417 "mp_policy": "active_passive" 00:14:41.417 } 00:14:41.417 } 00:14:41.417 ] 00:14:41.417 20:15:46 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3141737 00:14:41.417 20:15:46 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:41.417 20:15:46 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:41.417 Running I/O for 10 seconds... 00:14:42.354 Latency(us) 00:14:42.354 [2024-11-20T19:15:47.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:42.354 [2024-11-20T19:15:47.393Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.354 Nvme0n1 : 1.00 14671.00 57.31 0.00 0.00 0.00 0.00 0.00 00:14:42.354 [2024-11-20T19:15:47.393Z] =================================================================================================================== 00:14:42.354 [2024-11-20T19:15:47.393Z] Total : 14671.00 57.31 0.00 0.00 0.00 0.00 0.00 00:14:42.354 00:14:43.293 20:15:48 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:43.551 [2024-11-20T19:15:48.590Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.551 Nvme0n1 : 2.00 14897.50 58.19 0.00 0.00 0.00 0.00 0.00 00:14:43.551 [2024-11-20T19:15:48.590Z] =================================================================================================================== 00:14:43.551 [2024-11-20T19:15:48.590Z] Total : 14897.50 58.19 0.00 0.00 0.00 0.00 0.00 00:14:43.551 00:14:43.551 true 00:14:43.551 20:15:48 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:43.551 20:15:48 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:43.811 20:15:48 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:43.811 20:15:48 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:43.811 20:15:48 -- target/nvmf_lvs_grow.sh@65 -- # wait 3141737 00:14:44.381 [2024-11-20T19:15:49.420Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.381 Nvme0n1 : 3.00 15012.33 58.64 0.00 0.00 0.00 0.00 0.00 00:14:44.381 [2024-11-20T19:15:49.420Z] =================================================================================================================== 00:14:44.381 [2024-11-20T19:15:49.420Z] Total : 15012.33 58.64 0.00 0.00 0.00 0.00 0.00 00:14:44.381 00:14:45.319 [2024-11-20T19:15:50.358Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.319 Nvme0n1 : 4.00 15070.00 58.87 0.00 0.00 0.00 0.00 0.00 00:14:45.319 [2024-11-20T19:15:50.358Z] =================================================================================================================== 00:14:45.319 [2024-11-20T19:15:50.358Z] Total : 15070.00 58.87 0.00 0.00 0.00 0.00 0.00 00:14:45.319 00:14:46.701 [2024-11-20T19:15:51.740Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.701 Nvme0n1 : 5.00 15124.00 59.08 0.00 0.00 0.00 0.00 0.00 00:14:46.701 [2024-11-20T19:15:51.740Z] =================================================================================================================== 00:14:46.701 [2024-11-20T19:15:51.740Z] Total : 15124.00 59.08 0.00 0.00 0.00 0.00 0.00 00:14:46.701 00:14:47.635 [2024-11-20T19:15:52.674Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.635 Nvme0n1 : 6.00 15175.67 59.28 0.00 0.00 0.00 0.00 0.00 00:14:47.635 [2024-11-20T19:15:52.674Z] =================================================================================================================== 00:14:47.635 [2024-11-20T19:15:52.674Z] Total : 15175.67 59.28 0.00 0.00 0.00 0.00 0.00 00:14:47.635 00:14:48.575 [2024-11-20T19:15:53.614Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.575 Nvme0n1 : 7.00 15231.00 59.50 0.00 0.00 0.00 0.00 0.00 00:14:48.575 [2024-11-20T19:15:53.614Z] =================================================================================================================== 00:14:48.575 [2024-11-20T19:15:53.614Z] Total : 15231.00 59.50 0.00 0.00 0.00 0.00 0.00 00:14:48.575 00:14:49.511 [2024-11-20T19:15:54.550Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.511 Nvme0n1 : 8.00 15275.12 59.67 0.00 0.00 0.00 0.00 0.00 00:14:49.511 [2024-11-20T19:15:54.550Z] =================================================================================================================== 00:14:49.511 [2024-11-20T19:15:54.550Z] Total : 15275.12 59.67 0.00 0.00 0.00 0.00 0.00 00:14:49.511 00:14:50.450 [2024-11-20T19:15:55.489Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.450 Nvme0n1 : 9.00 15313.89 59.82 0.00 0.00 0.00 0.00 0.00 00:14:50.450 [2024-11-20T19:15:55.489Z] =================================================================================================================== 00:14:50.450 [2024-11-20T19:15:55.489Z] Total : 15313.89 59.82 0.00 0.00 0.00 0.00 0.00 00:14:50.450 00:14:51.448 [2024-11-20T19:15:56.487Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.448 Nvme0n1 : 10.00 15344.60 59.94 0.00 0.00 0.00 0.00 0.00 00:14:51.448 [2024-11-20T19:15:56.487Z] =================================================================================================================== 00:14:51.448 [2024-11-20T19:15:56.487Z] Total : 15344.60 59.94 0.00 0.00 0.00 0.00 0.00 00:14:51.448 00:14:51.448 00:14:51.448 Latency(us) 00:14:51.448 [2024-11-20T19:15:56.487Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:51.448 [2024-11-20T19:15:56.487Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.448 Nvme0n1 : 10.01 15349.38 59.96 0.00 0.00 8334.63 4660.34 18350.08 00:14:51.448 [2024-11-20T19:15:56.487Z] =================================================================================================================== 00:14:51.448 [2024-11-20T19:15:56.487Z] Total : 15349.38 59.96 0.00 0.00 8334.63 4660.34 18350.08 00:14:51.448 0 00:14:51.448 20:15:56 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3141464 00:14:51.448 20:15:56 -- common/autotest_common.sh@936 -- # '[' -z 3141464 ']' 00:14:51.448 20:15:56 -- common/autotest_common.sh@940 -- # kill -0 3141464 00:14:51.448 20:15:56 -- common/autotest_common.sh@941 -- # uname 00:14:51.448 20:15:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:51.448 20:15:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3141464 00:14:51.448 20:15:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:51.448 20:15:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:51.448 20:15:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3141464' 00:14:51.448 killing process with pid 3141464 00:14:51.448 20:15:56 -- common/autotest_common.sh@955 -- # kill 3141464 00:14:51.448 Received shutdown signal, test time was about 10.000000 seconds 00:14:51.448 00:14:51.448 Latency(us) 00:14:51.448 [2024-11-20T19:15:56.487Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:51.448 [2024-11-20T19:15:56.487Z] =================================================================================================================== 00:14:51.448 [2024-11-20T19:15:56.487Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:51.448 20:15:56 -- common/autotest_common.sh@960 -- # wait 3141464 00:14:51.706 20:15:56 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:51.964 20:15:56 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:51.964 20:15:56 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:52.223 20:15:57 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:52.223 20:15:57 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:52.223 20:15:57 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:52.482 [2024-11-20 20:15:57.446935] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:52.482 20:15:57 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:52.482 20:15:57 -- common/autotest_common.sh@650 -- # local es=0 00:14:52.482 20:15:57 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:52.482 20:15:57 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.482 20:15:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:52.482 20:15:57 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.482 20:15:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:52.482 20:15:57 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.482 20:15:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:52.482 20:15:57 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.482 20:15:57 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:52.482 20:15:57 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:52.740 request: 00:14:52.740 { 00:14:52.740 "uuid": "45a8aad9-3903-4532-b889-35e0ef59570a", 00:14:52.740 "method": "bdev_lvol_get_lvstores", 00:14:52.740 "req_id": 1 00:14:52.740 } 00:14:52.740 Got JSON-RPC error response 00:14:52.740 response: 00:14:52.740 { 00:14:52.740 "code": -19, 00:14:52.740 "message": "No such device" 00:14:52.740 } 00:14:52.740 20:15:57 -- common/autotest_common.sh@653 -- # es=1 00:14:52.740 20:15:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:52.740 20:15:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:52.740 20:15:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:52.740 20:15:57 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:52.998 aio_bdev 00:14:52.998 20:15:57 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 21ea3995-2374-4fb4-929e-50a6099793e0 00:14:52.998 20:15:57 -- common/autotest_common.sh@897 -- # local bdev_name=21ea3995-2374-4fb4-929e-50a6099793e0 00:14:52.998 20:15:57 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:52.998 20:15:57 -- common/autotest_common.sh@899 -- # local i 00:14:52.998 20:15:57 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:52.998 20:15:57 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:52.998 20:15:57 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:53.257 20:15:58 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 21ea3995-2374-4fb4-929e-50a6099793e0 -t 2000 00:14:53.515 [ 00:14:53.515 { 00:14:53.515 "name": "21ea3995-2374-4fb4-929e-50a6099793e0", 00:14:53.515 "aliases": [ 00:14:53.515 "lvs/lvol" 00:14:53.515 ], 00:14:53.515 "product_name": "Logical Volume", 00:14:53.515 "block_size": 4096, 00:14:53.515 "num_blocks": 38912, 00:14:53.515 "uuid": "21ea3995-2374-4fb4-929e-50a6099793e0", 00:14:53.515 "assigned_rate_limits": { 00:14:53.515 "rw_ios_per_sec": 0, 00:14:53.515 "rw_mbytes_per_sec": 0, 00:14:53.515 "r_mbytes_per_sec": 0, 00:14:53.515 "w_mbytes_per_sec": 0 00:14:53.515 }, 00:14:53.515 "claimed": false, 00:14:53.515 "zoned": false, 00:14:53.515 "supported_io_types": { 00:14:53.515 "read": true, 00:14:53.515 "write": true, 00:14:53.515 "unmap": true, 00:14:53.515 "write_zeroes": true, 00:14:53.515 "flush": false, 00:14:53.515 "reset": true, 00:14:53.515 "compare": false, 00:14:53.515 "compare_and_write": false, 00:14:53.515 "abort": false, 00:14:53.515 "nvme_admin": false, 00:14:53.515 "nvme_io": false 00:14:53.515 }, 00:14:53.515 "driver_specific": { 00:14:53.515 "lvol": { 00:14:53.515 "lvol_store_uuid": "45a8aad9-3903-4532-b889-35e0ef59570a", 00:14:53.515 "base_bdev": "aio_bdev", 00:14:53.515 "thin_provision": false, 00:14:53.515 "snapshot": false, 00:14:53.515 "clone": false, 00:14:53.515 "esnap_clone": false 00:14:53.515 } 00:14:53.515 } 00:14:53.515 } 00:14:53.515 ] 00:14:53.515 20:15:58 -- common/autotest_common.sh@905 -- # return 0 00:14:53.515 20:15:58 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:53.515 20:15:58 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:53.774 20:15:58 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:53.774 20:15:58 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:53.774 20:15:58 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:54.034 20:15:59 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:54.034 20:15:59 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 21ea3995-2374-4fb4-929e-50a6099793e0 00:14:54.293 20:15:59 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 45a8aad9-3903-4532-b889-35e0ef59570a 00:14:54.551 20:15:59 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.809 00:14:54.809 real 0m17.852s 00:14:54.809 user 0m17.666s 00:14:54.809 sys 0m1.764s 00:14:54.809 20:15:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:54.809 20:15:59 -- common/autotest_common.sh@10 -- # set +x 00:14:54.809 ************************************ 00:14:54.809 END TEST lvs_grow_clean 00:14:54.809 ************************************ 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:54.809 20:15:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:54.809 20:15:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:54.809 20:15:59 -- common/autotest_common.sh@10 -- # set +x 00:14:54.809 ************************************ 00:14:54.809 START TEST lvs_grow_dirty 00:14:54.809 ************************************ 00:14:54.809 20:15:59 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.809 20:15:59 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:55.378 20:16:00 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:55.379 20:16:00 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:55.379 20:16:00 -- target/nvmf_lvs_grow.sh@28 -- # lvs=1fd0e774-8608-43a4-80c7-1170ac7ec460 00:14:55.379 20:16:00 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:14:55.379 20:16:00 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:55.638 20:16:00 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:55.638 20:16:00 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:55.638 20:16:00 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 lvol 150 00:14:55.899 20:16:00 -- target/nvmf_lvs_grow.sh@33 -- # lvol=118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:14:55.899 20:16:00 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:55.899 20:16:00 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:56.158 [2024-11-20 20:16:01.102346] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:56.158 [2024-11-20 20:16:01.102443] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:56.158 true 00:14:56.158 20:16:01 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:14:56.158 20:16:01 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:56.416 20:16:01 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:56.416 20:16:01 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:56.675 20:16:01 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:14:56.934 20:16:01 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:57.193 20:16:02 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:57.453 20:16:02 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3143707 00:14:57.453 20:16:02 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:57.453 20:16:02 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:57.453 20:16:02 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3143707 /var/tmp/bdevperf.sock 00:14:57.453 20:16:02 -- common/autotest_common.sh@829 -- # '[' -z 3143707 ']' 00:14:57.453 20:16:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:57.453 20:16:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:57.453 20:16:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:57.453 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:57.453 20:16:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:57.453 20:16:02 -- common/autotest_common.sh@10 -- # set +x 00:14:57.453 [2024-11-20 20:16:02.454254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:57.453 [2024-11-20 20:16:02.454328] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3143707 ] 00:14:57.453 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.713 [2024-11-20 20:16:02.514909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.713 [2024-11-20 20:16:02.630504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:58.648 20:16:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:58.648 20:16:03 -- common/autotest_common.sh@862 -- # return 0 00:14:58.648 20:16:03 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:58.907 Nvme0n1 00:14:58.907 20:16:03 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:59.165 [ 00:14:59.165 { 00:14:59.165 "name": "Nvme0n1", 00:14:59.165 "aliases": [ 00:14:59.165 "118df3dc-b6cc-4e40-ba2a-7065e786d39c" 00:14:59.165 ], 00:14:59.165 "product_name": "NVMe disk", 00:14:59.165 "block_size": 4096, 00:14:59.165 "num_blocks": 38912, 00:14:59.165 "uuid": "118df3dc-b6cc-4e40-ba2a-7065e786d39c", 00:14:59.165 "assigned_rate_limits": { 00:14:59.165 "rw_ios_per_sec": 0, 00:14:59.165 "rw_mbytes_per_sec": 0, 00:14:59.165 "r_mbytes_per_sec": 0, 00:14:59.165 "w_mbytes_per_sec": 0 00:14:59.165 }, 00:14:59.165 "claimed": false, 00:14:59.165 "zoned": false, 00:14:59.165 "supported_io_types": { 00:14:59.165 "read": true, 00:14:59.165 "write": true, 00:14:59.165 "unmap": true, 00:14:59.165 "write_zeroes": true, 00:14:59.165 "flush": true, 00:14:59.165 "reset": true, 00:14:59.165 "compare": true, 00:14:59.165 "compare_and_write": true, 00:14:59.165 "abort": true, 00:14:59.165 "nvme_admin": true, 00:14:59.165 "nvme_io": true 00:14:59.165 }, 00:14:59.165 "driver_specific": { 00:14:59.165 "nvme": [ 00:14:59.165 { 00:14:59.165 "trid": { 00:14:59.165 "trtype": "TCP", 00:14:59.165 "adrfam": "IPv4", 00:14:59.165 "traddr": "10.0.0.2", 00:14:59.165 "trsvcid": "4420", 00:14:59.165 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:59.165 }, 00:14:59.165 "ctrlr_data": { 00:14:59.165 "cntlid": 1, 00:14:59.165 "vendor_id": "0x8086", 00:14:59.165 "model_number": "SPDK bdev Controller", 00:14:59.165 "serial_number": "SPDK0", 00:14:59.166 "firmware_revision": "24.01.1", 00:14:59.166 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:59.166 "oacs": { 00:14:59.166 "security": 0, 00:14:59.166 "format": 0, 00:14:59.166 "firmware": 0, 00:14:59.166 "ns_manage": 0 00:14:59.166 }, 00:14:59.166 "multi_ctrlr": true, 00:14:59.166 "ana_reporting": false 00:14:59.166 }, 00:14:59.166 "vs": { 00:14:59.166 "nvme_version": "1.3" 00:14:59.166 }, 00:14:59.166 "ns_data": { 00:14:59.166 "id": 1, 00:14:59.166 "can_share": true 00:14:59.166 } 00:14:59.166 } 00:14:59.166 ], 00:14:59.166 "mp_policy": "active_passive" 00:14:59.166 } 00:14:59.166 } 00:14:59.166 ] 00:14:59.166 20:16:04 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3143850 00:14:59.166 20:16:04 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:59.166 20:16:04 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:59.425 Running I/O for 10 seconds... 00:15:00.364 Latency(us) 00:15:00.364 [2024-11-20T19:16:05.403Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:00.364 [2024-11-20T19:16:05.403Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.364 Nvme0n1 : 1.00 14609.00 57.07 0.00 0.00 0.00 0.00 0.00 00:15:00.364 [2024-11-20T19:16:05.403Z] =================================================================================================================== 00:15:00.364 [2024-11-20T19:16:05.403Z] Total : 14609.00 57.07 0.00 0.00 0.00 0.00 0.00 00:15:00.364 00:15:01.299 20:16:06 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:01.299 [2024-11-20T19:16:06.338Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.299 Nvme0n1 : 2.00 14864.00 58.06 0.00 0.00 0.00 0.00 0.00 00:15:01.299 [2024-11-20T19:16:06.338Z] =================================================================================================================== 00:15:01.299 [2024-11-20T19:16:06.338Z] Total : 14864.00 58.06 0.00 0.00 0.00 0.00 0.00 00:15:01.299 00:15:01.557 true 00:15:01.557 20:16:06 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:01.557 20:16:06 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:01.815 20:16:06 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:01.815 20:16:06 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:01.815 20:16:06 -- target/nvmf_lvs_grow.sh@65 -- # wait 3143850 00:15:02.380 [2024-11-20T19:16:07.419Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.380 Nvme0n1 : 3.00 14936.67 58.35 0.00 0.00 0.00 0.00 0.00 00:15:02.380 [2024-11-20T19:16:07.419Z] =================================================================================================================== 00:15:02.380 [2024-11-20T19:16:07.419Z] Total : 14936.67 58.35 0.00 0.00 0.00 0.00 0.00 00:15:02.380 00:15:03.318 [2024-11-20T19:16:08.357Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.318 Nvme0n1 : 4.00 15031.50 58.72 0.00 0.00 0.00 0.00 0.00 00:15:03.318 [2024-11-20T19:16:08.357Z] =================================================================================================================== 00:15:03.318 [2024-11-20T19:16:08.357Z] Total : 15031.50 58.72 0.00 0.00 0.00 0.00 0.00 00:15:03.318 00:15:04.255 [2024-11-20T19:16:09.294Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.255 Nvme0n1 : 5.00 15113.20 59.04 0.00 0.00 0.00 0.00 0.00 00:15:04.255 [2024-11-20T19:16:09.294Z] =================================================================================================================== 00:15:04.255 [2024-11-20T19:16:09.294Z] Total : 15113.20 59.04 0.00 0.00 0.00 0.00 0.00 00:15:04.255 00:15:05.634 [2024-11-20T19:16:10.673Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.634 Nvme0n1 : 6.00 15156.67 59.21 0.00 0.00 0.00 0.00 0.00 00:15:05.634 [2024-11-20T19:16:10.673Z] =================================================================================================================== 00:15:05.634 [2024-11-20T19:16:10.673Z] Total : 15156.67 59.21 0.00 0.00 0.00 0.00 0.00 00:15:05.634 00:15:06.572 [2024-11-20T19:16:11.611Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.572 Nvme0n1 : 7.00 15198.14 59.37 0.00 0.00 0.00 0.00 0.00 00:15:06.572 [2024-11-20T19:16:11.611Z] =================================================================================================================== 00:15:06.572 [2024-11-20T19:16:11.611Z] Total : 15198.14 59.37 0.00 0.00 0.00 0.00 0.00 00:15:06.572 00:15:07.507 [2024-11-20T19:16:12.546Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.507 Nvme0n1 : 8.00 15220.00 59.45 0.00 0.00 0.00 0.00 0.00 00:15:07.507 [2024-11-20T19:16:12.546Z] =================================================================================================================== 00:15:07.507 [2024-11-20T19:16:12.546Z] Total : 15220.00 59.45 0.00 0.00 0.00 0.00 0.00 00:15:07.507 00:15:08.443 [2024-11-20T19:16:13.482Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.443 Nvme0n1 : 9.00 15249.33 59.57 0.00 0.00 0.00 0.00 0.00 00:15:08.443 [2024-11-20T19:16:13.482Z] =================================================================================================================== 00:15:08.443 [2024-11-20T19:16:13.482Z] Total : 15249.33 59.57 0.00 0.00 0.00 0.00 0.00 00:15:08.443 00:15:09.381 [2024-11-20T19:16:14.420Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.381 Nvme0n1 : 10.00 15271.40 59.65 0.00 0.00 0.00 0.00 0.00 00:15:09.381 [2024-11-20T19:16:14.420Z] =================================================================================================================== 00:15:09.381 [2024-11-20T19:16:14.420Z] Total : 15271.40 59.65 0.00 0.00 0.00 0.00 0.00 00:15:09.381 00:15:09.381 00:15:09.381 Latency(us) 00:15:09.381 [2024-11-20T19:16:14.420Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:09.381 [2024-11-20T19:16:14.420Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.381 Nvme0n1 : 10.00 15277.26 59.68 0.00 0.00 8374.09 2220.94 17087.91 00:15:09.381 [2024-11-20T19:16:14.420Z] =================================================================================================================== 00:15:09.381 [2024-11-20T19:16:14.420Z] Total : 15277.26 59.68 0.00 0.00 8374.09 2220.94 17087.91 00:15:09.381 0 00:15:09.381 20:16:14 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3143707 00:15:09.381 20:16:14 -- common/autotest_common.sh@936 -- # '[' -z 3143707 ']' 00:15:09.381 20:16:14 -- common/autotest_common.sh@940 -- # kill -0 3143707 00:15:09.381 20:16:14 -- common/autotest_common.sh@941 -- # uname 00:15:09.381 20:16:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:09.381 20:16:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3143707 00:15:09.381 20:16:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:09.381 20:16:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:09.381 20:16:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3143707' 00:15:09.381 killing process with pid 3143707 00:15:09.381 20:16:14 -- common/autotest_common.sh@955 -- # kill 3143707 00:15:09.381 Received shutdown signal, test time was about 10.000000 seconds 00:15:09.381 00:15:09.381 Latency(us) 00:15:09.381 [2024-11-20T19:16:14.420Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:09.381 [2024-11-20T19:16:14.420Z] =================================================================================================================== 00:15:09.381 [2024-11-20T19:16:14.420Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:09.381 20:16:14 -- common/autotest_common.sh@960 -- # wait 3143707 00:15:09.640 20:16:14 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:09.898 20:16:14 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:09.898 20:16:14 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:10.159 20:16:15 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:10.159 20:16:15 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:10.159 20:16:15 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3141010 00:15:10.159 20:16:15 -- target/nvmf_lvs_grow.sh@74 -- # wait 3141010 00:15:10.159 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3141010 Killed "${NVMF_APP[@]}" "$@" 00:15:10.159 20:16:15 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:10.159 20:16:15 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:10.159 20:16:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:10.159 20:16:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:10.159 20:16:15 -- common/autotest_common.sh@10 -- # set +x 00:15:10.159 20:16:15 -- nvmf/common.sh@469 -- # nvmfpid=3145219 00:15:10.159 20:16:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:10.159 20:16:15 -- nvmf/common.sh@470 -- # waitforlisten 3145219 00:15:10.159 20:16:15 -- common/autotest_common.sh@829 -- # '[' -z 3145219 ']' 00:15:10.159 20:16:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:10.159 20:16:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:10.159 20:16:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:10.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:10.159 20:16:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:10.159 20:16:15 -- common/autotest_common.sh@10 -- # set +x 00:15:10.159 [2024-11-20 20:16:15.193495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:10.159 [2024-11-20 20:16:15.193591] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:10.420 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.420 [2024-11-20 20:16:15.260685] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:10.420 [2024-11-20 20:16:15.369220] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:10.420 [2024-11-20 20:16:15.369361] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:10.420 [2024-11-20 20:16:15.369378] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:10.420 [2024-11-20 20:16:15.369389] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:10.420 [2024-11-20 20:16:15.369415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:11.358 20:16:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:11.358 20:16:16 -- common/autotest_common.sh@862 -- # return 0 00:15:11.358 20:16:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:11.358 20:16:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:11.358 20:16:16 -- common/autotest_common.sh@10 -- # set +x 00:15:11.358 20:16:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:11.358 20:16:16 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:11.617 [2024-11-20 20:16:16.430441] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:11.617 [2024-11-20 20:16:16.430571] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:11.617 [2024-11-20 20:16:16.430618] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:11.617 20:16:16 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:11.617 20:16:16 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:15:11.617 20:16:16 -- common/autotest_common.sh@897 -- # local bdev_name=118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:15:11.617 20:16:16 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:11.617 20:16:16 -- common/autotest_common.sh@899 -- # local i 00:15:11.617 20:16:16 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:11.617 20:16:16 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:11.617 20:16:16 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:11.877 20:16:16 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 118df3dc-b6cc-4e40-ba2a-7065e786d39c -t 2000 00:15:12.136 [ 00:15:12.136 { 00:15:12.136 "name": "118df3dc-b6cc-4e40-ba2a-7065e786d39c", 00:15:12.136 "aliases": [ 00:15:12.136 "lvs/lvol" 00:15:12.136 ], 00:15:12.136 "product_name": "Logical Volume", 00:15:12.136 "block_size": 4096, 00:15:12.136 "num_blocks": 38912, 00:15:12.136 "uuid": "118df3dc-b6cc-4e40-ba2a-7065e786d39c", 00:15:12.136 "assigned_rate_limits": { 00:15:12.136 "rw_ios_per_sec": 0, 00:15:12.136 "rw_mbytes_per_sec": 0, 00:15:12.136 "r_mbytes_per_sec": 0, 00:15:12.136 "w_mbytes_per_sec": 0 00:15:12.136 }, 00:15:12.136 "claimed": false, 00:15:12.136 "zoned": false, 00:15:12.136 "supported_io_types": { 00:15:12.136 "read": true, 00:15:12.136 "write": true, 00:15:12.136 "unmap": true, 00:15:12.136 "write_zeroes": true, 00:15:12.136 "flush": false, 00:15:12.136 "reset": true, 00:15:12.136 "compare": false, 00:15:12.136 "compare_and_write": false, 00:15:12.136 "abort": false, 00:15:12.136 "nvme_admin": false, 00:15:12.136 "nvme_io": false 00:15:12.136 }, 00:15:12.136 "driver_specific": { 00:15:12.136 "lvol": { 00:15:12.136 "lvol_store_uuid": "1fd0e774-8608-43a4-80c7-1170ac7ec460", 00:15:12.136 "base_bdev": "aio_bdev", 00:15:12.136 "thin_provision": false, 00:15:12.136 "snapshot": false, 00:15:12.136 "clone": false, 00:15:12.136 "esnap_clone": false 00:15:12.136 } 00:15:12.136 } 00:15:12.136 } 00:15:12.136 ] 00:15:12.136 20:16:16 -- common/autotest_common.sh@905 -- # return 0 00:15:12.136 20:16:16 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:12.136 20:16:16 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:12.393 20:16:17 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:12.394 20:16:17 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:12.394 20:16:17 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:12.651 20:16:17 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:12.651 20:16:17 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:12.909 [2024-11-20 20:16:17.699748] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:12.909 20:16:17 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:12.909 20:16:17 -- common/autotest_common.sh@650 -- # local es=0 00:15:12.909 20:16:17 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:12.909 20:16:17 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.909 20:16:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.909 20:16:17 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.909 20:16:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.909 20:16:17 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.909 20:16:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.909 20:16:17 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.909 20:16:17 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:12.909 20:16:17 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:13.168 request: 00:15:13.168 { 00:15:13.168 "uuid": "1fd0e774-8608-43a4-80c7-1170ac7ec460", 00:15:13.168 "method": "bdev_lvol_get_lvstores", 00:15:13.168 "req_id": 1 00:15:13.168 } 00:15:13.168 Got JSON-RPC error response 00:15:13.168 response: 00:15:13.168 { 00:15:13.168 "code": -19, 00:15:13.168 "message": "No such device" 00:15:13.168 } 00:15:13.168 20:16:17 -- common/autotest_common.sh@653 -- # es=1 00:15:13.168 20:16:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:13.168 20:16:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:13.168 20:16:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:13.168 20:16:17 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:13.428 aio_bdev 00:15:13.428 20:16:18 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:15:13.429 20:16:18 -- common/autotest_common.sh@897 -- # local bdev_name=118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:15:13.429 20:16:18 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:13.429 20:16:18 -- common/autotest_common.sh@899 -- # local i 00:15:13.429 20:16:18 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:13.429 20:16:18 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:13.429 20:16:18 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:13.687 20:16:18 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 118df3dc-b6cc-4e40-ba2a-7065e786d39c -t 2000 00:15:13.945 [ 00:15:13.945 { 00:15:13.945 "name": "118df3dc-b6cc-4e40-ba2a-7065e786d39c", 00:15:13.945 "aliases": [ 00:15:13.945 "lvs/lvol" 00:15:13.945 ], 00:15:13.945 "product_name": "Logical Volume", 00:15:13.945 "block_size": 4096, 00:15:13.945 "num_blocks": 38912, 00:15:13.945 "uuid": "118df3dc-b6cc-4e40-ba2a-7065e786d39c", 00:15:13.945 "assigned_rate_limits": { 00:15:13.945 "rw_ios_per_sec": 0, 00:15:13.945 "rw_mbytes_per_sec": 0, 00:15:13.945 "r_mbytes_per_sec": 0, 00:15:13.945 "w_mbytes_per_sec": 0 00:15:13.945 }, 00:15:13.945 "claimed": false, 00:15:13.945 "zoned": false, 00:15:13.945 "supported_io_types": { 00:15:13.945 "read": true, 00:15:13.945 "write": true, 00:15:13.945 "unmap": true, 00:15:13.945 "write_zeroes": true, 00:15:13.945 "flush": false, 00:15:13.945 "reset": true, 00:15:13.945 "compare": false, 00:15:13.945 "compare_and_write": false, 00:15:13.945 "abort": false, 00:15:13.945 "nvme_admin": false, 00:15:13.945 "nvme_io": false 00:15:13.945 }, 00:15:13.945 "driver_specific": { 00:15:13.945 "lvol": { 00:15:13.945 "lvol_store_uuid": "1fd0e774-8608-43a4-80c7-1170ac7ec460", 00:15:13.945 "base_bdev": "aio_bdev", 00:15:13.945 "thin_provision": false, 00:15:13.945 "snapshot": false, 00:15:13.945 "clone": false, 00:15:13.945 "esnap_clone": false 00:15:13.945 } 00:15:13.945 } 00:15:13.945 } 00:15:13.946 ] 00:15:13.946 20:16:18 -- common/autotest_common.sh@905 -- # return 0 00:15:13.946 20:16:18 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:13.946 20:16:18 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:14.204 20:16:19 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:14.204 20:16:19 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:14.204 20:16:19 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:14.462 20:16:19 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:14.462 20:16:19 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 118df3dc-b6cc-4e40-ba2a-7065e786d39c 00:15:14.721 20:16:19 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1fd0e774-8608-43a4-80c7-1170ac7ec460 00:15:14.981 20:16:19 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:15.261 20:16:20 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:15.261 00:15:15.261 real 0m20.285s 00:15:15.262 user 0m51.080s 00:15:15.262 sys 0m4.606s 00:15:15.262 20:16:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:15.262 20:16:20 -- common/autotest_common.sh@10 -- # set +x 00:15:15.262 ************************************ 00:15:15.262 END TEST lvs_grow_dirty 00:15:15.262 ************************************ 00:15:15.262 20:16:20 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:15.262 20:16:20 -- common/autotest_common.sh@806 -- # type=--id 00:15:15.262 20:16:20 -- common/autotest_common.sh@807 -- # id=0 00:15:15.262 20:16:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:15.262 20:16:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:15.262 20:16:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:15.262 20:16:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:15.262 20:16:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:15.262 20:16:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:15.262 nvmf_trace.0 00:15:15.262 20:16:20 -- common/autotest_common.sh@821 -- # return 0 00:15:15.262 20:16:20 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:15.262 20:16:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:15.262 20:16:20 -- nvmf/common.sh@116 -- # sync 00:15:15.262 20:16:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:15.262 20:16:20 -- nvmf/common.sh@119 -- # set +e 00:15:15.262 20:16:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:15.262 20:16:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:15.262 rmmod nvme_tcp 00:15:15.262 rmmod nvme_fabrics 00:15:15.262 rmmod nvme_keyring 00:15:15.262 20:16:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:15.262 20:16:20 -- nvmf/common.sh@123 -- # set -e 00:15:15.262 20:16:20 -- nvmf/common.sh@124 -- # return 0 00:15:15.262 20:16:20 -- nvmf/common.sh@477 -- # '[' -n 3145219 ']' 00:15:15.262 20:16:20 -- nvmf/common.sh@478 -- # killprocess 3145219 00:15:15.262 20:16:20 -- common/autotest_common.sh@936 -- # '[' -z 3145219 ']' 00:15:15.262 20:16:20 -- common/autotest_common.sh@940 -- # kill -0 3145219 00:15:15.262 20:16:20 -- common/autotest_common.sh@941 -- # uname 00:15:15.262 20:16:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:15.262 20:16:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3145219 00:15:15.262 20:16:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:15.262 20:16:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:15.262 20:16:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3145219' 00:15:15.262 killing process with pid 3145219 00:15:15.262 20:16:20 -- common/autotest_common.sh@955 -- # kill 3145219 00:15:15.262 20:16:20 -- common/autotest_common.sh@960 -- # wait 3145219 00:15:15.634 20:16:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:15.634 20:16:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:15.634 20:16:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:15.634 20:16:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:15.634 20:16:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:15.634 20:16:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:15.634 20:16:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:15.634 20:16:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:17.546 20:16:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:17.806 00:15:17.806 real 0m44.376s 00:15:17.806 user 1m15.570s 00:15:17.806 sys 0m8.320s 00:15:17.806 20:16:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:17.806 20:16:22 -- common/autotest_common.sh@10 -- # set +x 00:15:17.806 ************************************ 00:15:17.806 END TEST nvmf_lvs_grow 00:15:17.806 ************************************ 00:15:17.806 20:16:22 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:17.806 20:16:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:17.806 20:16:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:17.806 20:16:22 -- common/autotest_common.sh@10 -- # set +x 00:15:17.806 ************************************ 00:15:17.806 START TEST nvmf_bdev_io_wait 00:15:17.806 ************************************ 00:15:17.806 20:16:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:17.806 * Looking for test storage... 00:15:17.806 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:17.806 20:16:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:17.806 20:16:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:17.806 20:16:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:17.806 20:16:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:17.806 20:16:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:17.806 20:16:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:17.806 20:16:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:17.806 20:16:22 -- scripts/common.sh@335 -- # IFS=.-: 00:15:17.806 20:16:22 -- scripts/common.sh@335 -- # read -ra ver1 00:15:17.806 20:16:22 -- scripts/common.sh@336 -- # IFS=.-: 00:15:17.806 20:16:22 -- scripts/common.sh@336 -- # read -ra ver2 00:15:17.806 20:16:22 -- scripts/common.sh@337 -- # local 'op=<' 00:15:17.806 20:16:22 -- scripts/common.sh@339 -- # ver1_l=2 00:15:17.806 20:16:22 -- scripts/common.sh@340 -- # ver2_l=1 00:15:17.806 20:16:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:17.806 20:16:22 -- scripts/common.sh@343 -- # case "$op" in 00:15:17.806 20:16:22 -- scripts/common.sh@344 -- # : 1 00:15:17.806 20:16:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:17.806 20:16:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:17.806 20:16:22 -- scripts/common.sh@364 -- # decimal 1 00:15:17.806 20:16:22 -- scripts/common.sh@352 -- # local d=1 00:15:17.806 20:16:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:17.806 20:16:22 -- scripts/common.sh@354 -- # echo 1 00:15:17.806 20:16:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:17.806 20:16:22 -- scripts/common.sh@365 -- # decimal 2 00:15:17.806 20:16:22 -- scripts/common.sh@352 -- # local d=2 00:15:17.806 20:16:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:17.806 20:16:22 -- scripts/common.sh@354 -- # echo 2 00:15:17.806 20:16:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:17.806 20:16:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:17.806 20:16:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:17.806 20:16:22 -- scripts/common.sh@367 -- # return 0 00:15:17.806 20:16:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:17.806 20:16:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:17.806 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.806 --rc genhtml_branch_coverage=1 00:15:17.806 --rc genhtml_function_coverage=1 00:15:17.806 --rc genhtml_legend=1 00:15:17.806 --rc geninfo_all_blocks=1 00:15:17.806 --rc geninfo_unexecuted_blocks=1 00:15:17.806 00:15:17.806 ' 00:15:17.806 20:16:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:17.806 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.806 --rc genhtml_branch_coverage=1 00:15:17.806 --rc genhtml_function_coverage=1 00:15:17.806 --rc genhtml_legend=1 00:15:17.806 --rc geninfo_all_blocks=1 00:15:17.806 --rc geninfo_unexecuted_blocks=1 00:15:17.806 00:15:17.806 ' 00:15:17.806 20:16:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:17.806 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.806 --rc genhtml_branch_coverage=1 00:15:17.806 --rc genhtml_function_coverage=1 00:15:17.806 --rc genhtml_legend=1 00:15:17.806 --rc geninfo_all_blocks=1 00:15:17.806 --rc geninfo_unexecuted_blocks=1 00:15:17.806 00:15:17.806 ' 00:15:17.806 20:16:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:17.806 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.806 --rc genhtml_branch_coverage=1 00:15:17.806 --rc genhtml_function_coverage=1 00:15:17.806 --rc genhtml_legend=1 00:15:17.806 --rc geninfo_all_blocks=1 00:15:17.806 --rc geninfo_unexecuted_blocks=1 00:15:17.806 00:15:17.806 ' 00:15:17.806 20:16:22 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:17.806 20:16:22 -- nvmf/common.sh@7 -- # uname -s 00:15:17.806 20:16:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:17.806 20:16:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:17.806 20:16:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:17.806 20:16:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:17.806 20:16:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:17.806 20:16:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:17.806 20:16:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:17.806 20:16:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:17.806 20:16:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:17.806 20:16:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:17.806 20:16:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:17.806 20:16:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:17.806 20:16:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:17.806 20:16:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:17.806 20:16:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:17.806 20:16:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:17.806 20:16:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:17.806 20:16:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:17.806 20:16:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:17.806 20:16:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.807 20:16:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.807 20:16:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.807 20:16:22 -- paths/export.sh@5 -- # export PATH 00:15:17.807 20:16:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.807 20:16:22 -- nvmf/common.sh@46 -- # : 0 00:15:17.807 20:16:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:17.807 20:16:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:17.807 20:16:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:17.807 20:16:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:17.807 20:16:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:17.807 20:16:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:17.807 20:16:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:17.807 20:16:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:17.807 20:16:22 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:17.807 20:16:22 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:17.807 20:16:22 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:17.807 20:16:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:17.807 20:16:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:17.807 20:16:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:17.807 20:16:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:17.807 20:16:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:17.807 20:16:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.807 20:16:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:17.807 20:16:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:17.807 20:16:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:17.807 20:16:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:17.807 20:16:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:17.807 20:16:22 -- common/autotest_common.sh@10 -- # set +x 00:15:20.346 20:16:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:20.346 20:16:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:20.346 20:16:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:20.346 20:16:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:20.346 20:16:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:20.346 20:16:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:20.346 20:16:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:20.346 20:16:24 -- nvmf/common.sh@294 -- # net_devs=() 00:15:20.346 20:16:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:20.346 20:16:24 -- nvmf/common.sh@295 -- # e810=() 00:15:20.346 20:16:24 -- nvmf/common.sh@295 -- # local -ga e810 00:15:20.346 20:16:24 -- nvmf/common.sh@296 -- # x722=() 00:15:20.346 20:16:24 -- nvmf/common.sh@296 -- # local -ga x722 00:15:20.346 20:16:24 -- nvmf/common.sh@297 -- # mlx=() 00:15:20.346 20:16:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:20.346 20:16:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:20.346 20:16:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:20.346 20:16:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:20.346 20:16:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:20.346 20:16:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.346 20:16:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:20.346 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:20.346 20:16:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.346 20:16:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:20.346 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:20.346 20:16:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:20.346 20:16:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.346 20:16:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.346 20:16:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.346 20:16:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.346 20:16:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:20.346 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:20.346 20:16:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.346 20:16:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.346 20:16:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.346 20:16:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.346 20:16:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.346 20:16:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:20.346 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:20.346 20:16:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.346 20:16:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:20.346 20:16:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:20.346 20:16:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:20.346 20:16:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:20.346 20:16:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:20.346 20:16:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:20.346 20:16:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:20.346 20:16:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:20.346 20:16:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:20.346 20:16:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:20.346 20:16:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:20.346 20:16:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:20.346 20:16:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:20.346 20:16:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:20.346 20:16:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:20.346 20:16:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:20.346 20:16:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:20.346 20:16:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:20.346 20:16:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:20.346 20:16:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:20.346 20:16:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:20.346 20:16:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:20.346 20:16:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:20.346 20:16:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:20.346 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:20.346 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:15:20.346 00:15:20.346 --- 10.0.0.2 ping statistics --- 00:15:20.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.346 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:15:20.346 20:16:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:20.346 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:20.346 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:15:20.346 00:15:20.346 --- 10.0.0.1 ping statistics --- 00:15:20.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.346 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:15:20.346 20:16:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:20.346 20:16:25 -- nvmf/common.sh@410 -- # return 0 00:15:20.346 20:16:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:20.346 20:16:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:20.346 20:16:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:20.346 20:16:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:20.346 20:16:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:20.346 20:16:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:20.346 20:16:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:20.346 20:16:25 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:20.346 20:16:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:20.346 20:16:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:20.346 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.346 20:16:25 -- nvmf/common.sh@469 -- # nvmfpid=3147901 00:15:20.346 20:16:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:20.346 20:16:25 -- nvmf/common.sh@470 -- # waitforlisten 3147901 00:15:20.346 20:16:25 -- common/autotest_common.sh@829 -- # '[' -z 3147901 ']' 00:15:20.346 20:16:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:20.346 20:16:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:20.346 20:16:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:20.346 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:20.346 20:16:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:20.346 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.346 [2024-11-20 20:16:25.169885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.347 [2024-11-20 20:16:25.169973] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:20.347 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.347 [2024-11-20 20:16:25.245390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:20.347 [2024-11-20 20:16:25.372468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:20.347 [2024-11-20 20:16:25.372626] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:20.347 [2024-11-20 20:16:25.372646] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:20.347 [2024-11-20 20:16:25.372661] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:20.347 [2024-11-20 20:16:25.372722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:20.347 [2024-11-20 20:16:25.372782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:20.347 [2024-11-20 20:16:25.375092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:20.347 [2024-11-20 20:16:25.375106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:20.606 20:16:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:20.606 20:16:25 -- common/autotest_common.sh@862 -- # return 0 00:15:20.606 20:16:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:20.606 20:16:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 20:16:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 [2024-11-20 20:16:25.536160] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 Malloc0 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:20.606 20:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.606 20:16:25 -- common/autotest_common.sh@10 -- # set +x 00:15:20.606 [2024-11-20 20:16:25.596831] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:20.606 20:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3147940 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@30 -- # READ_PID=3147941 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # config=() 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3147944 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:20.606 20:16:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:20.606 20:16:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.606 { 00:15:20.606 "params": { 00:15:20.606 "name": "Nvme$subsystem", 00:15:20.606 "trtype": "$TEST_TRANSPORT", 00:15:20.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.606 "adrfam": "ipv4", 00:15:20.606 "trsvcid": "$NVMF_PORT", 00:15:20.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.606 "hdgst": ${hdgst:-false}, 00:15:20.606 "ddgst": ${ddgst:-false} 00:15:20.606 }, 00:15:20.606 "method": "bdev_nvme_attach_controller" 00:15:20.606 } 00:15:20.606 EOF 00:15:20.606 )") 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # config=() 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.606 20:16:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3147946 00:15:20.606 20:16:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.606 { 00:15:20.606 "params": { 00:15:20.606 "name": "Nvme$subsystem", 00:15:20.606 "trtype": "$TEST_TRANSPORT", 00:15:20.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.606 "adrfam": "ipv4", 00:15:20.606 "trsvcid": "$NVMF_PORT", 00:15:20.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.606 "hdgst": ${hdgst:-false}, 00:15:20.606 "ddgst": ${ddgst:-false} 00:15:20.606 }, 00:15:20.606 "method": "bdev_nvme_attach_controller" 00:15:20.606 } 00:15:20.606 EOF 00:15:20.606 )") 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@35 -- # sync 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # config=() 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:20.606 20:16:25 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:20.606 20:16:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.606 20:16:25 -- nvmf/common.sh@542 -- # cat 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # config=() 00:15:20.606 20:16:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.606 { 00:15:20.606 "params": { 00:15:20.606 "name": "Nvme$subsystem", 00:15:20.606 "trtype": "$TEST_TRANSPORT", 00:15:20.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.606 "adrfam": "ipv4", 00:15:20.606 "trsvcid": "$NVMF_PORT", 00:15:20.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.606 "hdgst": ${hdgst:-false}, 00:15:20.606 "ddgst": ${ddgst:-false} 00:15:20.606 }, 00:15:20.606 "method": "bdev_nvme_attach_controller" 00:15:20.606 } 00:15:20.606 EOF 00:15:20.606 )") 00:15:20.606 20:16:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.606 20:16:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.606 20:16:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.606 { 00:15:20.606 "params": { 00:15:20.606 "name": "Nvme$subsystem", 00:15:20.606 "trtype": "$TEST_TRANSPORT", 00:15:20.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.606 "adrfam": "ipv4", 00:15:20.606 "trsvcid": "$NVMF_PORT", 00:15:20.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.607 "hdgst": ${hdgst:-false}, 00:15:20.607 "ddgst": ${ddgst:-false} 00:15:20.607 }, 00:15:20.607 "method": "bdev_nvme_attach_controller" 00:15:20.607 } 00:15:20.607 EOF 00:15:20.607 )") 00:15:20.607 20:16:25 -- nvmf/common.sh@542 -- # cat 00:15:20.607 20:16:25 -- nvmf/common.sh@542 -- # cat 00:15:20.607 20:16:25 -- nvmf/common.sh@542 -- # cat 00:15:20.607 20:16:25 -- target/bdev_io_wait.sh@37 -- # wait 3147940 00:15:20.607 20:16:25 -- nvmf/common.sh@544 -- # jq . 00:15:20.607 20:16:25 -- nvmf/common.sh@544 -- # jq . 00:15:20.607 20:16:25 -- nvmf/common.sh@544 -- # jq . 00:15:20.607 20:16:25 -- nvmf/common.sh@544 -- # jq . 00:15:20.607 20:16:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.607 20:16:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.607 "params": { 00:15:20.607 "name": "Nvme1", 00:15:20.607 "trtype": "tcp", 00:15:20.607 "traddr": "10.0.0.2", 00:15:20.607 "adrfam": "ipv4", 00:15:20.607 "trsvcid": "4420", 00:15:20.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.607 "hdgst": false, 00:15:20.607 "ddgst": false 00:15:20.607 }, 00:15:20.607 "method": "bdev_nvme_attach_controller" 00:15:20.607 }' 00:15:20.607 20:16:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.607 20:16:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.607 "params": { 00:15:20.607 "name": "Nvme1", 00:15:20.607 "trtype": "tcp", 00:15:20.607 "traddr": "10.0.0.2", 00:15:20.607 "adrfam": "ipv4", 00:15:20.607 "trsvcid": "4420", 00:15:20.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.607 "hdgst": false, 00:15:20.607 "ddgst": false 00:15:20.607 }, 00:15:20.607 "method": "bdev_nvme_attach_controller" 00:15:20.607 }' 00:15:20.607 20:16:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.607 20:16:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.607 "params": { 00:15:20.607 "name": "Nvme1", 00:15:20.607 "trtype": "tcp", 00:15:20.607 "traddr": "10.0.0.2", 00:15:20.607 "adrfam": "ipv4", 00:15:20.607 "trsvcid": "4420", 00:15:20.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.607 "hdgst": false, 00:15:20.607 "ddgst": false 00:15:20.607 }, 00:15:20.607 "method": "bdev_nvme_attach_controller" 00:15:20.607 }' 00:15:20.607 20:16:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.607 20:16:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.607 "params": { 00:15:20.607 "name": "Nvme1", 00:15:20.607 "trtype": "tcp", 00:15:20.607 "traddr": "10.0.0.2", 00:15:20.607 "adrfam": "ipv4", 00:15:20.607 "trsvcid": "4420", 00:15:20.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.607 "hdgst": false, 00:15:20.607 "ddgst": false 00:15:20.607 }, 00:15:20.607 "method": "bdev_nvme_attach_controller" 00:15:20.607 }' 00:15:20.607 [2024-11-20 20:16:25.640445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.607 [2024-11-20 20:16:25.640446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.607 [2024-11-20 20:16:25.640445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.607 [2024-11-20 20:16:25.640461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.607 [2024-11-20 20:16:25.640536] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 20:16:25.640539] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 20:16:25.640537] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 20:16:25.640537] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:20.607 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:20.607 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:20.607 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:20.866 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.866 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.866 [2024-11-20 20:16:25.822135] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:20.866 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.126 [2024-11-20 20:16:25.918426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:21.126 [2024-11-20 20:16:25.920396] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.126 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.126 [2024-11-20 20:16:26.014688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:21.126 [2024-11-20 20:16:26.021111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.126 [2024-11-20 20:16:26.117643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:21.126 [2024-11-20 20:16:26.119518] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.385 [2024-11-20 20:16:26.219537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:21.385 Running I/O for 1 seconds... 00:15:21.644 Running I/O for 1 seconds... 00:15:21.644 Running I/O for 1 seconds... 00:15:21.644 Running I/O for 1 seconds... 00:15:22.580 00:15:22.580 Latency(us) 00:15:22.580 [2024-11-20T19:16:27.619Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.580 [2024-11-20T19:16:27.619Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:22.580 Nvme1n1 : 1.02 6188.06 24.17 0.00 0.00 20535.69 8543.95 32039.82 00:15:22.580 [2024-11-20T19:16:27.619Z] =================================================================================================================== 00:15:22.580 [2024-11-20T19:16:27.619Z] Total : 6188.06 24.17 0.00 0.00 20535.69 8543.95 32039.82 00:15:22.580 00:15:22.580 Latency(us) 00:15:22.580 [2024-11-20T19:16:27.619Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.580 [2024-11-20T19:16:27.619Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:22.580 Nvme1n1 : 1.00 202189.68 789.80 0.00 0.00 630.64 260.93 849.54 00:15:22.580 [2024-11-20T19:16:27.619Z] =================================================================================================================== 00:15:22.580 [2024-11-20T19:16:27.619Z] Total : 202189.68 789.80 0.00 0.00 630.64 260.93 849.54 00:15:22.580 00:15:22.581 Latency(us) 00:15:22.581 [2024-11-20T19:16:27.620Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.581 [2024-11-20T19:16:27.620Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:22.581 Nvme1n1 : 1.01 5655.02 22.09 0.00 0.00 22520.07 9903.22 44661.57 00:15:22.581 [2024-11-20T19:16:27.620Z] =================================================================================================================== 00:15:22.581 [2024-11-20T19:16:27.620Z] Total : 5655.02 22.09 0.00 0.00 22520.07 9903.22 44661.57 00:15:22.581 00:15:22.581 Latency(us) 00:15:22.581 [2024-11-20T19:16:27.620Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.581 [2024-11-20T19:16:27.620Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:22.581 Nvme1n1 : 1.01 10860.65 42.42 0.00 0.00 11743.71 5971.06 23981.32 00:15:22.581 [2024-11-20T19:16:27.620Z] =================================================================================================================== 00:15:22.581 [2024-11-20T19:16:27.620Z] Total : 10860.65 42.42 0.00 0.00 11743.71 5971.06 23981.32 00:15:22.841 20:16:27 -- target/bdev_io_wait.sh@38 -- # wait 3147941 00:15:22.841 20:16:27 -- target/bdev_io_wait.sh@39 -- # wait 3147944 00:15:22.841 20:16:27 -- target/bdev_io_wait.sh@40 -- # wait 3147946 00:15:23.101 20:16:27 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:23.101 20:16:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.101 20:16:27 -- common/autotest_common.sh@10 -- # set +x 00:15:23.101 20:16:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.101 20:16:27 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:23.101 20:16:27 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:23.102 20:16:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:23.102 20:16:27 -- nvmf/common.sh@116 -- # sync 00:15:23.102 20:16:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:23.102 20:16:27 -- nvmf/common.sh@119 -- # set +e 00:15:23.102 20:16:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:23.102 20:16:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:23.102 rmmod nvme_tcp 00:15:23.102 rmmod nvme_fabrics 00:15:23.102 rmmod nvme_keyring 00:15:23.102 20:16:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:23.102 20:16:27 -- nvmf/common.sh@123 -- # set -e 00:15:23.102 20:16:27 -- nvmf/common.sh@124 -- # return 0 00:15:23.102 20:16:27 -- nvmf/common.sh@477 -- # '[' -n 3147901 ']' 00:15:23.102 20:16:27 -- nvmf/common.sh@478 -- # killprocess 3147901 00:15:23.102 20:16:27 -- common/autotest_common.sh@936 -- # '[' -z 3147901 ']' 00:15:23.102 20:16:27 -- common/autotest_common.sh@940 -- # kill -0 3147901 00:15:23.102 20:16:27 -- common/autotest_common.sh@941 -- # uname 00:15:23.102 20:16:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:23.102 20:16:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3147901 00:15:23.102 20:16:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:23.102 20:16:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:23.102 20:16:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3147901' 00:15:23.102 killing process with pid 3147901 00:15:23.102 20:16:27 -- common/autotest_common.sh@955 -- # kill 3147901 00:15:23.102 20:16:27 -- common/autotest_common.sh@960 -- # wait 3147901 00:15:23.361 20:16:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:23.361 20:16:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:23.361 20:16:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:23.361 20:16:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:23.361 20:16:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:23.361 20:16:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:23.361 20:16:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:23.361 20:16:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.268 20:16:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:25.268 00:15:25.268 real 0m7.681s 00:15:25.268 user 0m17.822s 00:15:25.268 sys 0m3.666s 00:15:25.268 20:16:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:25.268 20:16:30 -- common/autotest_common.sh@10 -- # set +x 00:15:25.268 ************************************ 00:15:25.268 END TEST nvmf_bdev_io_wait 00:15:25.268 ************************************ 00:15:25.529 20:16:30 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:25.529 20:16:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:25.529 20:16:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:25.529 20:16:30 -- common/autotest_common.sh@10 -- # set +x 00:15:25.529 ************************************ 00:15:25.529 START TEST nvmf_queue_depth 00:15:25.529 ************************************ 00:15:25.529 20:16:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:25.529 * Looking for test storage... 00:15:25.529 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:25.529 20:16:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:25.529 20:16:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:25.529 20:16:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:25.529 20:16:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:25.529 20:16:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:25.529 20:16:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:25.529 20:16:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:25.529 20:16:30 -- scripts/common.sh@335 -- # IFS=.-: 00:15:25.529 20:16:30 -- scripts/common.sh@335 -- # read -ra ver1 00:15:25.529 20:16:30 -- scripts/common.sh@336 -- # IFS=.-: 00:15:25.529 20:16:30 -- scripts/common.sh@336 -- # read -ra ver2 00:15:25.529 20:16:30 -- scripts/common.sh@337 -- # local 'op=<' 00:15:25.529 20:16:30 -- scripts/common.sh@339 -- # ver1_l=2 00:15:25.529 20:16:30 -- scripts/common.sh@340 -- # ver2_l=1 00:15:25.529 20:16:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:25.529 20:16:30 -- scripts/common.sh@343 -- # case "$op" in 00:15:25.529 20:16:30 -- scripts/common.sh@344 -- # : 1 00:15:25.529 20:16:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:25.529 20:16:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:25.529 20:16:30 -- scripts/common.sh@364 -- # decimal 1 00:15:25.529 20:16:30 -- scripts/common.sh@352 -- # local d=1 00:15:25.529 20:16:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:25.529 20:16:30 -- scripts/common.sh@354 -- # echo 1 00:15:25.529 20:16:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:25.529 20:16:30 -- scripts/common.sh@365 -- # decimal 2 00:15:25.529 20:16:30 -- scripts/common.sh@352 -- # local d=2 00:15:25.529 20:16:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:25.529 20:16:30 -- scripts/common.sh@354 -- # echo 2 00:15:25.529 20:16:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:25.529 20:16:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:25.529 20:16:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:25.529 20:16:30 -- scripts/common.sh@367 -- # return 0 00:15:25.529 20:16:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:25.529 20:16:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:25.529 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.529 --rc genhtml_branch_coverage=1 00:15:25.529 --rc genhtml_function_coverage=1 00:15:25.529 --rc genhtml_legend=1 00:15:25.529 --rc geninfo_all_blocks=1 00:15:25.529 --rc geninfo_unexecuted_blocks=1 00:15:25.529 00:15:25.529 ' 00:15:25.529 20:16:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:25.529 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.529 --rc genhtml_branch_coverage=1 00:15:25.529 --rc genhtml_function_coverage=1 00:15:25.529 --rc genhtml_legend=1 00:15:25.529 --rc geninfo_all_blocks=1 00:15:25.529 --rc geninfo_unexecuted_blocks=1 00:15:25.529 00:15:25.529 ' 00:15:25.529 20:16:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:25.529 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.529 --rc genhtml_branch_coverage=1 00:15:25.529 --rc genhtml_function_coverage=1 00:15:25.529 --rc genhtml_legend=1 00:15:25.529 --rc geninfo_all_blocks=1 00:15:25.529 --rc geninfo_unexecuted_blocks=1 00:15:25.529 00:15:25.529 ' 00:15:25.529 20:16:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:25.529 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.529 --rc genhtml_branch_coverage=1 00:15:25.529 --rc genhtml_function_coverage=1 00:15:25.529 --rc genhtml_legend=1 00:15:25.529 --rc geninfo_all_blocks=1 00:15:25.529 --rc geninfo_unexecuted_blocks=1 00:15:25.529 00:15:25.529 ' 00:15:25.529 20:16:30 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:25.529 20:16:30 -- nvmf/common.sh@7 -- # uname -s 00:15:25.529 20:16:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:25.529 20:16:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:25.529 20:16:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:25.529 20:16:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:25.529 20:16:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:25.529 20:16:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:25.529 20:16:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:25.529 20:16:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:25.529 20:16:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:25.529 20:16:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:25.529 20:16:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.529 20:16:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.529 20:16:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:25.529 20:16:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:25.529 20:16:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:25.529 20:16:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:25.529 20:16:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:25.529 20:16:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:25.529 20:16:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:25.529 20:16:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.530 20:16:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.530 20:16:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.530 20:16:30 -- paths/export.sh@5 -- # export PATH 00:15:25.530 20:16:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.530 20:16:30 -- nvmf/common.sh@46 -- # : 0 00:15:25.530 20:16:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:25.530 20:16:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:25.530 20:16:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:25.530 20:16:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:25.530 20:16:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:25.530 20:16:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:25.530 20:16:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:25.530 20:16:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:25.530 20:16:30 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:25.530 20:16:30 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:25.530 20:16:30 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:25.530 20:16:30 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:25.530 20:16:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:25.530 20:16:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:25.530 20:16:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:25.530 20:16:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:25.530 20:16:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:25.530 20:16:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.530 20:16:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:25.530 20:16:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.530 20:16:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:25.530 20:16:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:25.530 20:16:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:25.530 20:16:30 -- common/autotest_common.sh@10 -- # set +x 00:15:28.070 20:16:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:28.070 20:16:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:28.070 20:16:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:28.070 20:16:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:28.070 20:16:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:28.070 20:16:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:28.070 20:16:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:28.070 20:16:32 -- nvmf/common.sh@294 -- # net_devs=() 00:15:28.070 20:16:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:28.070 20:16:32 -- nvmf/common.sh@295 -- # e810=() 00:15:28.070 20:16:32 -- nvmf/common.sh@295 -- # local -ga e810 00:15:28.070 20:16:32 -- nvmf/common.sh@296 -- # x722=() 00:15:28.070 20:16:32 -- nvmf/common.sh@296 -- # local -ga x722 00:15:28.070 20:16:32 -- nvmf/common.sh@297 -- # mlx=() 00:15:28.070 20:16:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:28.070 20:16:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:28.070 20:16:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:28.070 20:16:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:28.070 20:16:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:28.070 20:16:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:28.070 20:16:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:28.070 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:28.070 20:16:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:28.070 20:16:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:28.070 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:28.070 20:16:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:28.070 20:16:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:28.070 20:16:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.070 20:16:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:28.070 20:16:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.070 20:16:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:28.070 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:28.070 20:16:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.070 20:16:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:28.070 20:16:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.070 20:16:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:28.070 20:16:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.070 20:16:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:28.070 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:28.070 20:16:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.070 20:16:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:28.070 20:16:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:28.070 20:16:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:28.070 20:16:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:28.070 20:16:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:28.070 20:16:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:28.070 20:16:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:28.070 20:16:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:28.070 20:16:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:28.070 20:16:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:28.070 20:16:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:28.070 20:16:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:28.070 20:16:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:28.070 20:16:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:28.070 20:16:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:28.070 20:16:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:28.070 20:16:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:28.070 20:16:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:28.070 20:16:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:28.070 20:16:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:28.070 20:16:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:28.070 20:16:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:28.070 20:16:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:28.070 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:28.070 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:15:28.070 00:15:28.070 --- 10.0.0.2 ping statistics --- 00:15:28.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:28.070 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:15:28.070 20:16:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:28.070 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:28.070 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:15:28.070 00:15:28.070 --- 10.0.0.1 ping statistics --- 00:15:28.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:28.070 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:15:28.070 20:16:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:28.070 20:16:32 -- nvmf/common.sh@410 -- # return 0 00:15:28.070 20:16:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:28.070 20:16:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:28.070 20:16:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:28.070 20:16:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:28.070 20:16:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:28.070 20:16:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:28.070 20:16:32 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:28.070 20:16:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:28.070 20:16:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:28.070 20:16:32 -- common/autotest_common.sh@10 -- # set +x 00:15:28.070 20:16:32 -- nvmf/common.sh@469 -- # nvmfpid=3150305 00:15:28.070 20:16:32 -- nvmf/common.sh@470 -- # waitforlisten 3150305 00:15:28.070 20:16:32 -- common/autotest_common.sh@829 -- # '[' -z 3150305 ']' 00:15:28.070 20:16:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:28.070 20:16:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:28.070 20:16:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:28.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:28.071 20:16:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:28.071 20:16:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:28.071 20:16:32 -- common/autotest_common.sh@10 -- # set +x 00:15:28.071 [2024-11-20 20:16:32.794843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:28.071 [2024-11-20 20:16:32.794930] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:28.071 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.071 [2024-11-20 20:16:32.860977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:28.071 [2024-11-20 20:16:32.965324] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:28.071 [2024-11-20 20:16:32.965484] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:28.071 [2024-11-20 20:16:32.965500] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:28.071 [2024-11-20 20:16:32.965513] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:28.071 [2024-11-20 20:16:32.965540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:29.009 20:16:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.009 20:16:33 -- common/autotest_common.sh@862 -- # return 0 00:15:29.009 20:16:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:29.009 20:16:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 20:16:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:29.009 20:16:33 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:29.009 20:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 [2024-11-20 20:16:33.834246] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:29.009 20:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.009 20:16:33 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:29.009 20:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 Malloc0 00:15:29.009 20:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.009 20:16:33 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:29.009 20:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 20:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.009 20:16:33 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:29.009 20:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 20:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.009 20:16:33 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:29.009 20:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 [2024-11-20 20:16:33.895941] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:29.009 20:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.009 20:16:33 -- target/queue_depth.sh@30 -- # bdevperf_pid=3150463 00:15:29.009 20:16:33 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:29.009 20:16:33 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:29.009 20:16:33 -- target/queue_depth.sh@33 -- # waitforlisten 3150463 /var/tmp/bdevperf.sock 00:15:29.009 20:16:33 -- common/autotest_common.sh@829 -- # '[' -z 3150463 ']' 00:15:29.009 20:16:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:29.009 20:16:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:29.009 20:16:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:29.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:29.009 20:16:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:29.009 20:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:29.009 [2024-11-20 20:16:33.938287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.009 [2024-11-20 20:16:33.938351] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3150463 ] 00:15:29.009 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.009 [2024-11-20 20:16:34.000023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:29.267 [2024-11-20 20:16:34.114109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:30.203 20:16:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:30.203 20:16:34 -- common/autotest_common.sh@862 -- # return 0 00:15:30.203 20:16:34 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:30.203 20:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.203 20:16:34 -- common/autotest_common.sh@10 -- # set +x 00:15:30.203 NVMe0n1 00:15:30.203 20:16:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.203 20:16:35 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:30.203 Running I/O for 10 seconds... 00:15:42.411 00:15:42.411 Latency(us) 00:15:42.411 [2024-11-20T19:16:47.450Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.411 [2024-11-20T19:16:47.450Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:42.411 Verification LBA range: start 0x0 length 0x4000 00:15:42.411 NVMe0n1 : 10.07 12182.54 47.59 0.00 0.00 83718.54 15049.01 62914.56 00:15:42.411 [2024-11-20T19:16:47.450Z] =================================================================================================================== 00:15:42.411 [2024-11-20T19:16:47.450Z] Total : 12182.54 47.59 0.00 0.00 83718.54 15049.01 62914.56 00:15:42.411 0 00:15:42.411 20:16:45 -- target/queue_depth.sh@39 -- # killprocess 3150463 00:15:42.411 20:16:45 -- common/autotest_common.sh@936 -- # '[' -z 3150463 ']' 00:15:42.411 20:16:45 -- common/autotest_common.sh@940 -- # kill -0 3150463 00:15:42.411 20:16:45 -- common/autotest_common.sh@941 -- # uname 00:15:42.411 20:16:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:42.411 20:16:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150463 00:15:42.411 20:16:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:42.411 20:16:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:42.411 20:16:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150463' 00:15:42.411 killing process with pid 3150463 00:15:42.411 20:16:45 -- common/autotest_common.sh@955 -- # kill 3150463 00:15:42.411 Received shutdown signal, test time was about 10.000000 seconds 00:15:42.411 00:15:42.411 Latency(us) 00:15:42.411 [2024-11-20T19:16:47.450Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.411 [2024-11-20T19:16:47.450Z] =================================================================================================================== 00:15:42.411 [2024-11-20T19:16:47.450Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:42.411 20:16:45 -- common/autotest_common.sh@960 -- # wait 3150463 00:15:42.411 20:16:45 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:42.411 20:16:45 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:42.411 20:16:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:42.411 20:16:45 -- nvmf/common.sh@116 -- # sync 00:15:42.411 20:16:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:42.411 20:16:45 -- nvmf/common.sh@119 -- # set +e 00:15:42.411 20:16:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:42.411 20:16:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:42.411 rmmod nvme_tcp 00:15:42.411 rmmod nvme_fabrics 00:15:42.411 rmmod nvme_keyring 00:15:42.411 20:16:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:42.411 20:16:45 -- nvmf/common.sh@123 -- # set -e 00:15:42.411 20:16:45 -- nvmf/common.sh@124 -- # return 0 00:15:42.411 20:16:45 -- nvmf/common.sh@477 -- # '[' -n 3150305 ']' 00:15:42.411 20:16:45 -- nvmf/common.sh@478 -- # killprocess 3150305 00:15:42.411 20:16:45 -- common/autotest_common.sh@936 -- # '[' -z 3150305 ']' 00:15:42.411 20:16:45 -- common/autotest_common.sh@940 -- # kill -0 3150305 00:15:42.411 20:16:45 -- common/autotest_common.sh@941 -- # uname 00:15:42.411 20:16:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:42.411 20:16:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150305 00:15:42.411 20:16:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:42.411 20:16:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:42.411 20:16:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150305' 00:15:42.411 killing process with pid 3150305 00:15:42.411 20:16:45 -- common/autotest_common.sh@955 -- # kill 3150305 00:15:42.411 20:16:45 -- common/autotest_common.sh@960 -- # wait 3150305 00:15:42.411 20:16:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:42.411 20:16:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:42.411 20:16:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:42.411 20:16:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:42.411 20:16:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:42.411 20:16:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.411 20:16:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.411 20:16:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:43.350 20:16:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:43.350 00:15:43.350 real 0m17.706s 00:15:43.350 user 0m25.199s 00:15:43.350 sys 0m3.284s 00:15:43.350 20:16:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:43.350 20:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:43.350 ************************************ 00:15:43.350 END TEST nvmf_queue_depth 00:15:43.350 ************************************ 00:15:43.350 20:16:48 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:43.350 20:16:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:43.350 20:16:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:43.350 20:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:43.350 ************************************ 00:15:43.350 START TEST nvmf_multipath 00:15:43.350 ************************************ 00:15:43.350 20:16:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:43.350 * Looking for test storage... 00:15:43.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:43.350 20:16:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:43.350 20:16:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:43.350 20:16:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:43.350 20:16:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:43.350 20:16:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:43.350 20:16:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:43.350 20:16:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:43.350 20:16:48 -- scripts/common.sh@335 -- # IFS=.-: 00:15:43.350 20:16:48 -- scripts/common.sh@335 -- # read -ra ver1 00:15:43.350 20:16:48 -- scripts/common.sh@336 -- # IFS=.-: 00:15:43.350 20:16:48 -- scripts/common.sh@336 -- # read -ra ver2 00:15:43.350 20:16:48 -- scripts/common.sh@337 -- # local 'op=<' 00:15:43.350 20:16:48 -- scripts/common.sh@339 -- # ver1_l=2 00:15:43.350 20:16:48 -- scripts/common.sh@340 -- # ver2_l=1 00:15:43.350 20:16:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:43.350 20:16:48 -- scripts/common.sh@343 -- # case "$op" in 00:15:43.350 20:16:48 -- scripts/common.sh@344 -- # : 1 00:15:43.350 20:16:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:43.350 20:16:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:43.350 20:16:48 -- scripts/common.sh@364 -- # decimal 1 00:15:43.350 20:16:48 -- scripts/common.sh@352 -- # local d=1 00:15:43.350 20:16:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:43.350 20:16:48 -- scripts/common.sh@354 -- # echo 1 00:15:43.350 20:16:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:43.350 20:16:48 -- scripts/common.sh@365 -- # decimal 2 00:15:43.350 20:16:48 -- scripts/common.sh@352 -- # local d=2 00:15:43.350 20:16:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:43.350 20:16:48 -- scripts/common.sh@354 -- # echo 2 00:15:43.350 20:16:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:43.350 20:16:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:43.350 20:16:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:43.350 20:16:48 -- scripts/common.sh@367 -- # return 0 00:15:43.350 20:16:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:43.350 20:16:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:43.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:43.350 --rc genhtml_branch_coverage=1 00:15:43.350 --rc genhtml_function_coverage=1 00:15:43.350 --rc genhtml_legend=1 00:15:43.350 --rc geninfo_all_blocks=1 00:15:43.350 --rc geninfo_unexecuted_blocks=1 00:15:43.350 00:15:43.350 ' 00:15:43.350 20:16:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:43.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:43.350 --rc genhtml_branch_coverage=1 00:15:43.350 --rc genhtml_function_coverage=1 00:15:43.350 --rc genhtml_legend=1 00:15:43.350 --rc geninfo_all_blocks=1 00:15:43.350 --rc geninfo_unexecuted_blocks=1 00:15:43.350 00:15:43.350 ' 00:15:43.350 20:16:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:43.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:43.350 --rc genhtml_branch_coverage=1 00:15:43.350 --rc genhtml_function_coverage=1 00:15:43.351 --rc genhtml_legend=1 00:15:43.351 --rc geninfo_all_blocks=1 00:15:43.351 --rc geninfo_unexecuted_blocks=1 00:15:43.351 00:15:43.351 ' 00:15:43.351 20:16:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:43.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:43.351 --rc genhtml_branch_coverage=1 00:15:43.351 --rc genhtml_function_coverage=1 00:15:43.351 --rc genhtml_legend=1 00:15:43.351 --rc geninfo_all_blocks=1 00:15:43.351 --rc geninfo_unexecuted_blocks=1 00:15:43.351 00:15:43.351 ' 00:15:43.351 20:16:48 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:43.351 20:16:48 -- nvmf/common.sh@7 -- # uname -s 00:15:43.351 20:16:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:43.351 20:16:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:43.351 20:16:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:43.351 20:16:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:43.351 20:16:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:43.351 20:16:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:43.351 20:16:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:43.351 20:16:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:43.351 20:16:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:43.351 20:16:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:43.351 20:16:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:43.351 20:16:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:43.351 20:16:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:43.351 20:16:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:43.351 20:16:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:43.351 20:16:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:43.351 20:16:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:43.351 20:16:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:43.351 20:16:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:43.351 20:16:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:43.351 20:16:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:43.351 20:16:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:43.351 20:16:48 -- paths/export.sh@5 -- # export PATH 00:15:43.351 20:16:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:43.351 20:16:48 -- nvmf/common.sh@46 -- # : 0 00:15:43.351 20:16:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:43.351 20:16:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:43.351 20:16:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:43.351 20:16:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:43.351 20:16:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:43.351 20:16:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:43.351 20:16:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:43.351 20:16:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:43.351 20:16:48 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:43.351 20:16:48 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:43.351 20:16:48 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:43.351 20:16:48 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:43.351 20:16:48 -- target/multipath.sh@43 -- # nvmftestinit 00:15:43.351 20:16:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:43.351 20:16:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:43.351 20:16:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:43.351 20:16:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:43.351 20:16:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:43.351 20:16:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:43.351 20:16:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:43.351 20:16:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:43.351 20:16:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:43.351 20:16:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:43.351 20:16:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:43.351 20:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:45.259 20:16:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:45.259 20:16:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:45.259 20:16:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:45.259 20:16:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:45.259 20:16:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:45.259 20:16:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:45.259 20:16:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:45.259 20:16:50 -- nvmf/common.sh@294 -- # net_devs=() 00:15:45.259 20:16:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:45.259 20:16:50 -- nvmf/common.sh@295 -- # e810=() 00:15:45.259 20:16:50 -- nvmf/common.sh@295 -- # local -ga e810 00:15:45.259 20:16:50 -- nvmf/common.sh@296 -- # x722=() 00:15:45.259 20:16:50 -- nvmf/common.sh@296 -- # local -ga x722 00:15:45.259 20:16:50 -- nvmf/common.sh@297 -- # mlx=() 00:15:45.259 20:16:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:45.259 20:16:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:45.259 20:16:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:45.259 20:16:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:45.259 20:16:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:45.259 20:16:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:45.259 20:16:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:45.259 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:45.259 20:16:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:45.259 20:16:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:45.259 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:45.259 20:16:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:45.259 20:16:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:45.259 20:16:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:45.259 20:16:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:45.259 20:16:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:45.259 20:16:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:45.259 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:45.259 20:16:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:45.259 20:16:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:45.259 20:16:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:45.259 20:16:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:45.259 20:16:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:45.259 20:16:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:45.259 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:45.259 20:16:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:45.259 20:16:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:45.259 20:16:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:45.259 20:16:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:45.259 20:16:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:45.259 20:16:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:45.259 20:16:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:45.259 20:16:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:45.259 20:16:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:45.259 20:16:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:45.259 20:16:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:45.259 20:16:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:45.259 20:16:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:45.259 20:16:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:45.259 20:16:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:45.259 20:16:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:45.259 20:16:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:45.259 20:16:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:45.259 20:16:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:45.259 20:16:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:45.259 20:16:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:45.259 20:16:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:45.259 20:16:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:45.259 20:16:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:45.259 20:16:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:45.259 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:45.260 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:15:45.260 00:15:45.260 --- 10.0.0.2 ping statistics --- 00:15:45.260 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.260 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:15:45.260 20:16:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:45.260 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:45.260 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:15:45.260 00:15:45.260 --- 10.0.0.1 ping statistics --- 00:15:45.260 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.260 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:15:45.260 20:16:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:45.260 20:16:50 -- nvmf/common.sh@410 -- # return 0 00:15:45.260 20:16:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:45.260 20:16:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:45.260 20:16:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:45.260 20:16:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:45.260 20:16:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:45.260 20:16:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:45.260 20:16:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:45.260 20:16:50 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:45.260 20:16:50 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:45.260 only one NIC for nvmf test 00:15:45.260 20:16:50 -- target/multipath.sh@47 -- # nvmftestfini 00:15:45.260 20:16:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:45.260 20:16:50 -- nvmf/common.sh@116 -- # sync 00:15:45.260 20:16:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:45.260 20:16:50 -- nvmf/common.sh@119 -- # set +e 00:15:45.260 20:16:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:45.260 20:16:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:45.260 rmmod nvme_tcp 00:15:45.260 rmmod nvme_fabrics 00:15:45.260 rmmod nvme_keyring 00:15:45.260 20:16:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:45.260 20:16:50 -- nvmf/common.sh@123 -- # set -e 00:15:45.260 20:16:50 -- nvmf/common.sh@124 -- # return 0 00:15:45.260 20:16:50 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:45.260 20:16:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:45.260 20:16:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:45.260 20:16:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:45.260 20:16:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:45.260 20:16:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:45.260 20:16:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.260 20:16:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:45.260 20:16:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:47.803 20:16:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:47.803 20:16:52 -- target/multipath.sh@48 -- # exit 0 00:15:47.803 20:16:52 -- target/multipath.sh@1 -- # nvmftestfini 00:15:47.803 20:16:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:47.803 20:16:52 -- nvmf/common.sh@116 -- # sync 00:15:47.803 20:16:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:47.803 20:16:52 -- nvmf/common.sh@119 -- # set +e 00:15:47.803 20:16:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:47.803 20:16:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:47.803 20:16:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:47.803 20:16:52 -- nvmf/common.sh@123 -- # set -e 00:15:47.803 20:16:52 -- nvmf/common.sh@124 -- # return 0 00:15:47.803 20:16:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:47.803 20:16:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:47.803 20:16:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:47.803 20:16:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:47.803 20:16:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:47.803 20:16:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:47.803 20:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:47.803 20:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:47.803 20:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:47.803 20:16:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:47.803 00:15:47.803 real 0m4.256s 00:15:47.803 user 0m0.829s 00:15:47.803 sys 0m1.425s 00:15:47.804 20:16:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:47.804 20:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:47.804 ************************************ 00:15:47.804 END TEST nvmf_multipath 00:15:47.804 ************************************ 00:15:47.804 20:16:52 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:47.804 20:16:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:47.804 20:16:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:47.804 20:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:47.804 ************************************ 00:15:47.804 START TEST nvmf_zcopy 00:15:47.804 ************************************ 00:15:47.804 20:16:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:47.804 * Looking for test storage... 00:15:47.804 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:47.804 20:16:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:47.804 20:16:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:47.804 20:16:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:47.804 20:16:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:47.804 20:16:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:47.804 20:16:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:47.804 20:16:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:47.804 20:16:52 -- scripts/common.sh@335 -- # IFS=.-: 00:15:47.804 20:16:52 -- scripts/common.sh@335 -- # read -ra ver1 00:15:47.804 20:16:52 -- scripts/common.sh@336 -- # IFS=.-: 00:15:47.804 20:16:52 -- scripts/common.sh@336 -- # read -ra ver2 00:15:47.804 20:16:52 -- scripts/common.sh@337 -- # local 'op=<' 00:15:47.804 20:16:52 -- scripts/common.sh@339 -- # ver1_l=2 00:15:47.804 20:16:52 -- scripts/common.sh@340 -- # ver2_l=1 00:15:47.804 20:16:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:47.804 20:16:52 -- scripts/common.sh@343 -- # case "$op" in 00:15:47.804 20:16:52 -- scripts/common.sh@344 -- # : 1 00:15:47.804 20:16:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:47.804 20:16:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:47.804 20:16:52 -- scripts/common.sh@364 -- # decimal 1 00:15:47.804 20:16:52 -- scripts/common.sh@352 -- # local d=1 00:15:47.804 20:16:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:47.804 20:16:52 -- scripts/common.sh@354 -- # echo 1 00:15:47.804 20:16:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:47.804 20:16:52 -- scripts/common.sh@365 -- # decimal 2 00:15:47.804 20:16:52 -- scripts/common.sh@352 -- # local d=2 00:15:47.804 20:16:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:47.804 20:16:52 -- scripts/common.sh@354 -- # echo 2 00:15:47.804 20:16:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:47.804 20:16:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:47.804 20:16:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:47.804 20:16:52 -- scripts/common.sh@367 -- # return 0 00:15:47.804 20:16:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:47.804 20:16:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:47.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.804 --rc genhtml_branch_coverage=1 00:15:47.804 --rc genhtml_function_coverage=1 00:15:47.804 --rc genhtml_legend=1 00:15:47.804 --rc geninfo_all_blocks=1 00:15:47.804 --rc geninfo_unexecuted_blocks=1 00:15:47.804 00:15:47.804 ' 00:15:47.804 20:16:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:47.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.804 --rc genhtml_branch_coverage=1 00:15:47.804 --rc genhtml_function_coverage=1 00:15:47.804 --rc genhtml_legend=1 00:15:47.804 --rc geninfo_all_blocks=1 00:15:47.804 --rc geninfo_unexecuted_blocks=1 00:15:47.804 00:15:47.804 ' 00:15:47.804 20:16:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:47.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.804 --rc genhtml_branch_coverage=1 00:15:47.804 --rc genhtml_function_coverage=1 00:15:47.804 --rc genhtml_legend=1 00:15:47.804 --rc geninfo_all_blocks=1 00:15:47.804 --rc geninfo_unexecuted_blocks=1 00:15:47.804 00:15:47.804 ' 00:15:47.804 20:16:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:47.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.804 --rc genhtml_branch_coverage=1 00:15:47.804 --rc genhtml_function_coverage=1 00:15:47.804 --rc genhtml_legend=1 00:15:47.804 --rc geninfo_all_blocks=1 00:15:47.804 --rc geninfo_unexecuted_blocks=1 00:15:47.804 00:15:47.804 ' 00:15:47.804 20:16:52 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:47.804 20:16:52 -- nvmf/common.sh@7 -- # uname -s 00:15:47.804 20:16:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:47.804 20:16:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:47.804 20:16:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:47.804 20:16:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:47.804 20:16:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:47.804 20:16:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:47.804 20:16:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:47.804 20:16:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:47.804 20:16:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:47.804 20:16:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:47.804 20:16:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:47.804 20:16:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:47.804 20:16:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:47.804 20:16:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:47.804 20:16:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:47.804 20:16:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:47.804 20:16:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:47.804 20:16:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:47.804 20:16:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:47.804 20:16:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.804 20:16:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.804 20:16:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.804 20:16:52 -- paths/export.sh@5 -- # export PATH 00:15:47.804 20:16:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.804 20:16:52 -- nvmf/common.sh@46 -- # : 0 00:15:47.804 20:16:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:47.804 20:16:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:47.804 20:16:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:47.804 20:16:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:47.804 20:16:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:47.804 20:16:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:47.804 20:16:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:47.804 20:16:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:47.804 20:16:52 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:47.804 20:16:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:47.804 20:16:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:47.804 20:16:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:47.804 20:16:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:47.804 20:16:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:47.804 20:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:47.804 20:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:47.804 20:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:47.804 20:16:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:47.805 20:16:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:47.805 20:16:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:47.805 20:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:49.712 20:16:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:49.712 20:16:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:49.712 20:16:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:49.712 20:16:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:49.712 20:16:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:49.712 20:16:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:49.712 20:16:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:49.712 20:16:54 -- nvmf/common.sh@294 -- # net_devs=() 00:15:49.712 20:16:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:49.712 20:16:54 -- nvmf/common.sh@295 -- # e810=() 00:15:49.712 20:16:54 -- nvmf/common.sh@295 -- # local -ga e810 00:15:49.712 20:16:54 -- nvmf/common.sh@296 -- # x722=() 00:15:49.712 20:16:54 -- nvmf/common.sh@296 -- # local -ga x722 00:15:49.712 20:16:54 -- nvmf/common.sh@297 -- # mlx=() 00:15:49.712 20:16:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:49.712 20:16:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:49.712 20:16:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:49.712 20:16:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:49.712 20:16:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:49.712 20:16:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:49.712 20:16:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:49.712 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:49.712 20:16:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:49.712 20:16:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:49.712 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:49.712 20:16:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:49.712 20:16:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:49.712 20:16:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:49.712 20:16:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:49.713 20:16:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:49.713 20:16:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:49.713 20:16:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:49.713 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:49.713 20:16:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:49.713 20:16:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:49.713 20:16:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:49.713 20:16:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:49.713 20:16:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:49.713 20:16:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:49.713 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:49.713 20:16:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:49.713 20:16:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:49.713 20:16:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:49.713 20:16:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:49.713 20:16:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:49.713 20:16:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:49.713 20:16:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:49.713 20:16:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:49.713 20:16:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:49.713 20:16:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:49.713 20:16:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:49.713 20:16:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:49.713 20:16:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:49.713 20:16:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:49.713 20:16:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:49.713 20:16:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:49.713 20:16:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:49.713 20:16:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:49.713 20:16:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:49.713 20:16:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:49.713 20:16:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:49.713 20:16:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:49.713 20:16:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:49.713 20:16:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:49.713 20:16:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:49.713 20:16:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:49.713 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:49.713 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:15:49.713 00:15:49.713 --- 10.0.0.2 ping statistics --- 00:15:49.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.713 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:15:49.713 20:16:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:49.713 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:49.713 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:15:49.713 00:15:49.713 --- 10.0.0.1 ping statistics --- 00:15:49.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.713 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:15:49.713 20:16:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:49.713 20:16:54 -- nvmf/common.sh@410 -- # return 0 00:15:49.713 20:16:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:49.713 20:16:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:49.713 20:16:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:49.713 20:16:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:49.713 20:16:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:49.713 20:16:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:49.713 20:16:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:49.713 20:16:54 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:49.713 20:16:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:49.713 20:16:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:49.713 20:16:54 -- common/autotest_common.sh@10 -- # set +x 00:15:49.713 20:16:54 -- nvmf/common.sh@469 -- # nvmfpid=3155717 00:15:49.713 20:16:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:49.713 20:16:54 -- nvmf/common.sh@470 -- # waitforlisten 3155717 00:15:49.713 20:16:54 -- common/autotest_common.sh@829 -- # '[' -z 3155717 ']' 00:15:49.713 20:16:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:49.713 20:16:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:49.713 20:16:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:49.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:49.713 20:16:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:49.713 20:16:54 -- common/autotest_common.sh@10 -- # set +x 00:15:49.973 [2024-11-20 20:16:54.772680] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:49.973 [2024-11-20 20:16:54.772758] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:49.973 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.973 [2024-11-20 20:16:54.835649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:49.973 [2024-11-20 20:16:54.946262] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:49.973 [2024-11-20 20:16:54.946410] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:49.973 [2024-11-20 20:16:54.946427] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:49.973 [2024-11-20 20:16:54.946439] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:49.973 [2024-11-20 20:16:54.946475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.908 20:16:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:50.908 20:16:55 -- common/autotest_common.sh@862 -- # return 0 00:15:50.908 20:16:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:50.908 20:16:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 20:16:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:50.908 20:16:55 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:50.908 20:16:55 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:50.908 20:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 [2024-11-20 20:16:55.789579] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:50.908 20:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.908 20:16:55 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:50.908 20:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 20:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.908 20:16:55 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:50.908 20:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 [2024-11-20 20:16:55.805785] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:50.908 20:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.908 20:16:55 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:50.908 20:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 20:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.908 20:16:55 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:50.908 20:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 malloc0 00:15:50.908 20:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.908 20:16:55 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:50.908 20:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.908 20:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:50.908 20:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.908 20:16:55 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:50.908 20:16:55 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:50.908 20:16:55 -- nvmf/common.sh@520 -- # config=() 00:15:50.908 20:16:55 -- nvmf/common.sh@520 -- # local subsystem config 00:15:50.908 20:16:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:50.908 20:16:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:50.908 { 00:15:50.908 "params": { 00:15:50.908 "name": "Nvme$subsystem", 00:15:50.908 "trtype": "$TEST_TRANSPORT", 00:15:50.908 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:50.908 "adrfam": "ipv4", 00:15:50.908 "trsvcid": "$NVMF_PORT", 00:15:50.908 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:50.908 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:50.908 "hdgst": ${hdgst:-false}, 00:15:50.908 "ddgst": ${ddgst:-false} 00:15:50.908 }, 00:15:50.908 "method": "bdev_nvme_attach_controller" 00:15:50.908 } 00:15:50.908 EOF 00:15:50.908 )") 00:15:50.908 20:16:55 -- nvmf/common.sh@542 -- # cat 00:15:50.908 20:16:55 -- nvmf/common.sh@544 -- # jq . 00:15:50.908 20:16:55 -- nvmf/common.sh@545 -- # IFS=, 00:15:50.908 20:16:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:50.908 "params": { 00:15:50.908 "name": "Nvme1", 00:15:50.908 "trtype": "tcp", 00:15:50.908 "traddr": "10.0.0.2", 00:15:50.908 "adrfam": "ipv4", 00:15:50.908 "trsvcid": "4420", 00:15:50.908 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:50.908 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:50.908 "hdgst": false, 00:15:50.908 "ddgst": false 00:15:50.908 }, 00:15:50.908 "method": "bdev_nvme_attach_controller" 00:15:50.908 }' 00:15:50.908 [2024-11-20 20:16:55.883546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:50.908 [2024-11-20 20:16:55.883626] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3155876 ] 00:15:50.908 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.908 [2024-11-20 20:16:55.942155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:51.168 [2024-11-20 20:16:56.052796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:51.428 Running I/O for 10 seconds... 00:16:01.475 00:16:01.475 Latency(us) 00:16:01.475 [2024-11-20T19:17:06.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:01.475 [2024-11-20T19:17:06.514Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:01.475 Verification LBA range: start 0x0 length 0x1000 00:16:01.475 Nvme1n1 : 10.01 8259.79 64.53 0.00 0.00 15460.54 1316.79 24369.68 00:16:01.475 [2024-11-20T19:17:06.514Z] =================================================================================================================== 00:16:01.475 [2024-11-20T19:17:06.514Z] Total : 8259.79 64.53 0.00 0.00 15460.54 1316.79 24369.68 00:16:01.736 20:17:06 -- target/zcopy.sh@39 -- # perfpid=3157127 00:16:01.736 20:17:06 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:01.736 20:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:01.736 20:17:06 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:01.736 20:17:06 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:01.736 20:17:06 -- nvmf/common.sh@520 -- # config=() 00:16:01.736 20:17:06 -- nvmf/common.sh@520 -- # local subsystem config 00:16:01.736 20:17:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:01.736 20:17:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:01.736 { 00:16:01.736 "params": { 00:16:01.736 "name": "Nvme$subsystem", 00:16:01.736 "trtype": "$TEST_TRANSPORT", 00:16:01.736 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:01.736 "adrfam": "ipv4", 00:16:01.736 "trsvcid": "$NVMF_PORT", 00:16:01.736 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:01.736 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:01.736 "hdgst": ${hdgst:-false}, 00:16:01.736 "ddgst": ${ddgst:-false} 00:16:01.736 }, 00:16:01.736 "method": "bdev_nvme_attach_controller" 00:16:01.736 } 00:16:01.736 EOF 00:16:01.736 )") 00:16:01.736 20:17:06 -- nvmf/common.sh@542 -- # cat 00:16:01.736 [2024-11-20 20:17:06.538486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.538530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 20:17:06 -- nvmf/common.sh@544 -- # jq . 00:16:01.736 20:17:06 -- nvmf/common.sh@545 -- # IFS=, 00:16:01.736 20:17:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:01.736 "params": { 00:16:01.736 "name": "Nvme1", 00:16:01.736 "trtype": "tcp", 00:16:01.736 "traddr": "10.0.0.2", 00:16:01.736 "adrfam": "ipv4", 00:16:01.736 "trsvcid": "4420", 00:16:01.736 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:01.736 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:01.736 "hdgst": false, 00:16:01.736 "ddgst": false 00:16:01.736 }, 00:16:01.736 "method": "bdev_nvme_attach_controller" 00:16:01.736 }' 00:16:01.736 [2024-11-20 20:17:06.546435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.546459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.554471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.554499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.562502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.562527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.570514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.570535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.572941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:01.736 [2024-11-20 20:17:06.573002] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3157127 ] 00:16:01.736 [2024-11-20 20:17:06.578537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.578557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.586554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.586586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.594578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.594600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.602610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.602632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.736 [2024-11-20 20:17:06.610647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.610673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.618675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.618700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.626692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.626717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.634714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.634740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.637237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:01.736 [2024-11-20 20:17:06.642757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.642788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.650798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.650838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.658787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.736 [2024-11-20 20:17:06.658812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.736 [2024-11-20 20:17:06.666810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.666836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.674832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.674857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.682856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.682882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.690878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.690903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.698906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.698933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.706952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.706987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.714950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.714977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.722970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.722995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.730994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.731032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.739015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.739041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.747038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.747065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.753294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:01.737 [2024-11-20 20:17:06.755057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.755091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.763092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.763131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.737 [2024-11-20 20:17:06.771151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.737 [2024-11-20 20:17:06.771180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.779166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.779199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.787184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.787217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.795205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.795240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.803228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.803263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.811237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.811271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.819258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.819293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.827254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.827275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.835297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.835331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.843321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.843373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.851321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.851358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.859357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.859384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.867401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.867434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.875442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.875468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.883458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.883487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.891484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.891513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.899516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.899542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.907552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.997 [2024-11-20 20:17:06.907581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.997 [2024-11-20 20:17:06.915570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.915598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:06.923594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.923622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:06.931620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.931649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 Running I/O for 5 seconds... 00:16:01.998 [2024-11-20 20:17:06.939641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.939669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:06.953605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.953637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:06.965894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.965926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:06.979445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.979478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:06.992582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:06.992615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:07.005425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:07.005458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:07.018642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:07.018673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.998 [2024-11-20 20:17:07.031297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.998 [2024-11-20 20:17:07.031326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.043887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.043920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.056630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.056662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.068997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.069029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.081151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.081187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.093590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.093621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.106242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.106284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.118584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.118616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.130586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.130617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.142596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.142628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.154791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.154823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.166949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.166980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.179184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.179212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.191316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.191358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.203964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.203996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.218317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.218345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.230189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.230233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.242312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.242341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.254902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.254935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.268088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.268133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.280380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.280411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.259 [2024-11-20 20:17:07.293142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.259 [2024-11-20 20:17:07.293170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.305518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.305551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.317801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.317844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.330382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.330414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.342197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.342226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.354745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.354776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.366875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.366906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.379856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.379888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.393038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.393079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.405572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.405604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.417668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.417701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.429955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.429987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.442139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.442167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.454482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.454513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.466753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.466784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.479402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.479435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.492387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.492419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.505544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.505577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.518233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.518261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.530266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.530294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.542934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.542966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.520 [2024-11-20 20:17:07.555734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.520 [2024-11-20 20:17:07.555776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.568381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.568413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.580602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.580633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.592832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.592864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.604589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.604621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.616842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.616873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.628804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.628836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.640854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.640885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.653473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.653505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.666087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.666133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.679233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.679263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.692366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.692403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.704837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.704869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.717850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.717881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.730485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.730517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.742769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.742802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.754872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.754904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.766930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.766961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.779060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.779116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.779 [2024-11-20 20:17:07.791193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.779 [2024-11-20 20:17:07.791221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.780 [2024-11-20 20:17:07.803882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.780 [2024-11-20 20:17:07.803913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.816477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.816520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.829157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.829184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.842465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.842496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.855122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.855150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.867653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.867684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.879662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.879693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.892043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.037 [2024-11-20 20:17:07.892082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.037 [2024-11-20 20:17:07.904416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.904448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.917231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.917259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.929440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.929472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.943194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.943220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.952904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.952934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.965552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.965582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.977491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.977522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:07.989815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:07.989846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:08.002313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:08.002341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:08.014700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:08.014731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:08.029010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:08.029041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:08.040561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:08.040592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:08.052552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:08.052584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.038 [2024-11-20 20:17:08.065743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.038 [2024-11-20 20:17:08.065775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.078727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.078758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.091197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.091225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.103595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.103627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.116093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.116136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.129129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.129156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.141968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.141999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.154534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.154565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.167304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.167331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.179711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.179742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.192013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.192044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.204200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.204228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.216255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.216283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.228649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.228681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.240965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.240996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.253269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.253297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.265303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.265331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.278007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.278039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.290404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.290435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.302790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.302822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.315438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.315469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.298 [2024-11-20 20:17:08.327706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.298 [2024-11-20 20:17:08.327737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.340326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.340371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.352678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.352710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.364859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.364890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.376813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.376844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.389429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.389461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.402362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.402394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.414683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.414715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.426627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.426659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.439403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.439435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.451755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.451786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.464161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.464190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.475892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.475923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.488018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.488049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.500118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.500145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.512493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.512525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.524756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.524787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.536849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.536880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.549322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.549377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.561876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.561908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.574421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.574453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.559 [2024-11-20 20:17:08.587039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.559 [2024-11-20 20:17:08.587079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.599339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.599385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.612305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.612333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.623925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.623958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.636191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.636219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.648490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.648521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.660143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.660172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.672217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.672244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.684289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.684316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.696687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.696718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.709400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.709431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.721758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.721799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.734291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.734320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.746722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.746753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.758836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.758867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.770859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.770890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.783303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.783332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.796062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.796117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.808616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.808647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.821715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.821746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.833949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.833981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.819 [2024-11-20 20:17:08.846052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.819 [2024-11-20 20:17:08.846094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.858685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.858718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.871320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.871349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.883915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.883946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.895811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.895846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.907774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.907805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.920152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.920180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.932539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.932570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.944849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.944880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.957250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.957285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.969861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.969893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.982178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.982207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:08.994747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:08.994778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.006867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.006897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.019558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.019590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.034291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.034318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.046304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.046334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.058613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.058645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.071496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.071528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.078 [2024-11-20 20:17:09.083757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.078 [2024-11-20 20:17:09.083788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.079 [2024-11-20 20:17:09.096333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.079 [2024-11-20 20:17:09.096378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.079 [2024-11-20 20:17:09.108930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.079 [2024-11-20 20:17:09.108967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.121521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.121552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.133785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.133815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.146253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.146281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.158618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.158648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.170516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.170547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.182505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.182536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.195098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.195147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.207180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.207207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.219004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.219035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.231483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.231514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.244152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.244181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.256870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.256902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.269616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.269647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.282295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.282323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.295227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.295255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.307754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.307786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.319964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.319995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.332224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.332251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.344490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.344521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.356871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.356902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.336 [2024-11-20 20:17:09.369204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.336 [2024-11-20 20:17:09.369231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.382492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.382523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.394510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.394542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.407694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.407725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.420671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.420702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.434566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.434606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.446537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.446568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.460773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.460805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.472363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.472395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.484313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.484340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.496467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.496498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.509397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.509429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.521662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.521693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.533904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.533936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.546608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.546639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.558872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.558904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.571571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.571603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.583780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.583812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.595705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.595736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.608305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.608333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.594 [2024-11-20 20:17:09.621017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.594 [2024-11-20 20:17:09.621049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.633903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.633934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.646572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.646604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.659631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.659663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.671718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.671749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.684282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.684309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.696496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.696528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.708810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.708842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.721322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.721366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.733381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.733423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.745844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.745875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.758443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.758476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.771127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.771155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.783940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.783972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.796012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.796044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.808470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.808502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.820373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.820405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.832436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.832468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.844760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.844792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.857164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.857193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.869713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.869744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.853 [2024-11-20 20:17:09.882500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.853 [2024-11-20 20:17:09.882531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.895089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.895136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.907958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.907990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.920274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.920303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.932881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.932914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.945370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.945398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.957757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.957791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.970934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.970966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.983780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.983812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:09.996876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:09.996908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.010172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.010205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.023305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.023360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.036159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.036189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.049134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.049163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.061737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.061768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.074353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.074401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.086916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.086948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.099637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.099668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.112443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.112475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.124703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.124735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.136965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.136997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.113 [2024-11-20 20:17:10.149321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.113 [2024-11-20 20:17:10.149368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.162050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.162091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.174543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.174574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.186905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.186937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.199579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.199610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.211476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.211508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.223288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.223330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.235790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.235821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.248126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.248154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.260202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.260239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.273309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.273338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.285700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.285732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.298116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.298144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.310772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.310803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.322840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.322872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.335607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.335639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.348395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.348426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.360834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.360865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.374221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.374250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.387034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.387066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.373 [2024-11-20 20:17:10.399597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.373 [2024-11-20 20:17:10.399628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.412505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.412537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.425213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.425242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.437483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.437514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.449766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.449797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.463665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.463696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.475012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.475044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.488629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.488661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.500984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.501015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.513429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.513460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.525254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.525283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.537379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.537410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.549795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.549826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.561864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.561895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.573628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.573659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.585413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.585444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.597809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.597841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.610558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.610599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.623192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.632 [2024-11-20 20:17:10.623221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.632 [2024-11-20 20:17:10.635003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.633 [2024-11-20 20:17:10.635034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.633 [2024-11-20 20:17:10.646983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.633 [2024-11-20 20:17:10.647015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.633 [2024-11-20 20:17:10.659294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.633 [2024-11-20 20:17:10.659323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.671317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.671361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.683325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.683370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.695723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.695753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.707495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.707527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.720242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.720271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.732807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.732838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.745366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.745392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.757767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.757798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.769973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.770004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.784036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.784077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.795692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.795723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.808209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.808236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.820308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.820335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.832435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.832467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.844915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.844955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.856646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.856678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.869138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.869165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.881196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.881225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.893411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.893457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.905707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.905739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.891 [2024-11-20 20:17:10.918260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.891 [2024-11-20 20:17:10.918287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:10.930799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:10.930841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:10.943793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:10.943824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:10.958157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:10.958184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:10.969933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:10.969964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:10.982592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:10.982623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:10.995275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:10.995302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.007701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.007732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.020207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.020234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.033023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.033065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.045730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.045761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.058784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.058816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.071078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.071110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.083793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.083834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.096437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.096469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.150 [2024-11-20 20:17:11.109263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.150 [2024-11-20 20:17:11.109292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.151 [2024-11-20 20:17:11.121480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.151 [2024-11-20 20:17:11.121512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.151 [2024-11-20 20:17:11.134136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.151 [2024-11-20 20:17:11.134165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.151 [2024-11-20 20:17:11.147326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.151 [2024-11-20 20:17:11.147370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.151 [2024-11-20 20:17:11.160183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.151 [2024-11-20 20:17:11.160219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.151 [2024-11-20 20:17:11.172347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.151 [2024-11-20 20:17:11.172393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.151 [2024-11-20 20:17:11.184528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.151 [2024-11-20 20:17:11.184560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.196966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.196998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.209762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.209793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.222397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.222428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.235799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.235830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.248363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.248409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.260098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.260152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.272653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.272684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.285479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.285510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.299684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.299716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.310917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.310949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.323015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.323059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.334980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.335011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.348517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.348549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.359537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.359568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.372849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.372880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.385164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.385192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.397153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.397181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.408981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.409013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.423217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.423244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.434480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.434511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.411 [2024-11-20 20:17:11.446849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.411 [2024-11-20 20:17:11.446880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.458663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.458695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.470491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.470522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.482751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.482782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.494950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.494981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.507476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.507507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.519692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.519723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.532079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.532124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.544415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.544446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.556438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.556468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.568813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.568844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.581229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.581257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.593368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.593399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.605213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.605240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.616921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.616952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.630042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.630081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.642795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.642826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.655503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.655534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.667730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.667762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.680134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.680162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.692697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.692728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.671 [2024-11-20 20:17:11.704887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.671 [2024-11-20 20:17:11.704918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.716923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.716955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.729574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.729605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.741644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.741676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.753896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.753927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.766359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.766390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.778563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.778594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.791404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.791435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.805578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.805609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.817705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.817737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.829862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.829893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.842450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.842482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.855125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.855153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.867047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.867087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.879195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.879222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.891652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.891683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.904617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.904648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.917356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.917388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.930083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.930127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.942639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.942670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.954776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.954807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 [2024-11-20 20:17:11.961330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.931 [2024-11-20 20:17:11.961374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.931 00:16:06.931 Latency(us) 00:16:06.931 [2024-11-20T19:17:11.970Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:06.931 [2024-11-20T19:17:11.970Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:06.931 Nvme1n1 : 5.01 10222.43 79.86 0.00 0.00 12504.52 5339.97 24660.95 00:16:06.931 [2024-11-20T19:17:11.970Z] =================================================================================================================== 00:16:06.931 [2024-11-20T19:17:11.970Z] Total : 10222.43 79.86 0.00 0.00 12504.52 5339.97 24660.95 00:16:07.189 [2024-11-20 20:17:11.969370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:11.969400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:11.977396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:11.977426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:11.985427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:11.985455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:11.993489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:11.993539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.001513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.001561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.009524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.009570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.017550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.017597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.025570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.025618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.033594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.033639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.041617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.041662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.049629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.049673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.057663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.057713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.065697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.065746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.073709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.073759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.189 [2024-11-20 20:17:12.081724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.189 [2024-11-20 20:17:12.081770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.089734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.089778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.097766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.097810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.105794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.105841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.113771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.113796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.121791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.121829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.129812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.129837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.137833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.137867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.145867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.145897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.153920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.153963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.161963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.162007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.169922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.169949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.177944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.177969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.185967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.185992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.193988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.194013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.202047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.202122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.210093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.210147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.218099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.218149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.190 [2024-11-20 20:17:12.226112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.190 [2024-11-20 20:17:12.226134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.448 [2024-11-20 20:17:12.234132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.448 [2024-11-20 20:17:12.234154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.448 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3157127) - No such process 00:16:07.448 20:17:12 -- target/zcopy.sh@49 -- # wait 3157127 00:16:07.448 20:17:12 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:07.448 20:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.448 20:17:12 -- common/autotest_common.sh@10 -- # set +x 00:16:07.448 20:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.448 20:17:12 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:07.448 20:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.448 20:17:12 -- common/autotest_common.sh@10 -- # set +x 00:16:07.448 delay0 00:16:07.448 20:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.448 20:17:12 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:07.448 20:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.448 20:17:12 -- common/autotest_common.sh@10 -- # set +x 00:16:07.448 20:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.448 20:17:12 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:07.448 EAL: No free 2048 kB hugepages reported on node 1 00:16:07.448 [2024-11-20 20:17:12.350997] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:15.575 Initializing NVMe Controllers 00:16:15.575 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:15.575 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:15.575 Initialization complete. Launching workers. 00:16:15.575 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 264, failed: 16122 00:16:15.575 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 16288, failed to submit 98 00:16:15.575 success 16171, unsuccess 117, failed 0 00:16:15.575 20:17:19 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:15.575 20:17:19 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:15.575 20:17:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:15.575 20:17:19 -- nvmf/common.sh@116 -- # sync 00:16:15.575 20:17:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:15.575 20:17:19 -- nvmf/common.sh@119 -- # set +e 00:16:15.575 20:17:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:15.575 20:17:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:15.575 rmmod nvme_tcp 00:16:15.575 rmmod nvme_fabrics 00:16:15.575 rmmod nvme_keyring 00:16:15.575 20:17:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:15.575 20:17:19 -- nvmf/common.sh@123 -- # set -e 00:16:15.575 20:17:19 -- nvmf/common.sh@124 -- # return 0 00:16:15.575 20:17:19 -- nvmf/common.sh@477 -- # '[' -n 3155717 ']' 00:16:15.575 20:17:19 -- nvmf/common.sh@478 -- # killprocess 3155717 00:16:15.575 20:17:19 -- common/autotest_common.sh@936 -- # '[' -z 3155717 ']' 00:16:15.575 20:17:19 -- common/autotest_common.sh@940 -- # kill -0 3155717 00:16:15.575 20:17:19 -- common/autotest_common.sh@941 -- # uname 00:16:15.575 20:17:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:15.575 20:17:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3155717 00:16:15.575 20:17:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:15.575 20:17:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:15.575 20:17:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3155717' 00:16:15.575 killing process with pid 3155717 00:16:15.575 20:17:19 -- common/autotest_common.sh@955 -- # kill 3155717 00:16:15.575 20:17:19 -- common/autotest_common.sh@960 -- # wait 3155717 00:16:15.575 20:17:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:15.575 20:17:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:15.575 20:17:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:15.575 20:17:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:15.575 20:17:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:15.575 20:17:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:15.575 20:17:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:15.575 20:17:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:16.955 20:17:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:16.955 00:16:16.955 real 0m29.521s 00:16:16.955 user 0m41.449s 00:16:16.955 sys 0m9.777s 00:16:16.955 20:17:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:16.955 20:17:21 -- common/autotest_common.sh@10 -- # set +x 00:16:16.955 ************************************ 00:16:16.955 END TEST nvmf_zcopy 00:16:16.955 ************************************ 00:16:16.955 20:17:21 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:16.955 20:17:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:16.955 20:17:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:16.955 20:17:21 -- common/autotest_common.sh@10 -- # set +x 00:16:16.955 ************************************ 00:16:16.955 START TEST nvmf_nmic 00:16:16.955 ************************************ 00:16:16.955 20:17:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:16.955 * Looking for test storage... 00:16:16.955 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:16.955 20:17:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:16.955 20:17:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:16.955 20:17:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:17.214 20:17:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:17.214 20:17:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:17.214 20:17:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:17.214 20:17:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:17.214 20:17:22 -- scripts/common.sh@335 -- # IFS=.-: 00:16:17.214 20:17:22 -- scripts/common.sh@335 -- # read -ra ver1 00:16:17.214 20:17:22 -- scripts/common.sh@336 -- # IFS=.-: 00:16:17.214 20:17:22 -- scripts/common.sh@336 -- # read -ra ver2 00:16:17.214 20:17:22 -- scripts/common.sh@337 -- # local 'op=<' 00:16:17.214 20:17:22 -- scripts/common.sh@339 -- # ver1_l=2 00:16:17.214 20:17:22 -- scripts/common.sh@340 -- # ver2_l=1 00:16:17.214 20:17:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:17.214 20:17:22 -- scripts/common.sh@343 -- # case "$op" in 00:16:17.214 20:17:22 -- scripts/common.sh@344 -- # : 1 00:16:17.214 20:17:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:17.214 20:17:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:17.214 20:17:22 -- scripts/common.sh@364 -- # decimal 1 00:16:17.214 20:17:22 -- scripts/common.sh@352 -- # local d=1 00:16:17.214 20:17:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:17.214 20:17:22 -- scripts/common.sh@354 -- # echo 1 00:16:17.214 20:17:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:17.214 20:17:22 -- scripts/common.sh@365 -- # decimal 2 00:16:17.214 20:17:22 -- scripts/common.sh@352 -- # local d=2 00:16:17.214 20:17:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:17.214 20:17:22 -- scripts/common.sh@354 -- # echo 2 00:16:17.214 20:17:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:17.214 20:17:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:17.214 20:17:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:17.214 20:17:22 -- scripts/common.sh@367 -- # return 0 00:16:17.214 20:17:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:17.214 20:17:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:17.214 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:17.214 --rc genhtml_branch_coverage=1 00:16:17.214 --rc genhtml_function_coverage=1 00:16:17.214 --rc genhtml_legend=1 00:16:17.214 --rc geninfo_all_blocks=1 00:16:17.214 --rc geninfo_unexecuted_blocks=1 00:16:17.214 00:16:17.214 ' 00:16:17.214 20:17:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:17.214 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:17.214 --rc genhtml_branch_coverage=1 00:16:17.214 --rc genhtml_function_coverage=1 00:16:17.214 --rc genhtml_legend=1 00:16:17.214 --rc geninfo_all_blocks=1 00:16:17.214 --rc geninfo_unexecuted_blocks=1 00:16:17.214 00:16:17.214 ' 00:16:17.214 20:17:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:17.214 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:17.214 --rc genhtml_branch_coverage=1 00:16:17.214 --rc genhtml_function_coverage=1 00:16:17.214 --rc genhtml_legend=1 00:16:17.214 --rc geninfo_all_blocks=1 00:16:17.214 --rc geninfo_unexecuted_blocks=1 00:16:17.214 00:16:17.214 ' 00:16:17.214 20:17:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:17.214 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:17.214 --rc genhtml_branch_coverage=1 00:16:17.214 --rc genhtml_function_coverage=1 00:16:17.214 --rc genhtml_legend=1 00:16:17.214 --rc geninfo_all_blocks=1 00:16:17.214 --rc geninfo_unexecuted_blocks=1 00:16:17.214 00:16:17.214 ' 00:16:17.214 20:17:22 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:17.214 20:17:22 -- nvmf/common.sh@7 -- # uname -s 00:16:17.214 20:17:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:17.214 20:17:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:17.214 20:17:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:17.214 20:17:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:17.215 20:17:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:17.215 20:17:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:17.215 20:17:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:17.215 20:17:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:17.215 20:17:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:17.215 20:17:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:17.215 20:17:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:17.215 20:17:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:17.215 20:17:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:17.215 20:17:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:17.215 20:17:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:17.215 20:17:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:17.215 20:17:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:17.215 20:17:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:17.215 20:17:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:17.215 20:17:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.215 20:17:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.215 20:17:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.215 20:17:22 -- paths/export.sh@5 -- # export PATH 00:16:17.215 20:17:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.215 20:17:22 -- nvmf/common.sh@46 -- # : 0 00:16:17.215 20:17:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:17.215 20:17:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:17.215 20:17:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:17.215 20:17:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:17.215 20:17:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:17.215 20:17:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:17.215 20:17:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:17.215 20:17:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:17.215 20:17:22 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:17.215 20:17:22 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:17.215 20:17:22 -- target/nmic.sh@14 -- # nvmftestinit 00:16:17.215 20:17:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:17.215 20:17:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:17.215 20:17:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:17.215 20:17:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:17.215 20:17:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:17.215 20:17:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:17.215 20:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:17.215 20:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:17.215 20:17:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:17.215 20:17:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:17.215 20:17:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:17.215 20:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:19.748 20:17:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:19.748 20:17:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:19.748 20:17:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:19.748 20:17:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:19.748 20:17:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:19.748 20:17:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:19.748 20:17:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:19.748 20:17:24 -- nvmf/common.sh@294 -- # net_devs=() 00:16:19.748 20:17:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:19.748 20:17:24 -- nvmf/common.sh@295 -- # e810=() 00:16:19.748 20:17:24 -- nvmf/common.sh@295 -- # local -ga e810 00:16:19.748 20:17:24 -- nvmf/common.sh@296 -- # x722=() 00:16:19.748 20:17:24 -- nvmf/common.sh@296 -- # local -ga x722 00:16:19.748 20:17:24 -- nvmf/common.sh@297 -- # mlx=() 00:16:19.748 20:17:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:19.748 20:17:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:19.748 20:17:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:19.748 20:17:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:19.748 20:17:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:19.748 20:17:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:19.748 20:17:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:19.748 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:19.748 20:17:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:19.748 20:17:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:19.748 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:19.748 20:17:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:19.748 20:17:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:19.748 20:17:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:19.748 20:17:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:19.748 20:17:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:19.748 20:17:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:19.748 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:19.748 20:17:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:19.748 20:17:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:19.748 20:17:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:19.748 20:17:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:19.748 20:17:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:19.748 20:17:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:19.748 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:19.748 20:17:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:19.748 20:17:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:19.748 20:17:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:19.748 20:17:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:19.748 20:17:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:19.748 20:17:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:19.748 20:17:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:19.748 20:17:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:19.748 20:17:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:19.748 20:17:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:19.748 20:17:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:19.748 20:17:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:19.748 20:17:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:19.748 20:17:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:19.748 20:17:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:19.748 20:17:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:19.748 20:17:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:19.748 20:17:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:19.748 20:17:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:19.748 20:17:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:19.748 20:17:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:19.748 20:17:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:19.748 20:17:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:19.748 20:17:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:19.748 20:17:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:19.748 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:19.748 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.366 ms 00:16:19.748 00:16:19.748 --- 10.0.0.2 ping statistics --- 00:16:19.748 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:19.748 rtt min/avg/max/mdev = 0.366/0.366/0.366/0.000 ms 00:16:19.749 20:17:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:19.749 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:19.749 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:16:19.749 00:16:19.749 --- 10.0.0.1 ping statistics --- 00:16:19.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:19.749 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:16:19.749 20:17:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:19.749 20:17:24 -- nvmf/common.sh@410 -- # return 0 00:16:19.749 20:17:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:19.749 20:17:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:19.749 20:17:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:19.749 20:17:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:19.749 20:17:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:19.749 20:17:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:19.749 20:17:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:19.749 20:17:24 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:19.749 20:17:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:19.749 20:17:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:19.749 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:16:19.749 20:17:24 -- nvmf/common.sh@469 -- # nvmfpid=3160685 00:16:19.749 20:17:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:19.749 20:17:24 -- nvmf/common.sh@470 -- # waitforlisten 3160685 00:16:19.749 20:17:24 -- common/autotest_common.sh@829 -- # '[' -z 3160685 ']' 00:16:19.749 20:17:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:19.749 20:17:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:19.749 20:17:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:19.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:19.749 20:17:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:19.749 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:16:19.749 [2024-11-20 20:17:24.380241] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.749 [2024-11-20 20:17:24.380353] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:19.749 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.749 [2024-11-20 20:17:24.444110] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:19.749 [2024-11-20 20:17:24.554659] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:19.749 [2024-11-20 20:17:24.554812] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:19.749 [2024-11-20 20:17:24.554845] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:19.749 [2024-11-20 20:17:24.554857] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:19.749 [2024-11-20 20:17:24.554927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:19.749 [2024-11-20 20:17:24.555127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:19.749 [2024-11-20 20:17:24.555153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:19.749 [2024-11-20 20:17:24.555156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:20.689 20:17:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:20.689 20:17:25 -- common/autotest_common.sh@862 -- # return 0 00:16:20.689 20:17:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:20.689 20:17:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 20:17:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:20.689 20:17:25 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 [2024-11-20 20:17:25.414844] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 Malloc0 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 [2024-11-20 20:17:25.468734] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:20.689 test case1: single bdev can't be used in multiple subsystems 00:16:20.689 20:17:25 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.689 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.689 20:17:25 -- target/nmic.sh@28 -- # nmic_status=0 00:16:20.689 20:17:25 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:20.689 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.689 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.690 [2024-11-20 20:17:25.492575] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:20.690 [2024-11-20 20:17:25.492604] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:20.690 [2024-11-20 20:17:25.492634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.690 request: 00:16:20.690 { 00:16:20.690 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:20.690 "namespace": { 00:16:20.690 "bdev_name": "Malloc0" 00:16:20.690 }, 00:16:20.690 "method": "nvmf_subsystem_add_ns", 00:16:20.690 "req_id": 1 00:16:20.690 } 00:16:20.690 Got JSON-RPC error response 00:16:20.690 response: 00:16:20.690 { 00:16:20.690 "code": -32602, 00:16:20.690 "message": "Invalid parameters" 00:16:20.690 } 00:16:20.690 20:17:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:20.690 20:17:25 -- target/nmic.sh@29 -- # nmic_status=1 00:16:20.690 20:17:25 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:20.690 20:17:25 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:20.690 Adding namespace failed - expected result. 00:16:20.690 20:17:25 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:20.690 test case2: host connect to nvmf target in multiple paths 00:16:20.690 20:17:25 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:20.690 20:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.690 20:17:25 -- common/autotest_common.sh@10 -- # set +x 00:16:20.690 [2024-11-20 20:17:25.500687] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:20.690 20:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.690 20:17:25 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:21.256 20:17:26 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:22.194 20:17:26 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:22.194 20:17:26 -- common/autotest_common.sh@1187 -- # local i=0 00:16:22.194 20:17:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:22.194 20:17:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:22.194 20:17:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:24.125 20:17:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:24.125 20:17:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:24.125 20:17:28 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:24.125 20:17:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:24.125 20:17:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:24.125 20:17:28 -- common/autotest_common.sh@1197 -- # return 0 00:16:24.125 20:17:28 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:24.125 [global] 00:16:24.125 thread=1 00:16:24.125 invalidate=1 00:16:24.125 rw=write 00:16:24.125 time_based=1 00:16:24.125 runtime=1 00:16:24.125 ioengine=libaio 00:16:24.125 direct=1 00:16:24.125 bs=4096 00:16:24.125 iodepth=1 00:16:24.125 norandommap=0 00:16:24.125 numjobs=1 00:16:24.125 00:16:24.125 verify_dump=1 00:16:24.125 verify_backlog=512 00:16:24.125 verify_state_save=0 00:16:24.125 do_verify=1 00:16:24.125 verify=crc32c-intel 00:16:24.125 [job0] 00:16:24.125 filename=/dev/nvme0n1 00:16:24.125 Could not set queue depth (nvme0n1) 00:16:24.125 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:24.125 fio-3.35 00:16:24.125 Starting 1 thread 00:16:25.500 00:16:25.500 job0: (groupid=0, jobs=1): err= 0: pid=3161344: Wed Nov 20 20:17:30 2024 00:16:25.500 read: IOPS=21, BW=87.6KiB/s (89.8kB/s)(88.0KiB/1004msec) 00:16:25.500 slat (nsec): min=8043, max=43550, avg=29056.36, stdev=10182.39 00:16:25.500 clat (usec): min=40831, max=41070, avg=40959.49, stdev=63.50 00:16:25.500 lat (usec): min=40866, max=41086, avg=40988.55, stdev=58.49 00:16:25.500 clat percentiles (usec): 00:16:25.500 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:16:25.500 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:25.500 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:25.500 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:25.500 | 99.99th=[41157] 00:16:25.500 write: IOPS=509, BW=2040KiB/s (2089kB/s)(2048KiB/1004msec); 0 zone resets 00:16:25.500 slat (nsec): min=7859, max=68982, avg=15489.55, stdev=7582.78 00:16:25.500 clat (usec): min=144, max=513, avg=179.15, stdev=26.88 00:16:25.500 lat (usec): min=154, max=523, avg=194.64, stdev=30.46 00:16:25.500 clat percentiles (usec): 00:16:25.500 | 1.00th=[ 149], 5.00th=[ 153], 10.00th=[ 155], 20.00th=[ 161], 00:16:25.500 | 30.00th=[ 165], 40.00th=[ 169], 50.00th=[ 176], 60.00th=[ 180], 00:16:25.500 | 70.00th=[ 186], 80.00th=[ 194], 90.00th=[ 202], 95.00th=[ 227], 00:16:25.500 | 99.00th=[ 262], 99.50th=[ 269], 99.90th=[ 515], 99.95th=[ 515], 00:16:25.500 | 99.99th=[ 515] 00:16:25.500 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:25.500 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:25.500 lat (usec) : 250=93.63%, 500=2.06%, 750=0.19% 00:16:25.500 lat (msec) : 50=4.12% 00:16:25.500 cpu : usr=0.30%, sys=1.30%, ctx=534, majf=0, minf=1 00:16:25.500 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:25.500 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:25.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:25.501 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:25.501 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:25.501 00:16:25.501 Run status group 0 (all jobs): 00:16:25.501 READ: bw=87.6KiB/s (89.8kB/s), 87.6KiB/s-87.6KiB/s (89.8kB/s-89.8kB/s), io=88.0KiB (90.1kB), run=1004-1004msec 00:16:25.501 WRITE: bw=2040KiB/s (2089kB/s), 2040KiB/s-2040KiB/s (2089kB/s-2089kB/s), io=2048KiB (2097kB), run=1004-1004msec 00:16:25.501 00:16:25.501 Disk stats (read/write): 00:16:25.501 nvme0n1: ios=69/512, merge=0/0, ticks=792/90, in_queue=882, util=91.58% 00:16:25.501 20:17:30 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:25.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:25.501 20:17:30 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:25.501 20:17:30 -- common/autotest_common.sh@1208 -- # local i=0 00:16:25.501 20:17:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:25.501 20:17:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:25.501 20:17:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:25.501 20:17:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:25.501 20:17:30 -- common/autotest_common.sh@1220 -- # return 0 00:16:25.501 20:17:30 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:25.501 20:17:30 -- target/nmic.sh@53 -- # nvmftestfini 00:16:25.501 20:17:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:25.501 20:17:30 -- nvmf/common.sh@116 -- # sync 00:16:25.501 20:17:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:25.501 20:17:30 -- nvmf/common.sh@119 -- # set +e 00:16:25.501 20:17:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:25.501 20:17:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:25.501 rmmod nvme_tcp 00:16:25.501 rmmod nvme_fabrics 00:16:25.501 rmmod nvme_keyring 00:16:25.501 20:17:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:25.501 20:17:30 -- nvmf/common.sh@123 -- # set -e 00:16:25.501 20:17:30 -- nvmf/common.sh@124 -- # return 0 00:16:25.501 20:17:30 -- nvmf/common.sh@477 -- # '[' -n 3160685 ']' 00:16:25.501 20:17:30 -- nvmf/common.sh@478 -- # killprocess 3160685 00:16:25.501 20:17:30 -- common/autotest_common.sh@936 -- # '[' -z 3160685 ']' 00:16:25.501 20:17:30 -- common/autotest_common.sh@940 -- # kill -0 3160685 00:16:25.501 20:17:30 -- common/autotest_common.sh@941 -- # uname 00:16:25.501 20:17:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:25.501 20:17:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3160685 00:16:25.501 20:17:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:25.501 20:17:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:25.501 20:17:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3160685' 00:16:25.501 killing process with pid 3160685 00:16:25.501 20:17:30 -- common/autotest_common.sh@955 -- # kill 3160685 00:16:25.501 20:17:30 -- common/autotest_common.sh@960 -- # wait 3160685 00:16:25.759 20:17:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:25.759 20:17:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:25.759 20:17:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:25.759 20:17:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:25.759 20:17:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:25.759 20:17:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.759 20:17:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.759 20:17:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.295 20:17:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:28.295 00:16:28.295 real 0m10.919s 00:16:28.295 user 0m26.020s 00:16:28.295 sys 0m2.434s 00:16:28.295 20:17:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:28.295 20:17:32 -- common/autotest_common.sh@10 -- # set +x 00:16:28.295 ************************************ 00:16:28.295 END TEST nvmf_nmic 00:16:28.295 ************************************ 00:16:28.295 20:17:32 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:28.295 20:17:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:28.296 20:17:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.296 20:17:32 -- common/autotest_common.sh@10 -- # set +x 00:16:28.296 ************************************ 00:16:28.296 START TEST nvmf_fio_target 00:16:28.296 ************************************ 00:16:28.296 20:17:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:28.296 * Looking for test storage... 00:16:28.296 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.296 20:17:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:28.296 20:17:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:28.296 20:17:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:28.296 20:17:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:28.296 20:17:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:28.296 20:17:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:28.296 20:17:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:28.296 20:17:32 -- scripts/common.sh@335 -- # IFS=.-: 00:16:28.296 20:17:32 -- scripts/common.sh@335 -- # read -ra ver1 00:16:28.296 20:17:32 -- scripts/common.sh@336 -- # IFS=.-: 00:16:28.296 20:17:32 -- scripts/common.sh@336 -- # read -ra ver2 00:16:28.296 20:17:32 -- scripts/common.sh@337 -- # local 'op=<' 00:16:28.296 20:17:32 -- scripts/common.sh@339 -- # ver1_l=2 00:16:28.296 20:17:32 -- scripts/common.sh@340 -- # ver2_l=1 00:16:28.296 20:17:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:28.296 20:17:32 -- scripts/common.sh@343 -- # case "$op" in 00:16:28.296 20:17:32 -- scripts/common.sh@344 -- # : 1 00:16:28.296 20:17:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:28.296 20:17:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:28.296 20:17:32 -- scripts/common.sh@364 -- # decimal 1 00:16:28.296 20:17:32 -- scripts/common.sh@352 -- # local d=1 00:16:28.296 20:17:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:28.296 20:17:32 -- scripts/common.sh@354 -- # echo 1 00:16:28.296 20:17:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:28.296 20:17:32 -- scripts/common.sh@365 -- # decimal 2 00:16:28.296 20:17:32 -- scripts/common.sh@352 -- # local d=2 00:16:28.296 20:17:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:28.296 20:17:32 -- scripts/common.sh@354 -- # echo 2 00:16:28.296 20:17:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:28.296 20:17:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:28.296 20:17:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:28.296 20:17:32 -- scripts/common.sh@367 -- # return 0 00:16:28.296 20:17:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:28.296 20:17:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:28.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.296 --rc genhtml_branch_coverage=1 00:16:28.296 --rc genhtml_function_coverage=1 00:16:28.296 --rc genhtml_legend=1 00:16:28.296 --rc geninfo_all_blocks=1 00:16:28.296 --rc geninfo_unexecuted_blocks=1 00:16:28.296 00:16:28.296 ' 00:16:28.296 20:17:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:28.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.296 --rc genhtml_branch_coverage=1 00:16:28.296 --rc genhtml_function_coverage=1 00:16:28.296 --rc genhtml_legend=1 00:16:28.296 --rc geninfo_all_blocks=1 00:16:28.296 --rc geninfo_unexecuted_blocks=1 00:16:28.296 00:16:28.296 ' 00:16:28.296 20:17:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:28.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.296 --rc genhtml_branch_coverage=1 00:16:28.296 --rc genhtml_function_coverage=1 00:16:28.296 --rc genhtml_legend=1 00:16:28.296 --rc geninfo_all_blocks=1 00:16:28.296 --rc geninfo_unexecuted_blocks=1 00:16:28.296 00:16:28.296 ' 00:16:28.296 20:17:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:28.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.296 --rc genhtml_branch_coverage=1 00:16:28.296 --rc genhtml_function_coverage=1 00:16:28.296 --rc genhtml_legend=1 00:16:28.296 --rc geninfo_all_blocks=1 00:16:28.296 --rc geninfo_unexecuted_blocks=1 00:16:28.296 00:16:28.296 ' 00:16:28.296 20:17:32 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.296 20:17:32 -- nvmf/common.sh@7 -- # uname -s 00:16:28.296 20:17:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.296 20:17:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.296 20:17:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.296 20:17:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.296 20:17:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.296 20:17:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.296 20:17:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.296 20:17:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.296 20:17:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.296 20:17:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.296 20:17:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.296 20:17:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.296 20:17:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.296 20:17:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.296 20:17:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.296 20:17:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.296 20:17:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.296 20:17:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.296 20:17:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.296 20:17:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.296 20:17:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.296 20:17:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.296 20:17:32 -- paths/export.sh@5 -- # export PATH 00:16:28.296 20:17:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.296 20:17:32 -- nvmf/common.sh@46 -- # : 0 00:16:28.297 20:17:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.297 20:17:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.297 20:17:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.297 20:17:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.297 20:17:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.297 20:17:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.297 20:17:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.297 20:17:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.297 20:17:33 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:28.297 20:17:33 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:28.297 20:17:33 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:28.297 20:17:33 -- target/fio.sh@16 -- # nvmftestinit 00:16:28.297 20:17:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:28.297 20:17:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:28.297 20:17:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:28.297 20:17:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:28.297 20:17:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:28.297 20:17:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:28.297 20:17:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:28.297 20:17:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.297 20:17:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:28.297 20:17:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:28.297 20:17:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:28.297 20:17:33 -- common/autotest_common.sh@10 -- # set +x 00:16:30.201 20:17:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:30.201 20:17:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:30.201 20:17:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:30.201 20:17:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:30.201 20:17:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:30.201 20:17:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:30.201 20:17:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:30.201 20:17:35 -- nvmf/common.sh@294 -- # net_devs=() 00:16:30.201 20:17:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:30.201 20:17:35 -- nvmf/common.sh@295 -- # e810=() 00:16:30.201 20:17:35 -- nvmf/common.sh@295 -- # local -ga e810 00:16:30.201 20:17:35 -- nvmf/common.sh@296 -- # x722=() 00:16:30.201 20:17:35 -- nvmf/common.sh@296 -- # local -ga x722 00:16:30.201 20:17:35 -- nvmf/common.sh@297 -- # mlx=() 00:16:30.201 20:17:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:30.201 20:17:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:30.201 20:17:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:30.201 20:17:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:30.201 20:17:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:30.201 20:17:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.201 20:17:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:30.201 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:30.201 20:17:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.201 20:17:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:30.201 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:30.201 20:17:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:30.201 20:17:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.201 20:17:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.201 20:17:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.201 20:17:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.201 20:17:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:30.201 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:30.201 20:17:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.201 20:17:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.201 20:17:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.201 20:17:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.201 20:17:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.201 20:17:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:30.201 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:30.201 20:17:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.201 20:17:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:30.201 20:17:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:30.201 20:17:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:30.201 20:17:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:30.201 20:17:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:30.201 20:17:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:30.201 20:17:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:30.201 20:17:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:30.201 20:17:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:30.201 20:17:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:30.201 20:17:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:30.201 20:17:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:30.201 20:17:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:30.201 20:17:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:30.202 20:17:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:30.202 20:17:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:30.202 20:17:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:30.202 20:17:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:30.202 20:17:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:30.202 20:17:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:30.202 20:17:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:30.202 20:17:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:30.202 20:17:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:30.202 20:17:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:30.460 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:30.460 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.148 ms 00:16:30.460 00:16:30.460 --- 10.0.0.2 ping statistics --- 00:16:30.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:30.460 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:16:30.460 20:17:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:30.460 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:30.460 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:16:30.460 00:16:30.460 --- 10.0.0.1 ping statistics --- 00:16:30.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:30.460 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:16:30.460 20:17:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:30.460 20:17:35 -- nvmf/common.sh@410 -- # return 0 00:16:30.460 20:17:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:30.460 20:17:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:30.460 20:17:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:30.460 20:17:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:30.460 20:17:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:30.460 20:17:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:30.460 20:17:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:30.460 20:17:35 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:30.460 20:17:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:30.460 20:17:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:30.460 20:17:35 -- common/autotest_common.sh@10 -- # set +x 00:16:30.460 20:17:35 -- nvmf/common.sh@469 -- # nvmfpid=3163557 00:16:30.460 20:17:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:30.460 20:17:35 -- nvmf/common.sh@470 -- # waitforlisten 3163557 00:16:30.460 20:17:35 -- common/autotest_common.sh@829 -- # '[' -z 3163557 ']' 00:16:30.460 20:17:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:30.460 20:17:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:30.460 20:17:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:30.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:30.460 20:17:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:30.460 20:17:35 -- common/autotest_common.sh@10 -- # set +x 00:16:30.460 [2024-11-20 20:17:35.316084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:30.460 [2024-11-20 20:17:35.316174] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:30.460 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.460 [2024-11-20 20:17:35.380095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:30.460 [2024-11-20 20:17:35.488889] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:30.460 [2024-11-20 20:17:35.489039] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:30.460 [2024-11-20 20:17:35.489056] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:30.460 [2024-11-20 20:17:35.489076] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:30.460 [2024-11-20 20:17:35.489141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:30.460 [2024-11-20 20:17:35.489213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:30.460 [2024-11-20 20:17:35.489375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:30.460 [2024-11-20 20:17:35.489378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:31.404 20:17:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:31.404 20:17:36 -- common/autotest_common.sh@862 -- # return 0 00:16:31.404 20:17:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:31.404 20:17:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:31.404 20:17:36 -- common/autotest_common.sh@10 -- # set +x 00:16:31.404 20:17:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:31.404 20:17:36 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:31.662 [2024-11-20 20:17:36.627725] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:31.662 20:17:36 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.921 20:17:36 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:31.921 20:17:36 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.186 20:17:37 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:32.186 20:17:37 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.492 20:17:37 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:32.492 20:17:37 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.774 20:17:37 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:32.774 20:17:37 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:33.033 20:17:38 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:33.291 20:17:38 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:33.291 20:17:38 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:33.549 20:17:38 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:33.549 20:17:38 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:33.808 20:17:38 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:33.808 20:17:38 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:34.066 20:17:39 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:34.324 20:17:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:34.324 20:17:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:34.582 20:17:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:34.582 20:17:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:34.840 20:17:39 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:35.099 [2024-11-20 20:17:40.058193] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:35.099 20:17:40 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:35.357 20:17:40 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:35.615 20:17:40 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:36.184 20:17:41 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:36.184 20:17:41 -- common/autotest_common.sh@1187 -- # local i=0 00:16:36.184 20:17:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:36.184 20:17:41 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:36.184 20:17:41 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:36.184 20:17:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:38.722 20:17:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:38.722 20:17:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:38.722 20:17:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:38.722 20:17:43 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:38.722 20:17:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:38.722 20:17:43 -- common/autotest_common.sh@1197 -- # return 0 00:16:38.722 20:17:43 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:38.722 [global] 00:16:38.722 thread=1 00:16:38.722 invalidate=1 00:16:38.722 rw=write 00:16:38.722 time_based=1 00:16:38.722 runtime=1 00:16:38.722 ioengine=libaio 00:16:38.722 direct=1 00:16:38.722 bs=4096 00:16:38.722 iodepth=1 00:16:38.722 norandommap=0 00:16:38.722 numjobs=1 00:16:38.722 00:16:38.722 verify_dump=1 00:16:38.722 verify_backlog=512 00:16:38.722 verify_state_save=0 00:16:38.722 do_verify=1 00:16:38.722 verify=crc32c-intel 00:16:38.722 [job0] 00:16:38.722 filename=/dev/nvme0n1 00:16:38.722 [job1] 00:16:38.722 filename=/dev/nvme0n2 00:16:38.722 [job2] 00:16:38.722 filename=/dev/nvme0n3 00:16:38.722 [job3] 00:16:38.722 filename=/dev/nvme0n4 00:16:38.722 Could not set queue depth (nvme0n1) 00:16:38.722 Could not set queue depth (nvme0n2) 00:16:38.722 Could not set queue depth (nvme0n3) 00:16:38.722 Could not set queue depth (nvme0n4) 00:16:38.722 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.722 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.722 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.722 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.722 fio-3.35 00:16:38.722 Starting 4 threads 00:16:39.660 00:16:39.660 job0: (groupid=0, jobs=1): err= 0: pid=3164674: Wed Nov 20 20:17:44 2024 00:16:39.660 read: IOPS=23, BW=94.4KiB/s (96.7kB/s)(96.0KiB/1017msec) 00:16:39.660 slat (nsec): min=9220, max=20424, avg=14178.17, stdev=2392.27 00:16:39.660 clat (usec): min=297, max=41989, avg=37692.65, stdev=11501.31 00:16:39.660 lat (usec): min=312, max=42001, avg=37706.83, stdev=11500.26 00:16:39.660 clat percentiles (usec): 00:16:39.660 | 1.00th=[ 297], 5.00th=[ 441], 10.00th=[40633], 20.00th=[41157], 00:16:39.660 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:39.660 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:16:39.660 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:39.660 | 99.99th=[42206] 00:16:39.660 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:16:39.660 slat (nsec): min=7747, max=58005, avg=18115.82, stdev=7470.44 00:16:39.660 clat (usec): min=158, max=248, avg=195.96, stdev=14.88 00:16:39.660 lat (usec): min=167, max=268, avg=214.07, stdev=18.48 00:16:39.660 clat percentiles (usec): 00:16:39.660 | 1.00th=[ 161], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 184], 00:16:39.660 | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 200], 00:16:39.660 | 70.00th=[ 204], 80.00th=[ 208], 90.00th=[ 212], 95.00th=[ 219], 00:16:39.660 | 99.00th=[ 233], 99.50th=[ 247], 99.90th=[ 249], 99.95th=[ 249], 00:16:39.660 | 99.99th=[ 249] 00:16:39.660 bw ( KiB/s): min= 4096, max= 4096, per=21.71%, avg=4096.00, stdev= 0.00, samples=1 00:16:39.660 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:39.660 lat (usec) : 250=95.52%, 500=0.37% 00:16:39.660 lat (msec) : 50=4.10% 00:16:39.660 cpu : usr=0.59%, sys=1.18%, ctx=536, majf=0, minf=1 00:16:39.660 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:39.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.660 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.660 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.660 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:39.660 job1: (groupid=0, jobs=1): err= 0: pid=3164675: Wed Nov 20 20:17:44 2024 00:16:39.660 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec) 00:16:39.660 slat (nsec): min=4617, max=64401, avg=15444.06, stdev=9873.49 00:16:39.660 clat (usec): min=204, max=42287, avg=660.90, stdev=3603.83 00:16:39.660 lat (usec): min=212, max=42302, avg=676.34, stdev=3603.77 00:16:39.660 clat percentiles (usec): 00:16:39.660 | 1.00th=[ 215], 5.00th=[ 247], 10.00th=[ 281], 20.00th=[ 302], 00:16:39.660 | 30.00th=[ 314], 40.00th=[ 322], 50.00th=[ 338], 60.00th=[ 355], 00:16:39.660 | 70.00th=[ 371], 80.00th=[ 392], 90.00th=[ 420], 95.00th=[ 441], 00:16:39.660 | 99.00th=[ 515], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:39.660 | 99.99th=[42206] 00:16:39.660 write: IOPS=1296, BW=5187KiB/s (5311kB/s)(5192KiB/1001msec); 0 zone resets 00:16:39.660 slat (nsec): min=5550, max=43006, avg=11581.59, stdev=5531.32 00:16:39.660 clat (usec): min=131, max=506, avg=218.63, stdev=32.56 00:16:39.660 lat (usec): min=137, max=529, avg=230.21, stdev=33.51 00:16:39.660 clat percentiles (usec): 00:16:39.660 | 1.00th=[ 141], 5.00th=[ 149], 10.00th=[ 163], 20.00th=[ 202], 00:16:39.660 | 30.00th=[ 210], 40.00th=[ 219], 50.00th=[ 223], 60.00th=[ 227], 00:16:39.660 | 70.00th=[ 235], 80.00th=[ 241], 90.00th=[ 251], 95.00th=[ 262], 00:16:39.660 | 99.00th=[ 277], 99.50th=[ 302], 99.90th=[ 379], 99.95th=[ 506], 00:16:39.660 | 99.99th=[ 506] 00:16:39.660 bw ( KiB/s): min= 8192, max= 8192, per=43.42%, avg=8192.00, stdev= 0.00, samples=1 00:16:39.661 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:39.661 lat (usec) : 250=51.85%, 500=47.63%, 750=0.17% 00:16:39.661 lat (msec) : 50=0.34% 00:16:39.661 cpu : usr=2.10%, sys=2.90%, ctx=2322, majf=0, minf=1 00:16:39.661 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:39.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.661 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.661 issued rwts: total=1024,1298,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.661 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:39.661 job2: (groupid=0, jobs=1): err= 0: pid=3164676: Wed Nov 20 20:17:44 2024 00:16:39.661 read: IOPS=1656, BW=6625KiB/s (6784kB/s)(6632KiB/1001msec) 00:16:39.661 slat (nsec): min=4665, max=58080, avg=13135.41, stdev=8589.64 00:16:39.661 clat (usec): min=222, max=9056, avg=306.82, stdev=222.88 00:16:39.661 lat (usec): min=228, max=9065, avg=319.96, stdev=223.62 00:16:39.661 clat percentiles (usec): 00:16:39.661 | 1.00th=[ 229], 5.00th=[ 235], 10.00th=[ 239], 20.00th=[ 245], 00:16:39.661 | 30.00th=[ 251], 40.00th=[ 281], 50.00th=[ 293], 60.00th=[ 310], 00:16:39.661 | 70.00th=[ 326], 80.00th=[ 351], 90.00th=[ 388], 95.00th=[ 408], 00:16:39.661 | 99.00th=[ 482], 99.50th=[ 502], 99.90th=[ 594], 99.95th=[ 9110], 00:16:39.661 | 99.99th=[ 9110] 00:16:39.661 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:39.661 slat (nsec): min=6059, max=75205, avg=11013.02, stdev=5590.94 00:16:39.661 clat (usec): min=161, max=426, avg=212.28, stdev=35.88 00:16:39.661 lat (usec): min=168, max=460, avg=223.30, stdev=37.85 00:16:39.661 clat percentiles (usec): 00:16:39.661 | 1.00th=[ 165], 5.00th=[ 167], 10.00th=[ 172], 20.00th=[ 176], 00:16:39.661 | 30.00th=[ 186], 40.00th=[ 206], 50.00th=[ 217], 60.00th=[ 223], 00:16:39.661 | 70.00th=[ 229], 80.00th=[ 235], 90.00th=[ 249], 95.00th=[ 262], 00:16:39.661 | 99.00th=[ 355], 99.50th=[ 375], 99.90th=[ 396], 99.95th=[ 408], 00:16:39.661 | 99.99th=[ 429] 00:16:39.661 bw ( KiB/s): min= 8192, max= 8192, per=43.42%, avg=8192.00, stdev= 0.00, samples=1 00:16:39.661 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:39.661 lat (usec) : 250=62.63%, 500=37.13%, 750=0.22% 00:16:39.661 lat (msec) : 10=0.03% 00:16:39.661 cpu : usr=3.20%, sys=3.80%, ctx=3706, majf=0, minf=1 00:16:39.661 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:39.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.661 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.661 issued rwts: total=1658,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.661 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:39.661 job3: (groupid=0, jobs=1): err= 0: pid=3164677: Wed Nov 20 20:17:44 2024 00:16:39.661 read: IOPS=907, BW=3629KiB/s (3716kB/s)(3756KiB/1035msec) 00:16:39.661 slat (nsec): min=5798, max=46126, avg=13037.88, stdev=6869.24 00:16:39.661 clat (usec): min=232, max=42277, avg=827.79, stdev=4574.12 00:16:39.661 lat (usec): min=240, max=42304, avg=840.82, stdev=4573.97 00:16:39.661 clat percentiles (usec): 00:16:39.661 | 1.00th=[ 245], 5.00th=[ 262], 10.00th=[ 269], 20.00th=[ 281], 00:16:39.661 | 30.00th=[ 289], 40.00th=[ 297], 50.00th=[ 302], 60.00th=[ 310], 00:16:39.661 | 70.00th=[ 318], 80.00th=[ 330], 90.00th=[ 355], 95.00th=[ 371], 00:16:39.661 | 99.00th=[40633], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:39.661 | 99.99th=[42206] 00:16:39.661 write: IOPS=989, BW=3957KiB/s (4052kB/s)(4096KiB/1035msec); 0 zone resets 00:16:39.661 slat (nsec): min=7578, max=51381, avg=16167.86, stdev=7341.77 00:16:39.661 clat (usec): min=160, max=294, avg=214.81, stdev=20.83 00:16:39.661 lat (usec): min=175, max=309, avg=230.97, stdev=23.47 00:16:39.661 clat percentiles (usec): 00:16:39.661 | 1.00th=[ 172], 5.00th=[ 178], 10.00th=[ 186], 20.00th=[ 196], 00:16:39.661 | 30.00th=[ 204], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 221], 00:16:39.661 | 70.00th=[ 227], 80.00th=[ 231], 90.00th=[ 241], 95.00th=[ 247], 00:16:39.661 | 99.00th=[ 269], 99.50th=[ 281], 99.90th=[ 293], 99.95th=[ 293], 00:16:39.661 | 99.99th=[ 293] 00:16:39.661 bw ( KiB/s): min= 8192, max= 8192, per=43.42%, avg=8192.00, stdev= 0.00, samples=1 00:16:39.661 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:39.661 lat (usec) : 250=51.30%, 500=48.04% 00:16:39.661 lat (msec) : 4=0.05%, 50=0.61% 00:16:39.661 cpu : usr=2.22%, sys=3.68%, ctx=1963, majf=0, minf=1 00:16:39.661 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:39.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.661 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.661 issued rwts: total=939,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.661 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:39.661 00:16:39.661 Run status group 0 (all jobs): 00:16:39.661 READ: bw=13.8MiB/s (14.4MB/s), 94.4KiB/s-6625KiB/s (96.7kB/s-6784kB/s), io=14.2MiB (14.9MB), run=1001-1035msec 00:16:39.661 WRITE: bw=18.4MiB/s (19.3MB/s), 2014KiB/s-8184KiB/s (2062kB/s-8380kB/s), io=19.1MiB (20.0MB), run=1001-1035msec 00:16:39.661 00:16:39.661 Disk stats (read/write): 00:16:39.661 nvme0n1: ios=68/512, merge=0/0, ticks=724/103, in_queue=827, util=87.07% 00:16:39.661 nvme0n2: ios=900/1024, merge=0/0, ticks=578/228, in_queue=806, util=87.08% 00:16:39.661 nvme0n3: ios=1536/1589, merge=0/0, ticks=448/334, in_queue=782, util=89.02% 00:16:39.661 nvme0n4: ios=722/1024, merge=0/0, ticks=736/199, in_queue=935, util=90.74% 00:16:39.661 20:17:44 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:39.661 [global] 00:16:39.661 thread=1 00:16:39.661 invalidate=1 00:16:39.661 rw=randwrite 00:16:39.661 time_based=1 00:16:39.661 runtime=1 00:16:39.661 ioengine=libaio 00:16:39.661 direct=1 00:16:39.661 bs=4096 00:16:39.661 iodepth=1 00:16:39.661 norandommap=0 00:16:39.661 numjobs=1 00:16:39.661 00:16:39.661 verify_dump=1 00:16:39.661 verify_backlog=512 00:16:39.661 verify_state_save=0 00:16:39.661 do_verify=1 00:16:39.661 verify=crc32c-intel 00:16:39.661 [job0] 00:16:39.661 filename=/dev/nvme0n1 00:16:39.661 [job1] 00:16:39.661 filename=/dev/nvme0n2 00:16:39.661 [job2] 00:16:39.661 filename=/dev/nvme0n3 00:16:39.661 [job3] 00:16:39.661 filename=/dev/nvme0n4 00:16:39.920 Could not set queue depth (nvme0n1) 00:16:39.920 Could not set queue depth (nvme0n2) 00:16:39.920 Could not set queue depth (nvme0n3) 00:16:39.920 Could not set queue depth (nvme0n4) 00:16:39.920 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.920 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.920 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.920 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.920 fio-3.35 00:16:39.920 Starting 4 threads 00:16:41.298 00:16:41.298 job0: (groupid=0, jobs=1): err= 0: pid=3164911: Wed Nov 20 20:17:46 2024 00:16:41.298 read: IOPS=1370, BW=5482KiB/s (5613kB/s)(5520KiB/1007msec) 00:16:41.298 slat (nsec): min=4522, max=50342, avg=14675.49, stdev=7644.43 00:16:41.298 clat (usec): min=206, max=42047, avg=482.55, stdev=2485.37 00:16:41.298 lat (usec): min=212, max=42055, avg=497.23, stdev=2485.16 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 221], 5.00th=[ 235], 10.00th=[ 243], 20.00th=[ 255], 00:16:41.298 | 30.00th=[ 265], 40.00th=[ 281], 50.00th=[ 297], 60.00th=[ 314], 00:16:41.298 | 70.00th=[ 343], 80.00th=[ 441], 90.00th=[ 482], 95.00th=[ 529], 00:16:41.298 | 99.00th=[ 611], 99.50th=[ 676], 99.90th=[42206], 99.95th=[42206], 00:16:41.298 | 99.99th=[42206] 00:16:41.298 write: IOPS=1525, BW=6101KiB/s (6248kB/s)(6144KiB/1007msec); 0 zone resets 00:16:41.298 slat (nsec): min=6084, max=63909, avg=11589.97, stdev=5601.93 00:16:41.298 clat (usec): min=145, max=462, avg=189.90, stdev=34.85 00:16:41.298 lat (usec): min=153, max=477, avg=201.49, stdev=34.96 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 151], 5.00th=[ 157], 10.00th=[ 163], 20.00th=[ 167], 00:16:41.298 | 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 182], 60.00th=[ 188], 00:16:41.298 | 70.00th=[ 198], 80.00th=[ 208], 90.00th=[ 221], 95.00th=[ 235], 00:16:41.298 | 99.00th=[ 383], 99.50th=[ 400], 99.90th=[ 461], 99.95th=[ 461], 00:16:41.298 | 99.99th=[ 461] 00:16:41.298 bw ( KiB/s): min= 4096, max= 8192, per=30.93%, avg=6144.00, stdev=2896.31, samples=2 00:16:41.298 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:41.298 lat (usec) : 250=58.23%, 500=37.96%, 750=3.60% 00:16:41.298 lat (msec) : 4=0.03%, 50=0.17% 00:16:41.298 cpu : usr=1.99%, sys=3.98%, ctx=2917, majf=0, minf=1 00:16:41.298 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:41.298 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.298 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.298 issued rwts: total=1380,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.298 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:41.298 job1: (groupid=0, jobs=1): err= 0: pid=3164912: Wed Nov 20 20:17:46 2024 00:16:41.298 read: IOPS=24, BW=98.8KiB/s (101kB/s)(100KiB/1012msec) 00:16:41.298 slat (nsec): min=9031, max=34619, avg=18819.92, stdev=7956.36 00:16:41.298 clat (usec): min=377, max=42039, avg=34938.12, stdev=15366.46 00:16:41.298 lat (usec): min=411, max=42054, avg=34956.94, stdev=15365.64 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 379], 5.00th=[ 420], 10.00th=[ 478], 20.00th=[40633], 00:16:41.298 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:16:41.298 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:41.298 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:41.298 | 99.99th=[42206] 00:16:41.298 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:16:41.298 slat (nsec): min=8817, max=56202, avg=16003.21, stdev=7364.79 00:16:41.298 clat (usec): min=176, max=468, avg=247.56, stdev=45.13 00:16:41.298 lat (usec): min=185, max=507, avg=263.56, stdev=46.19 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 182], 5.00th=[ 196], 10.00th=[ 204], 20.00th=[ 215], 00:16:41.298 | 30.00th=[ 221], 40.00th=[ 229], 50.00th=[ 235], 60.00th=[ 245], 00:16:41.298 | 70.00th=[ 258], 80.00th=[ 281], 90.00th=[ 318], 95.00th=[ 343], 00:16:41.298 | 99.00th=[ 379], 99.50th=[ 420], 99.90th=[ 469], 99.95th=[ 469], 00:16:41.298 | 99.99th=[ 469] 00:16:41.298 bw ( KiB/s): min= 4096, max= 4096, per=20.62%, avg=4096.00, stdev= 0.00, samples=1 00:16:41.298 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:41.298 lat (usec) : 250=61.08%, 500=34.82%, 750=0.19% 00:16:41.298 lat (msec) : 50=3.91% 00:16:41.298 cpu : usr=0.20%, sys=1.48%, ctx=538, majf=0, minf=1 00:16:41.298 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:41.298 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.298 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.298 issued rwts: total=25,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.298 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:41.298 job2: (groupid=0, jobs=1): err= 0: pid=3164913: Wed Nov 20 20:17:46 2024 00:16:41.298 read: IOPS=1756, BW=7025KiB/s (7194kB/s)(7032KiB/1001msec) 00:16:41.298 slat (nsec): min=5939, max=67469, avg=14900.02, stdev=8487.94 00:16:41.298 clat (usec): min=213, max=545, avg=285.82, stdev=47.63 00:16:41.298 lat (usec): min=223, max=562, avg=300.72, stdev=50.11 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 227], 5.00th=[ 237], 10.00th=[ 243], 20.00th=[ 251], 00:16:41.298 | 30.00th=[ 260], 40.00th=[ 269], 50.00th=[ 281], 60.00th=[ 289], 00:16:41.298 | 70.00th=[ 293], 80.00th=[ 306], 90.00th=[ 330], 95.00th=[ 355], 00:16:41.298 | 99.00th=[ 490], 99.50th=[ 498], 99.90th=[ 529], 99.95th=[ 545], 00:16:41.298 | 99.99th=[ 545] 00:16:41.298 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:41.298 slat (nsec): min=7836, max=77853, avg=14988.14, stdev=6216.53 00:16:41.298 clat (usec): min=148, max=466, avg=207.73, stdev=35.59 00:16:41.298 lat (usec): min=159, max=489, avg=222.72, stdev=36.92 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 155], 5.00th=[ 165], 10.00th=[ 176], 20.00th=[ 184], 00:16:41.298 | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 200], 60.00th=[ 208], 00:16:41.298 | 70.00th=[ 215], 80.00th=[ 227], 90.00th=[ 249], 95.00th=[ 281], 00:16:41.298 | 99.00th=[ 338], 99.50th=[ 367], 99.90th=[ 429], 99.95th=[ 441], 00:16:41.298 | 99.99th=[ 465] 00:16:41.298 bw ( KiB/s): min= 8192, max= 8192, per=41.24%, avg=8192.00, stdev= 0.00, samples=1 00:16:41.298 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:41.298 lat (usec) : 250=57.75%, 500=42.04%, 750=0.21% 00:16:41.298 cpu : usr=2.80%, sys=6.00%, ctx=3809, majf=0, minf=1 00:16:41.298 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:41.298 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.298 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.298 issued rwts: total=1758,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.298 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:41.298 job3: (groupid=0, jobs=1): err= 0: pid=3164914: Wed Nov 20 20:17:46 2024 00:16:41.298 read: IOPS=499, BW=1998KiB/s (2046kB/s)(2060KiB/1031msec) 00:16:41.298 slat (nsec): min=4683, max=34454, avg=11861.37, stdev=5855.56 00:16:41.298 clat (usec): min=219, max=42145, avg=1500.92, stdev=6698.95 00:16:41.298 lat (usec): min=229, max=42160, avg=1512.78, stdev=6699.24 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 225], 5.00th=[ 237], 10.00th=[ 241], 20.00th=[ 251], 00:16:41.298 | 30.00th=[ 260], 40.00th=[ 269], 50.00th=[ 297], 60.00th=[ 392], 00:16:41.298 | 70.00th=[ 441], 80.00th=[ 482], 90.00th=[ 545], 95.00th=[ 652], 00:16:41.298 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:41.298 | 99.99th=[42206] 00:16:41.298 write: IOPS=993, BW=3973KiB/s (4068kB/s)(4096KiB/1031msec); 0 zone resets 00:16:41.298 slat (nsec): min=5496, max=51146, avg=10329.02, stdev=4930.02 00:16:41.298 clat (usec): min=157, max=620, avg=230.76, stdev=78.04 00:16:41.298 lat (usec): min=165, max=628, avg=241.09, stdev=78.69 00:16:41.298 clat percentiles (usec): 00:16:41.298 | 1.00th=[ 163], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 184], 00:16:41.298 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 202], 60.00th=[ 208], 00:16:41.298 | 70.00th=[ 221], 80.00th=[ 258], 90.00th=[ 375], 95.00th=[ 408], 00:16:41.298 | 99.00th=[ 490], 99.50th=[ 529], 99.90th=[ 578], 99.95th=[ 619], 00:16:41.298 | 99.99th=[ 619] 00:16:41.298 bw ( KiB/s): min= 4096, max= 4096, per=20.62%, avg=4096.00, stdev= 0.00, samples=2 00:16:41.298 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:41.298 lat (usec) : 250=58.15%, 500=35.67%, 750=5.07%, 1000=0.06% 00:16:41.298 lat (msec) : 4=0.06%, 20=0.06%, 50=0.91% 00:16:41.298 cpu : usr=0.87%, sys=1.55%, ctx=1539, majf=0, minf=1 00:16:41.299 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:41.299 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.299 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.299 issued rwts: total=515,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.299 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:41.299 00:16:41.299 Run status group 0 (all jobs): 00:16:41.299 READ: bw=13.9MiB/s (14.6MB/s), 98.8KiB/s-7025KiB/s (101kB/s-7194kB/s), io=14.4MiB (15.1MB), run=1001-1031msec 00:16:41.299 WRITE: bw=19.4MiB/s (20.3MB/s), 2024KiB/s-8184KiB/s (2072kB/s-8380kB/s), io=20.0MiB (21.0MB), run=1001-1031msec 00:16:41.299 00:16:41.299 Disk stats (read/write): 00:16:41.299 nvme0n1: ios=1342/1536, merge=0/0, ticks=1489/271, in_queue=1760, util=97.90% 00:16:41.299 nvme0n2: ios=58/512, merge=0/0, ticks=883/120, in_queue=1003, util=96.64% 00:16:41.299 nvme0n3: ios=1585/1604, merge=0/0, ticks=1278/313, in_queue=1591, util=99.58% 00:16:41.299 nvme0n4: ios=512/782, merge=0/0, ticks=645/189, in_queue=834, util=89.68% 00:16:41.299 20:17:46 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:41.299 [global] 00:16:41.299 thread=1 00:16:41.299 invalidate=1 00:16:41.299 rw=write 00:16:41.299 time_based=1 00:16:41.299 runtime=1 00:16:41.299 ioengine=libaio 00:16:41.299 direct=1 00:16:41.299 bs=4096 00:16:41.299 iodepth=128 00:16:41.299 norandommap=0 00:16:41.299 numjobs=1 00:16:41.299 00:16:41.299 verify_dump=1 00:16:41.299 verify_backlog=512 00:16:41.299 verify_state_save=0 00:16:41.299 do_verify=1 00:16:41.299 verify=crc32c-intel 00:16:41.299 [job0] 00:16:41.299 filename=/dev/nvme0n1 00:16:41.299 [job1] 00:16:41.299 filename=/dev/nvme0n2 00:16:41.299 [job2] 00:16:41.299 filename=/dev/nvme0n3 00:16:41.299 [job3] 00:16:41.299 filename=/dev/nvme0n4 00:16:41.299 Could not set queue depth (nvme0n1) 00:16:41.299 Could not set queue depth (nvme0n2) 00:16:41.299 Could not set queue depth (nvme0n3) 00:16:41.299 Could not set queue depth (nvme0n4) 00:16:41.559 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.559 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.559 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.559 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.559 fio-3.35 00:16:41.559 Starting 4 threads 00:16:42.936 00:16:42.936 job0: (groupid=0, jobs=1): err= 0: pid=3165266: Wed Nov 20 20:17:47 2024 00:16:42.936 read: IOPS=3317, BW=13.0MiB/s (13.6MB/s)(13.0MiB/1004msec) 00:16:42.936 slat (usec): min=2, max=11904, avg=95.59, stdev=651.01 00:16:42.936 clat (usec): min=2487, max=44901, avg=12436.64, stdev=5658.14 00:16:42.936 lat (usec): min=3808, max=44909, avg=12532.23, stdev=5699.39 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 5407], 5.00th=[ 7832], 10.00th=[ 8455], 20.00th=[ 9110], 00:16:42.936 | 30.00th=[ 9765], 40.00th=[10290], 50.00th=[10945], 60.00th=[11469], 00:16:42.936 | 70.00th=[12387], 80.00th=[14222], 90.00th=[18220], 95.00th=[21365], 00:16:42.936 | 99.00th=[40633], 99.50th=[41681], 99.90th=[44827], 99.95th=[44827], 00:16:42.936 | 99.99th=[44827] 00:16:42.936 write: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec); 0 zone resets 00:16:42.936 slat (usec): min=3, max=12741, avg=177.48, stdev=1027.82 00:16:42.936 clat (msec): min=2, max=130, avg=23.98, stdev=26.11 00:16:42.936 lat (msec): min=2, max=130, avg=24.15, stdev=26.28 00:16:42.936 clat percentiles (msec): 00:16:42.936 | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], 00:16:42.936 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 14], 00:16:42.936 | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 58], 95.00th=[ 99], 00:16:42.936 | 99.00th=[ 121], 99.50th=[ 126], 99.90th=[ 131], 99.95th=[ 131], 00:16:42.936 | 99.99th=[ 131] 00:16:42.936 bw ( KiB/s): min=12272, max=16400, per=21.64%, avg=14336.00, stdev=2918.94, samples=2 00:16:42.936 iops : min= 3068, max= 4100, avg=3584.00, stdev=729.73, samples=2 00:16:42.936 lat (msec) : 4=0.39%, 10=27.79%, 20=50.59%, 50=15.16%, 100=3.70% 00:16:42.936 lat (msec) : 250=2.37% 00:16:42.936 cpu : usr=3.59%, sys=7.48%, ctx=341, majf=0, minf=1 00:16:42.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:42.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.936 issued rwts: total=3331,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.936 job1: (groupid=0, jobs=1): err= 0: pid=3165267: Wed Nov 20 20:17:47 2024 00:16:42.936 read: IOPS=3695, BW=14.4MiB/s (15.1MB/s)(14.5MiB/1004msec) 00:16:42.936 slat (usec): min=2, max=36260, avg=138.95, stdev=1218.00 00:16:42.936 clat (usec): min=631, max=98876, avg=17873.59, stdev=17501.71 00:16:42.936 lat (usec): min=3974, max=98891, avg=18012.53, stdev=17644.02 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 4228], 5.00th=[ 8848], 10.00th=[10028], 20.00th=[10421], 00:16:42.936 | 30.00th=[10683], 40.00th=[10814], 50.00th=[10945], 60.00th=[11994], 00:16:42.936 | 70.00th=[14615], 80.00th=[15401], 90.00th=[36963], 95.00th=[67634], 00:16:42.936 | 99.00th=[85459], 99.50th=[87557], 99.90th=[93848], 99.95th=[99091], 00:16:42.936 | 99.99th=[99091] 00:16:42.936 write: IOPS=4079, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1004msec); 0 zone resets 00:16:42.936 slat (usec): min=3, max=26137, avg=109.15, stdev=815.40 00:16:42.936 clat (usec): min=1149, max=68242, avg=14784.25, stdev=8080.32 00:16:42.936 lat (usec): min=1166, max=68261, avg=14893.39, stdev=8154.59 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 3851], 5.00th=[ 9110], 10.00th=[ 9896], 20.00th=[11338], 00:16:42.936 | 30.00th=[11600], 40.00th=[11731], 50.00th=[11994], 60.00th=[12387], 00:16:42.936 | 70.00th=[13698], 80.00th=[15926], 90.00th=[23462], 95.00th=[32637], 00:16:42.936 | 99.00th=[51643], 99.50th=[52167], 99.90th=[52691], 99.95th=[57934], 00:16:42.936 | 99.99th=[68682] 00:16:42.936 bw ( KiB/s): min=11944, max=20808, per=24.72%, avg=16376.00, stdev=6267.79, samples=2 00:16:42.936 iops : min= 2986, max= 5202, avg=4094.00, stdev=1566.95, samples=2 00:16:42.936 lat (usec) : 750=0.01% 00:16:42.936 lat (msec) : 2=0.23%, 4=0.59%, 10=9.26%, 20=76.03%, 50=8.98% 00:16:42.936 lat (msec) : 100=4.89% 00:16:42.936 cpu : usr=4.89%, sys=8.18%, ctx=356, majf=0, minf=1 00:16:42.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:42.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.936 issued rwts: total=3710,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.936 job2: (groupid=0, jobs=1): err= 0: pid=3165268: Wed Nov 20 20:17:47 2024 00:16:42.936 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:16:42.936 slat (usec): min=3, max=10117, avg=90.56, stdev=637.64 00:16:42.936 clat (usec): min=3709, max=28855, avg=11774.19, stdev=2368.06 00:16:42.936 lat (usec): min=4011, max=28867, avg=11864.76, stdev=2422.17 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 7767], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[10552], 00:16:42.936 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11469], 00:16:42.936 | 70.00th=[11731], 80.00th=[12387], 90.00th=[14222], 95.00th=[16712], 00:16:42.936 | 99.00th=[20317], 99.50th=[21890], 99.90th=[26346], 99.95th=[28967], 00:16:42.936 | 99.99th=[28967] 00:16:42.936 write: IOPS=5350, BW=20.9MiB/s (21.9MB/s)(20.9MiB/1002msec); 0 zone resets 00:16:42.936 slat (usec): min=4, max=25247, avg=87.76, stdev=694.83 00:16:42.936 clat (usec): min=1140, max=41193, avg=11862.28, stdev=4874.26 00:16:42.936 lat (usec): min=1720, max=41210, avg=11950.04, stdev=4929.31 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 3982], 5.00th=[ 6390], 10.00th=[ 7373], 20.00th=[ 9896], 00:16:42.936 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:16:42.936 | 70.00th=[12125], 80.00th=[12649], 90.00th=[15664], 95.00th=[16319], 00:16:42.936 | 99.00th=[40633], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:42.936 | 99.99th=[41157] 00:16:42.936 bw ( KiB/s): min=20480, max=21392, per=31.61%, avg=20936.00, stdev=644.88, samples=2 00:16:42.936 iops : min= 5120, max= 5348, avg=5234.00, stdev=161.22, samples=2 00:16:42.936 lat (msec) : 2=0.02%, 4=0.54%, 10=15.35%, 20=81.62%, 50=2.46% 00:16:42.936 cpu : usr=8.49%, sys=8.29%, ctx=402, majf=0, minf=1 00:16:42.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:42.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.936 issued rwts: total=5120,5361,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.936 job3: (groupid=0, jobs=1): err= 0: pid=3165269: Wed Nov 20 20:17:47 2024 00:16:42.936 read: IOPS=3302, BW=12.9MiB/s (13.5MB/s)(12.9MiB/1003msec) 00:16:42.936 slat (usec): min=2, max=14562, avg=112.75, stdev=898.90 00:16:42.936 clat (usec): min=421, max=40741, avg=15312.32, stdev=5696.48 00:16:42.936 lat (usec): min=3514, max=40776, avg=15425.08, stdev=5771.91 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 6456], 5.00th=[ 6980], 10.00th=[ 9896], 20.00th=[11338], 00:16:42.936 | 30.00th=[11863], 40.00th=[12518], 50.00th=[13698], 60.00th=[15008], 00:16:42.936 | 70.00th=[17171], 80.00th=[20055], 90.00th=[24773], 95.00th=[26084], 00:16:42.936 | 99.00th=[30540], 99.50th=[33424], 99.90th=[34866], 99.95th=[38011], 00:16:42.936 | 99.99th=[40633] 00:16:42.936 write: IOPS=3573, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1003msec); 0 zone resets 00:16:42.936 slat (usec): min=3, max=69062, avg=141.63, stdev=1487.08 00:16:42.936 clat (usec): min=2151, max=80785, avg=17799.76, stdev=12362.24 00:16:42.936 lat (msec): min=2, max=111, avg=17.94, stdev=12.53 00:16:42.936 clat percentiles (usec): 00:16:42.936 | 1.00th=[ 3228], 5.00th=[ 5669], 10.00th=[ 7963], 20.00th=[10159], 00:16:42.936 | 30.00th=[11076], 40.00th=[11731], 50.00th=[12256], 60.00th=[12911], 00:16:42.936 | 70.00th=[16909], 80.00th=[26346], 90.00th=[39060], 95.00th=[44827], 00:16:42.936 | 99.00th=[56361], 99.50th=[56361], 99.90th=[56886], 99.95th=[56886], 00:16:42.936 | 99.99th=[81265] 00:16:42.936 bw ( KiB/s): min=12288, max=16384, per=21.64%, avg=14336.00, stdev=2896.31, samples=2 00:16:42.936 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:16:42.936 lat (usec) : 500=0.01% 00:16:42.936 lat (msec) : 4=1.22%, 10=12.30%, 20=62.31%, 50=22.80%, 100=1.36% 00:16:42.936 cpu : usr=2.20%, sys=4.39%, ctx=256, majf=0, minf=1 00:16:42.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:42.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.936 issued rwts: total=3312,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.936 00:16:42.936 Run status group 0 (all jobs): 00:16:42.936 READ: bw=60.2MiB/s (63.1MB/s), 12.9MiB/s-20.0MiB/s (13.5MB/s-20.9MB/s), io=60.4MiB (63.4MB), run=1002-1004msec 00:16:42.936 WRITE: bw=64.7MiB/s (67.8MB/s), 13.9MiB/s-20.9MiB/s (14.6MB/s-21.9MB/s), io=64.9MiB (68.1MB), run=1002-1004msec 00:16:42.936 00:16:42.936 Disk stats (read/write): 00:16:42.936 nvme0n1: ios=3122/3231, merge=0/0, ticks=34011/60958, in_queue=94969, util=87.78% 00:16:42.936 nvme0n2: ios=3451/3584, merge=0/0, ticks=23016/25211, in_queue=48227, util=97.36% 00:16:42.936 nvme0n3: ios=4201/4608, merge=0/0, ticks=43751/46564, in_queue=90315, util=95.73% 00:16:42.936 nvme0n4: ios=2578/2915, merge=0/0, ticks=39926/53064, in_queue=92990, util=100.00% 00:16:42.936 20:17:47 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:42.936 [global] 00:16:42.936 thread=1 00:16:42.936 invalidate=1 00:16:42.936 rw=randwrite 00:16:42.936 time_based=1 00:16:42.936 runtime=1 00:16:42.936 ioengine=libaio 00:16:42.936 direct=1 00:16:42.936 bs=4096 00:16:42.936 iodepth=128 00:16:42.936 norandommap=0 00:16:42.936 numjobs=1 00:16:42.936 00:16:42.936 verify_dump=1 00:16:42.936 verify_backlog=512 00:16:42.936 verify_state_save=0 00:16:42.936 do_verify=1 00:16:42.936 verify=crc32c-intel 00:16:42.936 [job0] 00:16:42.936 filename=/dev/nvme0n1 00:16:42.936 [job1] 00:16:42.936 filename=/dev/nvme0n2 00:16:42.936 [job2] 00:16:42.936 filename=/dev/nvme0n3 00:16:42.936 [job3] 00:16:42.936 filename=/dev/nvme0n4 00:16:42.936 Could not set queue depth (nvme0n1) 00:16:42.936 Could not set queue depth (nvme0n2) 00:16:42.937 Could not set queue depth (nvme0n3) 00:16:42.937 Could not set queue depth (nvme0n4) 00:16:42.937 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.937 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.937 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.937 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.937 fio-3.35 00:16:42.937 Starting 4 threads 00:16:44.321 00:16:44.321 job0: (groupid=0, jobs=1): err= 0: pid=3165503: Wed Nov 20 20:17:49 2024 00:16:44.321 read: IOPS=5635, BW=22.0MiB/s (23.1MB/s)(22.2MiB/1009msec) 00:16:44.321 slat (usec): min=2, max=9373, avg=86.17, stdev=607.43 00:16:44.321 clat (usec): min=3555, max=26663, avg=10816.43, stdev=2993.81 00:16:44.321 lat (usec): min=3564, max=26669, avg=10902.60, stdev=3033.36 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 4948], 5.00th=[ 7701], 10.00th=[ 8291], 20.00th=[ 9241], 00:16:44.321 | 30.00th=[ 9372], 40.00th=[ 9634], 50.00th=[ 9765], 60.00th=[10028], 00:16:44.321 | 70.00th=[10683], 80.00th=[12387], 90.00th=[15270], 95.00th=[17433], 00:16:44.321 | 99.00th=[20055], 99.50th=[23462], 99.90th=[25560], 99.95th=[26608], 00:16:44.321 | 99.99th=[26608] 00:16:44.321 write: IOPS=6089, BW=23.8MiB/s (24.9MB/s)(24.0MiB/1009msec); 0 zone resets 00:16:44.321 slat (usec): min=3, max=8427, avg=72.95, stdev=345.95 00:16:44.321 clat (usec): min=1543, max=26663, avg=10799.80, stdev=3954.30 00:16:44.321 lat (usec): min=1550, max=26685, avg=10872.75, stdev=3982.35 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 2737], 5.00th=[ 4359], 10.00th=[ 5866], 20.00th=[ 8160], 00:16:44.321 | 30.00th=[ 9896], 40.00th=[10290], 50.00th=[10814], 60.00th=[11207], 00:16:44.321 | 70.00th=[11338], 80.00th=[11469], 90.00th=[17957], 95.00th=[18744], 00:16:44.321 | 99.00th=[19792], 99.50th=[23725], 99.90th=[25822], 99.95th=[25822], 00:16:44.321 | 99.99th=[26608] 00:16:44.321 bw ( KiB/s): min=23944, max=24624, per=37.39%, avg=24284.00, stdev=480.83, samples=2 00:16:44.321 iops : min= 5986, max= 6156, avg=6071.00, stdev=120.21, samples=2 00:16:44.321 lat (msec) : 2=0.28%, 4=2.18%, 10=43.72%, 20=52.98%, 50=0.84% 00:16:44.321 cpu : usr=7.84%, sys=11.41%, ctx=643, majf=0, minf=2 00:16:44.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:44.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.321 issued rwts: total=5686,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.321 job1: (groupid=0, jobs=1): err= 0: pid=3165504: Wed Nov 20 20:17:49 2024 00:16:44.321 read: IOPS=3279, BW=12.8MiB/s (13.4MB/s)(12.9MiB/1005msec) 00:16:44.321 slat (usec): min=3, max=21317, avg=148.37, stdev=991.79 00:16:44.321 clat (usec): min=2679, max=63342, avg=18847.69, stdev=10853.61 00:16:44.321 lat (usec): min=6425, max=68494, avg=18996.06, stdev=10942.43 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 6915], 5.00th=[ 9503], 10.00th=[ 9765], 20.00th=[10028], 00:16:44.321 | 30.00th=[10814], 40.00th=[13960], 50.00th=[15926], 60.00th=[17957], 00:16:44.321 | 70.00th=[21890], 80.00th=[26608], 90.00th=[29492], 95.00th=[36439], 00:16:44.321 | 99.00th=[62129], 99.50th=[63177], 99.90th=[63177], 99.95th=[63177], 00:16:44.321 | 99.99th=[63177] 00:16:44.321 write: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec); 0 zone resets 00:16:44.321 slat (usec): min=3, max=10117, avg=133.09, stdev=764.06 00:16:44.321 clat (usec): min=5907, max=56821, avg=18098.16, stdev=9573.21 00:16:44.321 lat (usec): min=5912, max=57138, avg=18231.25, stdev=9637.58 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 6456], 5.00th=[10159], 10.00th=[10552], 20.00th=[10683], 00:16:44.321 | 30.00th=[10945], 40.00th=[11469], 50.00th=[16450], 60.00th=[18482], 00:16:44.321 | 70.00th=[20317], 80.00th=[21890], 90.00th=[31327], 95.00th=[42206], 00:16:44.321 | 99.00th=[47973], 99.50th=[49546], 99.90th=[56886], 99.95th=[56886], 00:16:44.321 | 99.99th=[56886] 00:16:44.321 bw ( KiB/s): min=12288, max=16416, per=22.10%, avg=14352.00, stdev=2918.94, samples=2 00:16:44.321 iops : min= 3072, max= 4104, avg=3588.00, stdev=729.73, samples=2 00:16:44.321 lat (msec) : 4=0.01%, 10=10.70%, 20=56.29%, 50=31.16%, 100=1.83% 00:16:44.321 cpu : usr=4.38%, sys=6.77%, ctx=271, majf=0, minf=1 00:16:44.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:44.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.321 issued rwts: total=3296,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.321 job2: (groupid=0, jobs=1): err= 0: pid=3165507: Wed Nov 20 20:17:49 2024 00:16:44.321 read: IOPS=3114, BW=12.2MiB/s (12.8MB/s)(12.2MiB/1007msec) 00:16:44.321 slat (usec): min=2, max=54481, avg=166.96, stdev=1532.54 00:16:44.321 clat (usec): min=568, max=123252, avg=20771.40, stdev=19902.29 00:16:44.321 lat (msec): min=6, max=123, avg=20.94, stdev=20.00 00:16:44.321 clat percentiles (msec): 00:16:44.321 | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 13], 00:16:44.321 | 30.00th=[ 14], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 16], 00:16:44.321 | 70.00th=[ 19], 80.00th=[ 23], 90.00th=[ 31], 95.00th=[ 67], 00:16:44.321 | 99.00th=[ 120], 99.50th=[ 124], 99.90th=[ 124], 99.95th=[ 124], 00:16:44.321 | 99.99th=[ 124] 00:16:44.321 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:16:44.321 slat (usec): min=3, max=13495, avg=124.27, stdev=714.97 00:16:44.321 clat (usec): min=7056, max=41172, avg=17153.65, stdev=6084.68 00:16:44.321 lat (usec): min=7091, max=41216, avg=17277.92, stdev=6148.98 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 8225], 5.00th=[10945], 10.00th=[12649], 20.00th=[13304], 00:16:44.321 | 30.00th=[13566], 40.00th=[13698], 50.00th=[13960], 60.00th=[14353], 00:16:44.321 | 70.00th=[18482], 80.00th=[25297], 90.00th=[27657], 95.00th=[28443], 00:16:44.321 | 99.00th=[30802], 99.50th=[31065], 99.90th=[39584], 99.95th=[41157], 00:16:44.321 | 99.99th=[41157] 00:16:44.321 bw ( KiB/s): min=12296, max=15864, per=21.68%, avg=14080.00, stdev=2522.96, samples=2 00:16:44.321 iops : min= 3074, max= 3966, avg=3520.00, stdev=630.74, samples=2 00:16:44.321 lat (usec) : 750=0.01% 00:16:44.321 lat (msec) : 10=3.56%, 20=68.66%, 50=25.40%, 100=0.95%, 250=1.41% 00:16:44.321 cpu : usr=4.27%, sys=7.75%, ctx=384, majf=0, minf=1 00:16:44.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:44.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.321 issued rwts: total=3136,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.321 job3: (groupid=0, jobs=1): err= 0: pid=3165508: Wed Nov 20 20:17:49 2024 00:16:44.321 read: IOPS=3000, BW=11.7MiB/s (12.3MB/s)(11.8MiB/1007msec) 00:16:44.321 slat (nsec): min=1990, max=16029k, avg=158121.56, stdev=985405.04 00:16:44.321 clat (usec): min=1445, max=45924, avg=20165.44, stdev=6803.67 00:16:44.321 lat (usec): min=6081, max=45935, avg=20323.57, stdev=6871.57 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 6390], 5.00th=[10159], 10.00th=[10552], 20.00th=[14877], 00:16:44.321 | 30.00th=[17171], 40.00th=[17957], 50.00th=[20579], 60.00th=[21365], 00:16:44.321 | 70.00th=[22676], 80.00th=[25297], 90.00th=[28443], 95.00th=[30802], 00:16:44.321 | 99.00th=[39584], 99.50th=[45876], 99.90th=[45876], 99.95th=[45876], 00:16:44.321 | 99.99th=[45876] 00:16:44.321 write: IOPS=3050, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1007msec); 0 zone resets 00:16:44.321 slat (usec): min=3, max=14433, avg=163.96, stdev=1004.40 00:16:44.321 clat (usec): min=3309, max=45927, avg=21603.01, stdev=6866.02 00:16:44.321 lat (usec): min=3316, max=45935, avg=21766.97, stdev=6946.57 00:16:44.321 clat percentiles (usec): 00:16:44.321 | 1.00th=[ 3458], 5.00th=[12649], 10.00th=[14222], 20.00th=[16909], 00:16:44.321 | 30.00th=[17957], 40.00th=[19792], 50.00th=[20841], 60.00th=[21890], 00:16:44.321 | 70.00th=[23200], 80.00th=[26608], 90.00th=[28443], 95.00th=[36963], 00:16:44.321 | 99.00th=[43254], 99.50th=[44303], 99.90th=[45876], 99.95th=[45876], 00:16:44.321 | 99.99th=[45876] 00:16:44.321 bw ( KiB/s): min=12288, max=12288, per=18.92%, avg=12288.00, stdev= 0.00, samples=2 00:16:44.321 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:16:44.321 lat (msec) : 2=0.02%, 4=0.53%, 10=1.99%, 20=42.48%, 50=54.99% 00:16:44.321 cpu : usr=2.68%, sys=3.88%, ctx=289, majf=0, minf=1 00:16:44.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:44.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.321 issued rwts: total=3022,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.321 00:16:44.321 Run status group 0 (all jobs): 00:16:44.321 READ: bw=58.6MiB/s (61.5MB/s), 11.7MiB/s-22.0MiB/s (12.3MB/s-23.1MB/s), io=59.1MiB (62.0MB), run=1005-1009msec 00:16:44.321 WRITE: bw=63.4MiB/s (66.5MB/s), 11.9MiB/s-23.8MiB/s (12.5MB/s-24.9MB/s), io=64.0MiB (67.1MB), run=1005-1009msec 00:16:44.321 00:16:44.321 Disk stats (read/write): 00:16:44.321 nvme0n1: ios=5147/5343, merge=0/0, ticks=51699/50091, in_queue=101790, util=98.20% 00:16:44.321 nvme0n2: ios=3022/3072, merge=0/0, ticks=25592/23866, in_queue=49458, util=93.50% 00:16:44.321 nvme0n3: ios=2841/3072, merge=0/0, ticks=24846/22451, in_queue=47297, util=90.83% 00:16:44.321 nvme0n4: ios=2570/2560, merge=0/0, ticks=25702/26821, in_queue=52523, util=94.54% 00:16:44.321 20:17:49 -- target/fio.sh@55 -- # sync 00:16:44.321 20:17:49 -- target/fio.sh@59 -- # fio_pid=3165647 00:16:44.321 20:17:49 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:44.321 20:17:49 -- target/fio.sh@61 -- # sleep 3 00:16:44.321 [global] 00:16:44.321 thread=1 00:16:44.321 invalidate=1 00:16:44.321 rw=read 00:16:44.321 time_based=1 00:16:44.321 runtime=10 00:16:44.321 ioengine=libaio 00:16:44.321 direct=1 00:16:44.321 bs=4096 00:16:44.321 iodepth=1 00:16:44.321 norandommap=1 00:16:44.321 numjobs=1 00:16:44.321 00:16:44.321 [job0] 00:16:44.321 filename=/dev/nvme0n1 00:16:44.321 [job1] 00:16:44.321 filename=/dev/nvme0n2 00:16:44.321 [job2] 00:16:44.321 filename=/dev/nvme0n3 00:16:44.321 [job3] 00:16:44.321 filename=/dev/nvme0n4 00:16:44.321 Could not set queue depth (nvme0n1) 00:16:44.321 Could not set queue depth (nvme0n2) 00:16:44.321 Could not set queue depth (nvme0n3) 00:16:44.321 Could not set queue depth (nvme0n4) 00:16:44.321 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.321 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.321 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.321 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.321 fio-3.35 00:16:44.321 Starting 4 threads 00:16:47.612 20:17:52 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:47.612 20:17:52 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:47.612 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=25378816, buflen=4096 00:16:47.612 fio: pid=3165744, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:47.612 20:17:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.612 20:17:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:47.612 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=28131328, buflen=4096 00:16:47.612 fio: pid=3165743, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:47.871 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=11079680, buflen=4096 00:16:47.871 fio: pid=3165739, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:47.871 20:17:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.871 20:17:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:48.130 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=52252672, buflen=4096 00:16:48.130 fio: pid=3165740, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:48.130 20:17:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.130 20:17:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:48.130 00:16:48.130 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3165739: Wed Nov 20 20:17:53 2024 00:16:48.130 read: IOPS=796, BW=3184KiB/s (3261kB/s)(10.6MiB/3398msec) 00:16:48.130 slat (nsec): min=5823, max=53932, avg=13648.68, stdev=5342.16 00:16:48.130 clat (usec): min=205, max=42024, avg=1229.91, stdev=6127.45 00:16:48.130 lat (usec): min=211, max=42036, avg=1243.56, stdev=6128.19 00:16:48.130 clat percentiles (usec): 00:16:48.130 | 1.00th=[ 227], 5.00th=[ 239], 10.00th=[ 245], 20.00th=[ 255], 00:16:48.130 | 30.00th=[ 265], 40.00th=[ 273], 50.00th=[ 277], 60.00th=[ 285], 00:16:48.130 | 70.00th=[ 289], 80.00th=[ 306], 90.00th=[ 351], 95.00th=[ 379], 00:16:48.130 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[42206], 00:16:48.130 | 99.99th=[42206] 00:16:48.130 bw ( KiB/s): min= 96, max=13448, per=11.54%, avg=3589.33, stdev=5672.62, samples=6 00:16:48.130 iops : min= 24, max= 3362, avg=897.33, stdev=1418.16, samples=6 00:16:48.130 lat (usec) : 250=15.19%, 500=82.26%, 750=0.18% 00:16:48.130 lat (msec) : 50=2.33% 00:16:48.130 cpu : usr=0.68%, sys=1.74%, ctx=2707, majf=0, minf=2 00:16:48.130 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.130 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.130 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.130 issued rwts: total=2706,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.131 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.131 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3165740: Wed Nov 20 20:17:53 2024 00:16:48.131 read: IOPS=3478, BW=13.6MiB/s (14.2MB/s)(49.8MiB/3668msec) 00:16:48.131 slat (usec): min=4, max=33236, avg=18.35, stdev=432.26 00:16:48.131 clat (usec): min=179, max=41176, avg=264.19, stdev=723.29 00:16:48.131 lat (usec): min=194, max=41201, avg=282.54, stdev=843.97 00:16:48.131 clat percentiles (usec): 00:16:48.131 | 1.00th=[ 198], 5.00th=[ 204], 10.00th=[ 210], 20.00th=[ 217], 00:16:48.131 | 30.00th=[ 225], 40.00th=[ 233], 50.00th=[ 243], 60.00th=[ 251], 00:16:48.131 | 70.00th=[ 258], 80.00th=[ 265], 90.00th=[ 285], 95.00th=[ 347], 00:16:48.131 | 99.00th=[ 486], 99.50th=[ 519], 99.90th=[ 750], 99.95th=[ 947], 00:16:48.131 | 99.99th=[41157] 00:16:48.131 bw ( KiB/s): min= 9424, max=17128, per=44.87%, avg=13959.14, stdev=2435.68, samples=7 00:16:48.131 iops : min= 2356, max= 4282, avg=3489.71, stdev=608.91, samples=7 00:16:48.131 lat (usec) : 250=60.16%, 500=39.11%, 750=0.62%, 1000=0.05% 00:16:48.131 lat (msec) : 2=0.01%, 4=0.01%, 50=0.03% 00:16:48.131 cpu : usr=2.37%, sys=5.07%, ctx=12765, majf=0, minf=1 00:16:48.131 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.131 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.131 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.131 issued rwts: total=12758,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.131 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.131 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3165743: Wed Nov 20 20:17:53 2024 00:16:48.131 read: IOPS=2173, BW=8691KiB/s (8900kB/s)(26.8MiB/3161msec) 00:16:48.131 slat (nsec): min=6037, max=66034, avg=13312.79, stdev=6329.17 00:16:48.131 clat (usec): min=217, max=52857, avg=440.25, stdev=2109.33 00:16:48.131 lat (usec): min=225, max=52871, avg=453.57, stdev=2109.67 00:16:48.131 clat percentiles (usec): 00:16:48.131 | 1.00th=[ 237], 5.00th=[ 269], 10.00th=[ 281], 20.00th=[ 289], 00:16:48.131 | 30.00th=[ 302], 40.00th=[ 310], 50.00th=[ 322], 60.00th=[ 334], 00:16:48.131 | 70.00th=[ 347], 80.00th=[ 363], 90.00th=[ 400], 95.00th=[ 449], 00:16:48.131 | 99.00th=[ 537], 99.50th=[ 578], 99.90th=[41157], 99.95th=[41157], 00:16:48.131 | 99.99th=[52691] 00:16:48.131 bw ( KiB/s): min= 2048, max=12472, per=29.42%, avg=9152.00, stdev=3997.92, samples=6 00:16:48.131 iops : min= 512, max= 3118, avg=2288.00, stdev=999.48, samples=6 00:16:48.131 lat (usec) : 250=2.18%, 500=95.56%, 750=1.94%, 1000=0.01% 00:16:48.131 lat (msec) : 4=0.03%, 50=0.25%, 100=0.01% 00:16:48.131 cpu : usr=1.68%, sys=4.53%, ctx=6871, majf=0, minf=1 00:16:48.131 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.131 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.131 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.131 issued rwts: total=6869,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.131 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.131 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3165744: Wed Nov 20 20:17:53 2024 00:16:48.131 read: IOPS=2147, BW=8588KiB/s (8794kB/s)(24.2MiB/2886msec) 00:16:48.131 slat (nsec): min=5592, max=56347, avg=12492.58, stdev=5156.48 00:16:48.131 clat (usec): min=226, max=42003, avg=446.26, stdev=2255.58 00:16:48.131 lat (usec): min=233, max=42017, avg=458.75, stdev=2255.71 00:16:48.131 clat percentiles (usec): 00:16:48.131 | 1.00th=[ 245], 5.00th=[ 265], 10.00th=[ 277], 20.00th=[ 289], 00:16:48.131 | 30.00th=[ 297], 40.00th=[ 306], 50.00th=[ 314], 60.00th=[ 322], 00:16:48.131 | 70.00th=[ 330], 80.00th=[ 343], 90.00th=[ 363], 95.00th=[ 400], 00:16:48.131 | 99.00th=[ 529], 99.50th=[ 832], 99.90th=[41157], 99.95th=[41157], 00:16:48.131 | 99.99th=[42206] 00:16:48.131 bw ( KiB/s): min= 1704, max=12088, per=29.39%, avg=9142.40, stdev=4413.86, samples=5 00:16:48.131 iops : min= 426, max= 3022, avg=2285.60, stdev=1103.47, samples=5 00:16:48.131 lat (usec) : 250=1.89%, 500=96.77%, 750=0.66%, 1000=0.31% 00:16:48.131 lat (msec) : 2=0.03%, 4=0.02%, 50=0.31% 00:16:48.131 cpu : usr=2.08%, sys=3.88%, ctx=6198, majf=0, minf=2 00:16:48.131 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.131 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.131 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.131 issued rwts: total=6197,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.131 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.131 00:16:48.131 Run status group 0 (all jobs): 00:16:48.131 READ: bw=30.4MiB/s (31.9MB/s), 3184KiB/s-13.6MiB/s (3261kB/s-14.2MB/s), io=111MiB (117MB), run=2886-3668msec 00:16:48.131 00:16:48.131 Disk stats (read/write): 00:16:48.131 nvme0n1: ios=2702/0, merge=0/0, ticks=3203/0, in_queue=3203, util=94.91% 00:16:48.131 nvme0n2: ios=12436/0, merge=0/0, ticks=3156/0, in_queue=3156, util=93.12% 00:16:48.131 nvme0n3: ios=6914/0, merge=0/0, ticks=3425/0, in_queue=3425, util=99.72% 00:16:48.131 nvme0n4: ios=6194/0, merge=0/0, ticks=2622/0, in_queue=2622, util=96.71% 00:16:48.389 20:17:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.389 20:17:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:48.648 20:17:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.648 20:17:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:48.906 20:17:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.906 20:17:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:49.164 20:17:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:49.164 20:17:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:49.424 20:17:54 -- target/fio.sh@69 -- # fio_status=0 00:16:49.424 20:17:54 -- target/fio.sh@70 -- # wait 3165647 00:16:49.424 20:17:54 -- target/fio.sh@70 -- # fio_status=4 00:16:49.424 20:17:54 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:49.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:49.684 20:17:54 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:49.684 20:17:54 -- common/autotest_common.sh@1208 -- # local i=0 00:16:49.684 20:17:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:49.684 20:17:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:49.684 20:17:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:49.684 20:17:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:49.684 20:17:54 -- common/autotest_common.sh@1220 -- # return 0 00:16:49.684 20:17:54 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:49.684 20:17:54 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:49.684 nvmf hotplug test: fio failed as expected 00:16:49.684 20:17:54 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:49.943 20:17:54 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:49.943 20:17:54 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:49.943 20:17:54 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:49.943 20:17:54 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:49.943 20:17:54 -- target/fio.sh@91 -- # nvmftestfini 00:16:49.943 20:17:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:49.943 20:17:54 -- nvmf/common.sh@116 -- # sync 00:16:49.943 20:17:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:49.943 20:17:54 -- nvmf/common.sh@119 -- # set +e 00:16:49.943 20:17:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:49.943 20:17:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:49.943 rmmod nvme_tcp 00:16:49.943 rmmod nvme_fabrics 00:16:49.943 rmmod nvme_keyring 00:16:49.943 20:17:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:49.943 20:17:54 -- nvmf/common.sh@123 -- # set -e 00:16:49.943 20:17:54 -- nvmf/common.sh@124 -- # return 0 00:16:49.943 20:17:54 -- nvmf/common.sh@477 -- # '[' -n 3163557 ']' 00:16:49.943 20:17:54 -- nvmf/common.sh@478 -- # killprocess 3163557 00:16:49.943 20:17:54 -- common/autotest_common.sh@936 -- # '[' -z 3163557 ']' 00:16:49.943 20:17:54 -- common/autotest_common.sh@940 -- # kill -0 3163557 00:16:49.943 20:17:54 -- common/autotest_common.sh@941 -- # uname 00:16:49.943 20:17:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:49.943 20:17:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3163557 00:16:49.943 20:17:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:49.943 20:17:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:49.943 20:17:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3163557' 00:16:49.943 killing process with pid 3163557 00:16:49.943 20:17:54 -- common/autotest_common.sh@955 -- # kill 3163557 00:16:49.943 20:17:54 -- common/autotest_common.sh@960 -- # wait 3163557 00:16:50.202 20:17:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:50.202 20:17:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:50.202 20:17:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:50.202 20:17:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:50.202 20:17:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:50.202 20:17:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:50.202 20:17:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:50.202 20:17:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.739 20:17:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:52.739 00:16:52.739 real 0m24.407s 00:16:52.739 user 1m24.208s 00:16:52.739 sys 0m7.893s 00:16:52.739 20:17:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:52.739 20:17:57 -- common/autotest_common.sh@10 -- # set +x 00:16:52.739 ************************************ 00:16:52.739 END TEST nvmf_fio_target 00:16:52.739 ************************************ 00:16:52.739 20:17:57 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:52.739 20:17:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:52.739 20:17:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:52.739 20:17:57 -- common/autotest_common.sh@10 -- # set +x 00:16:52.739 ************************************ 00:16:52.739 START TEST nvmf_bdevio 00:16:52.739 ************************************ 00:16:52.739 20:17:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:52.739 * Looking for test storage... 00:16:52.739 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:52.739 20:17:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:52.739 20:17:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:52.739 20:17:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:52.739 20:17:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:52.739 20:17:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:52.739 20:17:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:52.739 20:17:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:52.739 20:17:57 -- scripts/common.sh@335 -- # IFS=.-: 00:16:52.739 20:17:57 -- scripts/common.sh@335 -- # read -ra ver1 00:16:52.739 20:17:57 -- scripts/common.sh@336 -- # IFS=.-: 00:16:52.739 20:17:57 -- scripts/common.sh@336 -- # read -ra ver2 00:16:52.739 20:17:57 -- scripts/common.sh@337 -- # local 'op=<' 00:16:52.739 20:17:57 -- scripts/common.sh@339 -- # ver1_l=2 00:16:52.739 20:17:57 -- scripts/common.sh@340 -- # ver2_l=1 00:16:52.739 20:17:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:52.739 20:17:57 -- scripts/common.sh@343 -- # case "$op" in 00:16:52.739 20:17:57 -- scripts/common.sh@344 -- # : 1 00:16:52.739 20:17:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:52.739 20:17:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:52.739 20:17:57 -- scripts/common.sh@364 -- # decimal 1 00:16:52.739 20:17:57 -- scripts/common.sh@352 -- # local d=1 00:16:52.739 20:17:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:52.739 20:17:57 -- scripts/common.sh@354 -- # echo 1 00:16:52.739 20:17:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:52.739 20:17:57 -- scripts/common.sh@365 -- # decimal 2 00:16:52.739 20:17:57 -- scripts/common.sh@352 -- # local d=2 00:16:52.739 20:17:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:52.739 20:17:57 -- scripts/common.sh@354 -- # echo 2 00:16:52.739 20:17:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:52.739 20:17:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:52.739 20:17:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:52.739 20:17:57 -- scripts/common.sh@367 -- # return 0 00:16:52.739 20:17:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:52.739 20:17:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:52.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.739 --rc genhtml_branch_coverage=1 00:16:52.739 --rc genhtml_function_coverage=1 00:16:52.739 --rc genhtml_legend=1 00:16:52.739 --rc geninfo_all_blocks=1 00:16:52.739 --rc geninfo_unexecuted_blocks=1 00:16:52.739 00:16:52.739 ' 00:16:52.739 20:17:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:52.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.739 --rc genhtml_branch_coverage=1 00:16:52.739 --rc genhtml_function_coverage=1 00:16:52.739 --rc genhtml_legend=1 00:16:52.739 --rc geninfo_all_blocks=1 00:16:52.739 --rc geninfo_unexecuted_blocks=1 00:16:52.739 00:16:52.739 ' 00:16:52.739 20:17:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:52.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.739 --rc genhtml_branch_coverage=1 00:16:52.739 --rc genhtml_function_coverage=1 00:16:52.739 --rc genhtml_legend=1 00:16:52.739 --rc geninfo_all_blocks=1 00:16:52.739 --rc geninfo_unexecuted_blocks=1 00:16:52.739 00:16:52.739 ' 00:16:52.739 20:17:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:52.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.740 --rc genhtml_branch_coverage=1 00:16:52.740 --rc genhtml_function_coverage=1 00:16:52.740 --rc genhtml_legend=1 00:16:52.740 --rc geninfo_all_blocks=1 00:16:52.740 --rc geninfo_unexecuted_blocks=1 00:16:52.740 00:16:52.740 ' 00:16:52.740 20:17:57 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:52.740 20:17:57 -- nvmf/common.sh@7 -- # uname -s 00:16:52.740 20:17:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:52.740 20:17:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:52.740 20:17:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:52.740 20:17:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:52.740 20:17:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:52.740 20:17:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:52.740 20:17:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:52.740 20:17:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:52.740 20:17:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:52.740 20:17:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:52.740 20:17:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.740 20:17:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.740 20:17:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:52.740 20:17:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:52.740 20:17:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:52.740 20:17:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:52.740 20:17:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:52.740 20:17:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:52.740 20:17:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:52.740 20:17:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.740 20:17:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.740 20:17:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.740 20:17:57 -- paths/export.sh@5 -- # export PATH 00:16:52.740 20:17:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.740 20:17:57 -- nvmf/common.sh@46 -- # : 0 00:16:52.740 20:17:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:52.740 20:17:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:52.740 20:17:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:52.740 20:17:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:52.740 20:17:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:52.740 20:17:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:52.740 20:17:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:52.740 20:17:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:52.740 20:17:57 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:52.740 20:17:57 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:52.740 20:17:57 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:52.740 20:17:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:52.740 20:17:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:52.740 20:17:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:52.740 20:17:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:52.740 20:17:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:52.740 20:17:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:52.740 20:17:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:52.740 20:17:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.740 20:17:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:52.740 20:17:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:52.740 20:17:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:52.740 20:17:57 -- common/autotest_common.sh@10 -- # set +x 00:16:54.650 20:17:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:54.650 20:17:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:54.650 20:17:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:54.650 20:17:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:54.650 20:17:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:54.650 20:17:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:54.650 20:17:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:54.650 20:17:59 -- nvmf/common.sh@294 -- # net_devs=() 00:16:54.650 20:17:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:54.650 20:17:59 -- nvmf/common.sh@295 -- # e810=() 00:16:54.650 20:17:59 -- nvmf/common.sh@295 -- # local -ga e810 00:16:54.650 20:17:59 -- nvmf/common.sh@296 -- # x722=() 00:16:54.650 20:17:59 -- nvmf/common.sh@296 -- # local -ga x722 00:16:54.650 20:17:59 -- nvmf/common.sh@297 -- # mlx=() 00:16:54.650 20:17:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:54.650 20:17:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:54.650 20:17:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:54.650 20:17:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:54.650 20:17:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:54.650 20:17:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:54.650 20:17:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:54.650 20:17:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:54.650 20:17:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:54.650 20:17:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:54.650 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:54.651 20:17:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:54.651 20:17:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:54.651 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:54.651 20:17:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:54.651 20:17:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:54.651 20:17:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.651 20:17:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:54.651 20:17:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.651 20:17:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:54.651 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:54.651 20:17:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.651 20:17:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:54.651 20:17:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.651 20:17:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:54.651 20:17:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.651 20:17:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:54.651 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:54.651 20:17:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.651 20:17:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:54.651 20:17:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:54.651 20:17:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:54.651 20:17:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:54.651 20:17:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:54.651 20:17:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:54.651 20:17:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:54.651 20:17:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:54.651 20:17:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:54.651 20:17:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:54.651 20:17:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:54.651 20:17:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:54.651 20:17:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:54.651 20:17:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:54.651 20:17:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:54.651 20:17:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:54.651 20:17:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:54.651 20:17:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:54.651 20:17:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:54.651 20:17:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:54.651 20:17:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:54.651 20:17:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:54.651 20:17:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:54.651 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:54.651 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.299 ms 00:16:54.651 00:16:54.651 --- 10.0.0.2 ping statistics --- 00:16:54.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:54.651 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:16:54.651 20:17:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:54.651 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:54.651 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:16:54.651 00:16:54.651 --- 10.0.0.1 ping statistics --- 00:16:54.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:54.651 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:16:54.651 20:17:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:54.651 20:17:59 -- nvmf/common.sh@410 -- # return 0 00:16:54.651 20:17:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:54.651 20:17:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:54.651 20:17:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:54.651 20:17:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:54.651 20:17:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:54.651 20:17:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:54.651 20:17:59 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:54.651 20:17:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:54.651 20:17:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:54.651 20:17:59 -- common/autotest_common.sh@10 -- # set +x 00:16:54.651 20:17:59 -- nvmf/common.sh@469 -- # nvmfpid=3168404 00:16:54.651 20:17:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:54.651 20:17:59 -- nvmf/common.sh@470 -- # waitforlisten 3168404 00:16:54.651 20:17:59 -- common/autotest_common.sh@829 -- # '[' -z 3168404 ']' 00:16:54.651 20:17:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:54.651 20:17:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:54.651 20:17:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:54.651 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:54.651 20:17:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:54.651 20:17:59 -- common/autotest_common.sh@10 -- # set +x 00:16:54.651 [2024-11-20 20:17:59.680189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:54.651 [2024-11-20 20:17:59.680274] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:54.910 EAL: No free 2048 kB hugepages reported on node 1 00:16:54.910 [2024-11-20 20:17:59.744532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:54.910 [2024-11-20 20:17:59.851969] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:54.910 [2024-11-20 20:17:59.852126] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:54.910 [2024-11-20 20:17:59.852148] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:54.910 [2024-11-20 20:17:59.852162] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:54.910 [2024-11-20 20:17:59.852245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:54.910 [2024-11-20 20:17:59.852303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:54.910 [2024-11-20 20:17:59.852538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:54.910 [2024-11-20 20:17:59.852542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:55.846 20:18:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:55.846 20:18:00 -- common/autotest_common.sh@862 -- # return 0 00:16:55.846 20:18:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:55.846 20:18:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:55.846 20:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:55.846 20:18:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:55.846 20:18:00 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:55.846 20:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.846 20:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:55.846 [2024-11-20 20:18:00.686684] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:55.846 20:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.846 20:18:00 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:55.846 20:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.846 20:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:55.846 Malloc0 00:16:55.846 20:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.846 20:18:00 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:55.846 20:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.846 20:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:55.846 20:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.846 20:18:00 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:55.846 20:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.846 20:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:55.846 20:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.846 20:18:00 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:55.846 20:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.846 20:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:55.846 [2024-11-20 20:18:00.738285] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:55.846 20:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.846 20:18:00 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:55.846 20:18:00 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:55.846 20:18:00 -- nvmf/common.sh@520 -- # config=() 00:16:55.846 20:18:00 -- nvmf/common.sh@520 -- # local subsystem config 00:16:55.846 20:18:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:55.846 20:18:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:55.846 { 00:16:55.846 "params": { 00:16:55.846 "name": "Nvme$subsystem", 00:16:55.846 "trtype": "$TEST_TRANSPORT", 00:16:55.846 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:55.846 "adrfam": "ipv4", 00:16:55.846 "trsvcid": "$NVMF_PORT", 00:16:55.846 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:55.846 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:55.846 "hdgst": ${hdgst:-false}, 00:16:55.846 "ddgst": ${ddgst:-false} 00:16:55.847 }, 00:16:55.847 "method": "bdev_nvme_attach_controller" 00:16:55.847 } 00:16:55.847 EOF 00:16:55.847 )") 00:16:55.847 20:18:00 -- nvmf/common.sh@542 -- # cat 00:16:55.847 20:18:00 -- nvmf/common.sh@544 -- # jq . 00:16:55.847 20:18:00 -- nvmf/common.sh@545 -- # IFS=, 00:16:55.847 20:18:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:55.847 "params": { 00:16:55.847 "name": "Nvme1", 00:16:55.847 "trtype": "tcp", 00:16:55.847 "traddr": "10.0.0.2", 00:16:55.847 "adrfam": "ipv4", 00:16:55.847 "trsvcid": "4420", 00:16:55.847 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:55.847 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:55.847 "hdgst": false, 00:16:55.847 "ddgst": false 00:16:55.847 }, 00:16:55.847 "method": "bdev_nvme_attach_controller" 00:16:55.847 }' 00:16:55.847 [2024-11-20 20:18:00.780670] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:55.847 [2024-11-20 20:18:00.780743] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3168618 ] 00:16:55.847 EAL: No free 2048 kB hugepages reported on node 1 00:16:55.847 [2024-11-20 20:18:00.842470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:56.105 [2024-11-20 20:18:00.953025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:56.106 [2024-11-20 20:18:00.953096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:56.106 [2024-11-20 20:18:00.953101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:56.366 [2024-11-20 20:18:01.251301] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:56.366 [2024-11-20 20:18:01.251351] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:56.366 I/O targets: 00:16:56.366 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:56.366 00:16:56.366 00:16:56.366 CUnit - A unit testing framework for C - Version 2.1-3 00:16:56.366 http://cunit.sourceforge.net/ 00:16:56.366 00:16:56.366 00:16:56.366 Suite: bdevio tests on: Nvme1n1 00:16:56.366 Test: blockdev write read block ...passed 00:16:56.366 Test: blockdev write zeroes read block ...passed 00:16:56.366 Test: blockdev write zeroes read no split ...passed 00:16:56.366 Test: blockdev write zeroes read split ...passed 00:16:56.626 Test: blockdev write zeroes read split partial ...passed 00:16:56.626 Test: blockdev reset ...[2024-11-20 20:18:01.407900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:56.626 [2024-11-20 20:18:01.408000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x70ff20 (9): Bad file descriptor 00:16:56.626 [2024-11-20 20:18:01.510604] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:56.626 passed 00:16:56.626 Test: blockdev write read 8 blocks ...passed 00:16:56.626 Test: blockdev write read size > 128k ...passed 00:16:56.626 Test: blockdev write read invalid size ...passed 00:16:56.626 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:56.626 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:56.626 Test: blockdev write read max offset ...passed 00:16:56.887 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:56.888 Test: blockdev writev readv 8 blocks ...passed 00:16:56.888 Test: blockdev writev readv 30 x 1block ...passed 00:16:56.888 Test: blockdev writev readv block ...passed 00:16:56.888 Test: blockdev writev readv size > 128k ...passed 00:16:56.888 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:56.888 Test: blockdev comparev and writev ...[2024-11-20 20:18:01.725524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.725567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.725592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.725610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.725938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.725963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.725984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.726000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.726336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.726361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.726382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.726398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.726713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.726737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.726767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.888 [2024-11-20 20:18:01.726784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:56.888 passed 00:16:56.888 Test: blockdev nvme passthru rw ...passed 00:16:56.888 Test: blockdev nvme passthru vendor specific ...[2024-11-20 20:18:01.809384] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.888 [2024-11-20 20:18:01.809412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.809583] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.888 [2024-11-20 20:18:01.809605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.809766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.888 [2024-11-20 20:18:01.809788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:56.888 [2024-11-20 20:18:01.809955] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.888 [2024-11-20 20:18:01.809978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:56.888 passed 00:16:56.888 Test: blockdev nvme admin passthru ...passed 00:16:56.888 Test: blockdev copy ...passed 00:16:56.888 00:16:56.888 Run Summary: Type Total Ran Passed Failed Inactive 00:16:56.888 suites 1 1 n/a 0 0 00:16:56.888 tests 23 23 23 0 0 00:16:56.888 asserts 152 152 152 0 n/a 00:16:56.888 00:16:56.888 Elapsed time = 1.235 seconds 00:16:57.149 20:18:02 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:57.149 20:18:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:57.149 20:18:02 -- common/autotest_common.sh@10 -- # set +x 00:16:57.149 20:18:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:57.149 20:18:02 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:57.149 20:18:02 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:57.149 20:18:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:57.149 20:18:02 -- nvmf/common.sh@116 -- # sync 00:16:57.149 20:18:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:57.149 20:18:02 -- nvmf/common.sh@119 -- # set +e 00:16:57.149 20:18:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:57.149 20:18:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:57.149 rmmod nvme_tcp 00:16:57.149 rmmod nvme_fabrics 00:16:57.149 rmmod nvme_keyring 00:16:57.149 20:18:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:57.149 20:18:02 -- nvmf/common.sh@123 -- # set -e 00:16:57.149 20:18:02 -- nvmf/common.sh@124 -- # return 0 00:16:57.149 20:18:02 -- nvmf/common.sh@477 -- # '[' -n 3168404 ']' 00:16:57.149 20:18:02 -- nvmf/common.sh@478 -- # killprocess 3168404 00:16:57.149 20:18:02 -- common/autotest_common.sh@936 -- # '[' -z 3168404 ']' 00:16:57.149 20:18:02 -- common/autotest_common.sh@940 -- # kill -0 3168404 00:16:57.149 20:18:02 -- common/autotest_common.sh@941 -- # uname 00:16:57.409 20:18:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:57.409 20:18:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3168404 00:16:57.409 20:18:02 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:57.409 20:18:02 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:57.409 20:18:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3168404' 00:16:57.409 killing process with pid 3168404 00:16:57.409 20:18:02 -- common/autotest_common.sh@955 -- # kill 3168404 00:16:57.409 20:18:02 -- common/autotest_common.sh@960 -- # wait 3168404 00:16:57.668 20:18:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:57.668 20:18:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:57.668 20:18:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:57.668 20:18:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:57.668 20:18:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:57.668 20:18:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:57.668 20:18:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:57.668 20:18:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.578 20:18:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:59.578 00:16:59.578 real 0m7.295s 00:16:59.578 user 0m14.114s 00:16:59.578 sys 0m2.110s 00:16:59.578 20:18:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:59.578 20:18:04 -- common/autotest_common.sh@10 -- # set +x 00:16:59.578 ************************************ 00:16:59.578 END TEST nvmf_bdevio 00:16:59.578 ************************************ 00:16:59.578 20:18:04 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:59.578 20:18:04 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:59.578 20:18:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:59.578 20:18:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:59.578 20:18:04 -- common/autotest_common.sh@10 -- # set +x 00:16:59.578 ************************************ 00:16:59.578 START TEST nvmf_bdevio_no_huge 00:16:59.578 ************************************ 00:16:59.578 20:18:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:59.837 * Looking for test storage... 00:16:59.837 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:59.837 20:18:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:59.837 20:18:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:59.837 20:18:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:59.837 20:18:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:59.837 20:18:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:59.837 20:18:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:59.837 20:18:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:59.837 20:18:04 -- scripts/common.sh@335 -- # IFS=.-: 00:16:59.837 20:18:04 -- scripts/common.sh@335 -- # read -ra ver1 00:16:59.837 20:18:04 -- scripts/common.sh@336 -- # IFS=.-: 00:16:59.837 20:18:04 -- scripts/common.sh@336 -- # read -ra ver2 00:16:59.837 20:18:04 -- scripts/common.sh@337 -- # local 'op=<' 00:16:59.837 20:18:04 -- scripts/common.sh@339 -- # ver1_l=2 00:16:59.837 20:18:04 -- scripts/common.sh@340 -- # ver2_l=1 00:16:59.837 20:18:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:59.837 20:18:04 -- scripts/common.sh@343 -- # case "$op" in 00:16:59.837 20:18:04 -- scripts/common.sh@344 -- # : 1 00:16:59.837 20:18:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:59.837 20:18:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:59.837 20:18:04 -- scripts/common.sh@364 -- # decimal 1 00:16:59.837 20:18:04 -- scripts/common.sh@352 -- # local d=1 00:16:59.837 20:18:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:59.837 20:18:04 -- scripts/common.sh@354 -- # echo 1 00:16:59.837 20:18:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:59.837 20:18:04 -- scripts/common.sh@365 -- # decimal 2 00:16:59.837 20:18:04 -- scripts/common.sh@352 -- # local d=2 00:16:59.837 20:18:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:59.837 20:18:04 -- scripts/common.sh@354 -- # echo 2 00:16:59.837 20:18:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:59.837 20:18:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:59.837 20:18:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:59.837 20:18:04 -- scripts/common.sh@367 -- # return 0 00:16:59.837 20:18:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:59.837 20:18:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:59.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.837 --rc genhtml_branch_coverage=1 00:16:59.837 --rc genhtml_function_coverage=1 00:16:59.837 --rc genhtml_legend=1 00:16:59.837 --rc geninfo_all_blocks=1 00:16:59.837 --rc geninfo_unexecuted_blocks=1 00:16:59.837 00:16:59.837 ' 00:16:59.837 20:18:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:59.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.837 --rc genhtml_branch_coverage=1 00:16:59.837 --rc genhtml_function_coverage=1 00:16:59.837 --rc genhtml_legend=1 00:16:59.838 --rc geninfo_all_blocks=1 00:16:59.838 --rc geninfo_unexecuted_blocks=1 00:16:59.838 00:16:59.838 ' 00:16:59.838 20:18:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:59.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.838 --rc genhtml_branch_coverage=1 00:16:59.838 --rc genhtml_function_coverage=1 00:16:59.838 --rc genhtml_legend=1 00:16:59.838 --rc geninfo_all_blocks=1 00:16:59.838 --rc geninfo_unexecuted_blocks=1 00:16:59.838 00:16:59.838 ' 00:16:59.838 20:18:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:59.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.838 --rc genhtml_branch_coverage=1 00:16:59.838 --rc genhtml_function_coverage=1 00:16:59.838 --rc genhtml_legend=1 00:16:59.838 --rc geninfo_all_blocks=1 00:16:59.838 --rc geninfo_unexecuted_blocks=1 00:16:59.838 00:16:59.838 ' 00:16:59.838 20:18:04 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:59.838 20:18:04 -- nvmf/common.sh@7 -- # uname -s 00:16:59.838 20:18:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:59.838 20:18:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:59.838 20:18:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:59.838 20:18:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:59.838 20:18:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:59.838 20:18:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:59.838 20:18:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:59.838 20:18:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:59.838 20:18:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:59.838 20:18:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:59.838 20:18:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.838 20:18:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.838 20:18:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:59.838 20:18:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:59.838 20:18:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:59.838 20:18:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:59.838 20:18:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:59.838 20:18:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:59.838 20:18:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:59.838 20:18:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.838 20:18:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.838 20:18:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.838 20:18:04 -- paths/export.sh@5 -- # export PATH 00:16:59.838 20:18:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.838 20:18:04 -- nvmf/common.sh@46 -- # : 0 00:16:59.838 20:18:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:59.838 20:18:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:59.838 20:18:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:59.838 20:18:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:59.838 20:18:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:59.838 20:18:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:59.838 20:18:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:59.838 20:18:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:59.838 20:18:04 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:59.838 20:18:04 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:59.838 20:18:04 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:59.838 20:18:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:59.838 20:18:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:59.838 20:18:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:59.838 20:18:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:59.838 20:18:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:59.838 20:18:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:59.838 20:18:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:59.838 20:18:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.838 20:18:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:59.838 20:18:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:59.838 20:18:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:59.838 20:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:01.804 20:18:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:01.805 20:18:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:01.805 20:18:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:01.805 20:18:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:01.805 20:18:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:01.805 20:18:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:01.805 20:18:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:01.805 20:18:06 -- nvmf/common.sh@294 -- # net_devs=() 00:17:01.805 20:18:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:01.805 20:18:06 -- nvmf/common.sh@295 -- # e810=() 00:17:01.805 20:18:06 -- nvmf/common.sh@295 -- # local -ga e810 00:17:01.805 20:18:06 -- nvmf/common.sh@296 -- # x722=() 00:17:01.805 20:18:06 -- nvmf/common.sh@296 -- # local -ga x722 00:17:01.805 20:18:06 -- nvmf/common.sh@297 -- # mlx=() 00:17:01.805 20:18:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:01.805 20:18:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:01.805 20:18:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:01.805 20:18:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:01.805 20:18:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:01.805 20:18:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:01.805 20:18:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:01.805 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:01.805 20:18:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:01.805 20:18:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:01.805 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:01.805 20:18:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:01.805 20:18:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:01.805 20:18:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:01.805 20:18:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:01.805 20:18:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:01.805 20:18:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:01.805 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:01.805 20:18:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:01.805 20:18:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:01.805 20:18:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:01.805 20:18:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:01.805 20:18:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:01.805 20:18:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:01.805 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:01.805 20:18:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:01.805 20:18:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:01.805 20:18:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:01.805 20:18:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:01.805 20:18:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:01.805 20:18:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:01.805 20:18:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:01.805 20:18:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:01.805 20:18:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:01.805 20:18:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:01.805 20:18:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:01.805 20:18:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:01.805 20:18:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:01.805 20:18:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:01.805 20:18:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:01.805 20:18:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:01.805 20:18:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:01.805 20:18:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:01.805 20:18:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:01.805 20:18:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:01.805 20:18:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:01.805 20:18:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:02.101 20:18:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:02.101 20:18:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:02.102 20:18:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:02.102 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:02.102 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:17:02.102 00:17:02.102 --- 10.0.0.2 ping statistics --- 00:17:02.102 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:02.102 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:17:02.102 20:18:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:02.102 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:02.102 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:17:02.102 00:17:02.102 --- 10.0.0.1 ping statistics --- 00:17:02.102 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:02.102 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:17:02.102 20:18:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:02.102 20:18:06 -- nvmf/common.sh@410 -- # return 0 00:17:02.102 20:18:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:02.102 20:18:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:02.102 20:18:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:02.102 20:18:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:02.102 20:18:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:02.102 20:18:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:02.102 20:18:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:02.102 20:18:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:02.102 20:18:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:02.102 20:18:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:02.102 20:18:06 -- common/autotest_common.sh@10 -- # set +x 00:17:02.102 20:18:06 -- nvmf/common.sh@469 -- # nvmfpid=3170894 00:17:02.102 20:18:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:02.102 20:18:06 -- nvmf/common.sh@470 -- # waitforlisten 3170894 00:17:02.102 20:18:06 -- common/autotest_common.sh@829 -- # '[' -z 3170894 ']' 00:17:02.102 20:18:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:02.102 20:18:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:02.102 20:18:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:02.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:02.102 20:18:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:02.102 20:18:06 -- common/autotest_common.sh@10 -- # set +x 00:17:02.102 [2024-11-20 20:18:06.997522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.102 [2024-11-20 20:18:06.997613] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:02.102 [2024-11-20 20:18:07.068213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:02.385 [2024-11-20 20:18:07.176209] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:02.385 [2024-11-20 20:18:07.176366] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:02.385 [2024-11-20 20:18:07.176384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:02.385 [2024-11-20 20:18:07.176397] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:02.385 [2024-11-20 20:18:07.176486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:02.385 [2024-11-20 20:18:07.176552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:02.385 [2024-11-20 20:18:07.176617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:02.385 [2024-11-20 20:18:07.176620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:02.953 20:18:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.953 20:18:07 -- common/autotest_common.sh@862 -- # return 0 00:17:02.953 20:18:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:02.953 20:18:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:02.953 20:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:03.213 20:18:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:03.213 20:18:08 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:03.213 20:18:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.213 20:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:03.213 [2024-11-20 20:18:08.010743] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:03.213 20:18:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.213 20:18:08 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:03.213 20:18:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.213 20:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:03.213 Malloc0 00:17:03.213 20:18:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.213 20:18:08 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:03.213 20:18:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.213 20:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:03.213 20:18:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.213 20:18:08 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:03.213 20:18:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.213 20:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:03.213 20:18:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.213 20:18:08 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:03.213 20:18:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.213 20:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:03.213 [2024-11-20 20:18:08.048907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:03.213 20:18:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.213 20:18:08 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:03.213 20:18:08 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:03.213 20:18:08 -- nvmf/common.sh@520 -- # config=() 00:17:03.213 20:18:08 -- nvmf/common.sh@520 -- # local subsystem config 00:17:03.213 20:18:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:03.213 20:18:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:03.213 { 00:17:03.213 "params": { 00:17:03.213 "name": "Nvme$subsystem", 00:17:03.213 "trtype": "$TEST_TRANSPORT", 00:17:03.213 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:03.213 "adrfam": "ipv4", 00:17:03.213 "trsvcid": "$NVMF_PORT", 00:17:03.213 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:03.213 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:03.213 "hdgst": ${hdgst:-false}, 00:17:03.213 "ddgst": ${ddgst:-false} 00:17:03.213 }, 00:17:03.213 "method": "bdev_nvme_attach_controller" 00:17:03.213 } 00:17:03.213 EOF 00:17:03.213 )") 00:17:03.213 20:18:08 -- nvmf/common.sh@542 -- # cat 00:17:03.213 20:18:08 -- nvmf/common.sh@544 -- # jq . 00:17:03.213 20:18:08 -- nvmf/common.sh@545 -- # IFS=, 00:17:03.213 20:18:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:03.213 "params": { 00:17:03.213 "name": "Nvme1", 00:17:03.214 "trtype": "tcp", 00:17:03.214 "traddr": "10.0.0.2", 00:17:03.214 "adrfam": "ipv4", 00:17:03.214 "trsvcid": "4420", 00:17:03.214 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:03.214 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:03.214 "hdgst": false, 00:17:03.214 "ddgst": false 00:17:03.214 }, 00:17:03.214 "method": "bdev_nvme_attach_controller" 00:17:03.214 }' 00:17:03.214 [2024-11-20 20:18:08.089646] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:03.214 [2024-11-20 20:18:08.089723] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3171416 ] 00:17:03.214 [2024-11-20 20:18:08.153135] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:03.473 [2024-11-20 20:18:08.267951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:03.473 [2024-11-20 20:18:08.268005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:03.473 [2024-11-20 20:18:08.268009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:03.731 [2024-11-20 20:18:08.582740] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:03.731 [2024-11-20 20:18:08.582791] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:03.731 I/O targets: 00:17:03.731 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:03.731 00:17:03.731 00:17:03.731 CUnit - A unit testing framework for C - Version 2.1-3 00:17:03.731 http://cunit.sourceforge.net/ 00:17:03.731 00:17:03.731 00:17:03.731 Suite: bdevio tests on: Nvme1n1 00:17:03.731 Test: blockdev write read block ...passed 00:17:03.731 Test: blockdev write zeroes read block ...passed 00:17:03.731 Test: blockdev write zeroes read no split ...passed 00:17:03.731 Test: blockdev write zeroes read split ...passed 00:17:03.990 Test: blockdev write zeroes read split partial ...passed 00:17:03.990 Test: blockdev reset ...[2024-11-20 20:18:08.788484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:03.990 [2024-11-20 20:18:08.788583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14197d0 (9): Bad file descriptor 00:17:03.990 [2024-11-20 20:18:08.803525] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:03.990 passed 00:17:03.990 Test: blockdev write read 8 blocks ...passed 00:17:03.990 Test: blockdev write read size > 128k ...passed 00:17:03.990 Test: blockdev write read invalid size ...passed 00:17:03.990 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:03.990 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:03.990 Test: blockdev write read max offset ...passed 00:17:03.990 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:03.990 Test: blockdev writev readv 8 blocks ...passed 00:17:03.990 Test: blockdev writev readv 30 x 1block ...passed 00:17:03.990 Test: blockdev writev readv block ...passed 00:17:03.990 Test: blockdev writev readv size > 128k ...passed 00:17:03.990 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:03.990 Test: blockdev comparev and writev ...[2024-11-20 20:18:09.016412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.016449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.016473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.016490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.016810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.016836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.016858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.016873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.017204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.017229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.017250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.017266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.017578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.017601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:03.990 [2024-11-20 20:18:09.017622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.990 [2024-11-20 20:18:09.017637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:04.248 passed 00:17:04.248 Test: blockdev nvme passthru rw ...passed 00:17:04.248 Test: blockdev nvme passthru vendor specific ...[2024-11-20 20:18:09.101328] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.248 [2024-11-20 20:18:09.101357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:04.248 [2024-11-20 20:18:09.101515] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.248 [2024-11-20 20:18:09.101538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:04.248 [2024-11-20 20:18:09.101688] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.248 [2024-11-20 20:18:09.101710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:04.248 [2024-11-20 20:18:09.101864] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.248 [2024-11-20 20:18:09.101893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:04.248 passed 00:17:04.248 Test: blockdev nvme admin passthru ...passed 00:17:04.248 Test: blockdev copy ...passed 00:17:04.248 00:17:04.248 Run Summary: Type Total Ran Passed Failed Inactive 00:17:04.248 suites 1 1 n/a 0 0 00:17:04.248 tests 23 23 23 0 0 00:17:04.248 asserts 152 152 152 0 n/a 00:17:04.248 00:17:04.248 Elapsed time = 1.156 seconds 00:17:04.507 20:18:09 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:04.507 20:18:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.507 20:18:09 -- common/autotest_common.sh@10 -- # set +x 00:17:04.767 20:18:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.767 20:18:09 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:04.767 20:18:09 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:04.767 20:18:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:04.767 20:18:09 -- nvmf/common.sh@116 -- # sync 00:17:04.767 20:18:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:04.767 20:18:09 -- nvmf/common.sh@119 -- # set +e 00:17:04.767 20:18:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:04.767 20:18:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:04.767 rmmod nvme_tcp 00:17:04.767 rmmod nvme_fabrics 00:17:04.767 rmmod nvme_keyring 00:17:04.767 20:18:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:04.767 20:18:09 -- nvmf/common.sh@123 -- # set -e 00:17:04.767 20:18:09 -- nvmf/common.sh@124 -- # return 0 00:17:04.767 20:18:09 -- nvmf/common.sh@477 -- # '[' -n 3170894 ']' 00:17:04.767 20:18:09 -- nvmf/common.sh@478 -- # killprocess 3170894 00:17:04.767 20:18:09 -- common/autotest_common.sh@936 -- # '[' -z 3170894 ']' 00:17:04.767 20:18:09 -- common/autotest_common.sh@940 -- # kill -0 3170894 00:17:04.767 20:18:09 -- common/autotest_common.sh@941 -- # uname 00:17:04.767 20:18:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:04.767 20:18:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3170894 00:17:04.767 20:18:09 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:04.768 20:18:09 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:04.768 20:18:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3170894' 00:17:04.768 killing process with pid 3170894 00:17:04.768 20:18:09 -- common/autotest_common.sh@955 -- # kill 3170894 00:17:04.768 20:18:09 -- common/autotest_common.sh@960 -- # wait 3170894 00:17:05.337 20:18:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:05.337 20:18:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:05.337 20:18:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:05.337 20:18:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:05.337 20:18:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:05.337 20:18:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:05.337 20:18:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:05.337 20:18:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:07.246 20:18:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:07.246 00:17:07.246 real 0m7.527s 00:17:07.246 user 0m14.683s 00:17:07.246 sys 0m2.586s 00:17:07.246 20:18:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:07.246 20:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:07.246 ************************************ 00:17:07.246 END TEST nvmf_bdevio_no_huge 00:17:07.246 ************************************ 00:17:07.246 20:18:12 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:07.246 20:18:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:07.246 20:18:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:07.246 20:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:07.246 ************************************ 00:17:07.246 START TEST nvmf_tls 00:17:07.246 ************************************ 00:17:07.246 20:18:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:07.246 * Looking for test storage... 00:17:07.246 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:07.246 20:18:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:07.246 20:18:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:07.246 20:18:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:07.507 20:18:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:07.507 20:18:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:07.507 20:18:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:07.507 20:18:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:07.507 20:18:12 -- scripts/common.sh@335 -- # IFS=.-: 00:17:07.507 20:18:12 -- scripts/common.sh@335 -- # read -ra ver1 00:17:07.507 20:18:12 -- scripts/common.sh@336 -- # IFS=.-: 00:17:07.507 20:18:12 -- scripts/common.sh@336 -- # read -ra ver2 00:17:07.507 20:18:12 -- scripts/common.sh@337 -- # local 'op=<' 00:17:07.507 20:18:12 -- scripts/common.sh@339 -- # ver1_l=2 00:17:07.507 20:18:12 -- scripts/common.sh@340 -- # ver2_l=1 00:17:07.507 20:18:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:07.507 20:18:12 -- scripts/common.sh@343 -- # case "$op" in 00:17:07.507 20:18:12 -- scripts/common.sh@344 -- # : 1 00:17:07.507 20:18:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:07.507 20:18:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:07.507 20:18:12 -- scripts/common.sh@364 -- # decimal 1 00:17:07.507 20:18:12 -- scripts/common.sh@352 -- # local d=1 00:17:07.507 20:18:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:07.507 20:18:12 -- scripts/common.sh@354 -- # echo 1 00:17:07.507 20:18:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:07.507 20:18:12 -- scripts/common.sh@365 -- # decimal 2 00:17:07.507 20:18:12 -- scripts/common.sh@352 -- # local d=2 00:17:07.507 20:18:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:07.507 20:18:12 -- scripts/common.sh@354 -- # echo 2 00:17:07.507 20:18:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:07.507 20:18:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:07.507 20:18:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:07.507 20:18:12 -- scripts/common.sh@367 -- # return 0 00:17:07.507 20:18:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:07.507 20:18:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:07.507 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.507 --rc genhtml_branch_coverage=1 00:17:07.507 --rc genhtml_function_coverage=1 00:17:07.507 --rc genhtml_legend=1 00:17:07.507 --rc geninfo_all_blocks=1 00:17:07.507 --rc geninfo_unexecuted_blocks=1 00:17:07.507 00:17:07.507 ' 00:17:07.507 20:18:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:07.507 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.507 --rc genhtml_branch_coverage=1 00:17:07.507 --rc genhtml_function_coverage=1 00:17:07.507 --rc genhtml_legend=1 00:17:07.507 --rc geninfo_all_blocks=1 00:17:07.507 --rc geninfo_unexecuted_blocks=1 00:17:07.507 00:17:07.507 ' 00:17:07.507 20:18:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:07.507 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.507 --rc genhtml_branch_coverage=1 00:17:07.507 --rc genhtml_function_coverage=1 00:17:07.507 --rc genhtml_legend=1 00:17:07.507 --rc geninfo_all_blocks=1 00:17:07.507 --rc geninfo_unexecuted_blocks=1 00:17:07.507 00:17:07.507 ' 00:17:07.507 20:18:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:07.507 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.507 --rc genhtml_branch_coverage=1 00:17:07.507 --rc genhtml_function_coverage=1 00:17:07.507 --rc genhtml_legend=1 00:17:07.507 --rc geninfo_all_blocks=1 00:17:07.507 --rc geninfo_unexecuted_blocks=1 00:17:07.507 00:17:07.507 ' 00:17:07.507 20:18:12 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:07.507 20:18:12 -- nvmf/common.sh@7 -- # uname -s 00:17:07.507 20:18:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:07.507 20:18:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:07.507 20:18:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:07.507 20:18:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:07.507 20:18:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:07.507 20:18:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:07.507 20:18:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:07.507 20:18:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:07.508 20:18:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:07.508 20:18:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:07.508 20:18:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:07.508 20:18:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:07.508 20:18:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:07.508 20:18:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:07.508 20:18:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:07.508 20:18:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:07.508 20:18:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:07.508 20:18:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:07.508 20:18:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:07.508 20:18:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.508 20:18:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.508 20:18:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.508 20:18:12 -- paths/export.sh@5 -- # export PATH 00:17:07.508 20:18:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.508 20:18:12 -- nvmf/common.sh@46 -- # : 0 00:17:07.508 20:18:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:07.508 20:18:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:07.508 20:18:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:07.508 20:18:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:07.508 20:18:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:07.508 20:18:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:07.508 20:18:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:07.508 20:18:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:07.508 20:18:12 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:07.508 20:18:12 -- target/tls.sh@71 -- # nvmftestinit 00:17:07.508 20:18:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:07.508 20:18:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:07.508 20:18:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:07.508 20:18:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:07.508 20:18:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:07.508 20:18:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:07.508 20:18:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:07.508 20:18:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:07.508 20:18:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:07.508 20:18:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:07.508 20:18:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:07.508 20:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:09.413 20:18:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:09.413 20:18:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:09.413 20:18:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:09.413 20:18:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:09.413 20:18:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:09.413 20:18:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:09.413 20:18:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:09.413 20:18:14 -- nvmf/common.sh@294 -- # net_devs=() 00:17:09.413 20:18:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:09.413 20:18:14 -- nvmf/common.sh@295 -- # e810=() 00:17:09.413 20:18:14 -- nvmf/common.sh@295 -- # local -ga e810 00:17:09.413 20:18:14 -- nvmf/common.sh@296 -- # x722=() 00:17:09.413 20:18:14 -- nvmf/common.sh@296 -- # local -ga x722 00:17:09.413 20:18:14 -- nvmf/common.sh@297 -- # mlx=() 00:17:09.413 20:18:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:09.413 20:18:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:09.413 20:18:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:09.413 20:18:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:09.413 20:18:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:09.413 20:18:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:09.413 20:18:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:09.413 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:09.413 20:18:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:09.413 20:18:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:09.413 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:09.413 20:18:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:09.413 20:18:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:09.413 20:18:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:09.413 20:18:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:09.413 20:18:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:09.413 20:18:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:09.413 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:09.413 20:18:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:09.413 20:18:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:09.413 20:18:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:09.413 20:18:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:09.413 20:18:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:09.413 20:18:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:09.413 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:09.413 20:18:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:09.413 20:18:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:09.413 20:18:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:09.413 20:18:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:09.413 20:18:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:09.413 20:18:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:09.413 20:18:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:09.413 20:18:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:09.413 20:18:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:09.413 20:18:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:09.413 20:18:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:09.413 20:18:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:09.413 20:18:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:09.413 20:18:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:09.413 20:18:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:09.413 20:18:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:09.413 20:18:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:09.413 20:18:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:09.413 20:18:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:09.413 20:18:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:09.413 20:18:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:09.413 20:18:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:09.413 20:18:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:09.413 20:18:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:09.413 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:09.413 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:17:09.413 00:17:09.413 --- 10.0.0.2 ping statistics --- 00:17:09.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:09.413 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:17:09.413 20:18:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:09.413 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:09.413 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:17:09.413 00:17:09.413 --- 10.0.0.1 ping statistics --- 00:17:09.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:09.413 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:17:09.413 20:18:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:09.413 20:18:14 -- nvmf/common.sh@410 -- # return 0 00:17:09.413 20:18:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:09.413 20:18:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:09.413 20:18:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:09.413 20:18:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:09.413 20:18:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:09.413 20:18:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:09.413 20:18:14 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:09.413 20:18:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:09.413 20:18:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:09.413 20:18:14 -- common/autotest_common.sh@10 -- # set +x 00:17:09.413 20:18:14 -- nvmf/common.sh@469 -- # nvmfpid=3173652 00:17:09.413 20:18:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:09.413 20:18:14 -- nvmf/common.sh@470 -- # waitforlisten 3173652 00:17:09.413 20:18:14 -- common/autotest_common.sh@829 -- # '[' -z 3173652 ']' 00:17:09.413 20:18:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:09.413 20:18:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:09.413 20:18:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:09.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:09.413 20:18:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:09.413 20:18:14 -- common/autotest_common.sh@10 -- # set +x 00:17:09.413 [2024-11-20 20:18:14.414234] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:09.413 [2024-11-20 20:18:14.414305] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:09.672 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.672 [2024-11-20 20:18:14.491638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:09.672 [2024-11-20 20:18:14.609752] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:09.672 [2024-11-20 20:18:14.609914] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:09.672 [2024-11-20 20:18:14.609933] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:09.672 [2024-11-20 20:18:14.609947] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:09.672 [2024-11-20 20:18:14.609979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.672 20:18:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:09.672 20:18:14 -- common/autotest_common.sh@862 -- # return 0 00:17:09.672 20:18:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:09.672 20:18:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:09.672 20:18:14 -- common/autotest_common.sh@10 -- # set +x 00:17:09.672 20:18:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:09.672 20:18:14 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:09.672 20:18:14 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:09.931 true 00:17:09.931 20:18:14 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:09.931 20:18:14 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:10.190 20:18:15 -- target/tls.sh@82 -- # version=0 00:17:10.190 20:18:15 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:10.190 20:18:15 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:10.760 20:18:15 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.760 20:18:15 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:10.760 20:18:15 -- target/tls.sh@90 -- # version=13 00:17:10.760 20:18:15 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:10.760 20:18:15 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:11.018 20:18:16 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.018 20:18:16 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:11.276 20:18:16 -- target/tls.sh@98 -- # version=7 00:17:11.276 20:18:16 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:11.276 20:18:16 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.276 20:18:16 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:11.534 20:18:16 -- target/tls.sh@105 -- # ktls=false 00:17:11.534 20:18:16 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:11.534 20:18:16 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:11.792 20:18:16 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.792 20:18:16 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:12.050 20:18:17 -- target/tls.sh@113 -- # ktls=true 00:17:12.050 20:18:17 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:12.050 20:18:17 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:12.308 20:18:17 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:12.308 20:18:17 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:12.566 20:18:17 -- target/tls.sh@121 -- # ktls=false 00:17:12.566 20:18:17 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:12.566 20:18:17 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:12.566 20:18:17 -- target/tls.sh@49 -- # local key hash crc 00:17:12.566 20:18:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:12.566 20:18:17 -- target/tls.sh@51 -- # hash=01 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # gzip -1 -c 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # tail -c8 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # head -c 4 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # crc='p$H�' 00:17:12.566 20:18:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:12.566 20:18:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:12.566 20:18:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:12.566 20:18:17 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:12.566 20:18:17 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:12.566 20:18:17 -- target/tls.sh@49 -- # local key hash crc 00:17:12.566 20:18:17 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:12.566 20:18:17 -- target/tls.sh@51 -- # hash=01 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # gzip -1 -c 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # head -c 4 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # tail -c8 00:17:12.566 20:18:17 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:12.566 20:18:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:12.566 20:18:17 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:12.566 20:18:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:12.566 20:18:17 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:12.566 20:18:17 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.566 20:18:17 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:12.566 20:18:17 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:12.566 20:18:17 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:12.566 20:18:17 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.566 20:18:17 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:12.566 20:18:17 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:12.824 20:18:17 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:13.391 20:18:18 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.391 20:18:18 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.391 20:18:18 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:13.649 [2024-11-20 20:18:18.491490] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:13.649 20:18:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:13.906 20:18:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:14.165 [2024-11-20 20:18:19.093146] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:14.165 [2024-11-20 20:18:19.093411] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:14.165 20:18:19 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:14.422 malloc0 00:17:14.422 20:18:19 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:14.680 20:18:19 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.938 20:18:19 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.938 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.143 Initializing NVMe Controllers 00:17:27.143 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:27.143 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:27.143 Initialization complete. Launching workers. 00:17:27.143 ======================================================== 00:17:27.143 Latency(us) 00:17:27.143 Device Information : IOPS MiB/s Average min max 00:17:27.143 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7789.78 30.43 8218.52 1328.32 10567.86 00:17:27.143 ======================================================== 00:17:27.143 Total : 7789.78 30.43 8218.52 1328.32 10567.86 00:17:27.143 00:17:27.143 20:18:29 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.143 20:18:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:27.143 20:18:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:27.143 20:18:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:27.143 20:18:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:27.143 20:18:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:27.143 20:18:29 -- target/tls.sh@28 -- # bdevperf_pid=3175611 00:17:27.143 20:18:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:27.143 20:18:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:27.143 20:18:29 -- target/tls.sh@31 -- # waitforlisten 3175611 /var/tmp/bdevperf.sock 00:17:27.143 20:18:29 -- common/autotest_common.sh@829 -- # '[' -z 3175611 ']' 00:17:27.143 20:18:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:27.143 20:18:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:27.143 20:18:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:27.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:27.143 20:18:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:27.143 20:18:29 -- common/autotest_common.sh@10 -- # set +x 00:17:27.143 [2024-11-20 20:18:30.031583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:27.143 [2024-11-20 20:18:30.031668] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175611 ] 00:17:27.143 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.143 [2024-11-20 20:18:30.090989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.143 [2024-11-20 20:18:30.200409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:27.143 20:18:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:27.143 20:18:30 -- common/autotest_common.sh@862 -- # return 0 00:17:27.143 20:18:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.143 [2024-11-20 20:18:31.224171] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:27.143 TLSTESTn1 00:17:27.143 20:18:31 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:27.143 Running I/O for 10 seconds... 00:17:37.130 00:17:37.130 Latency(us) 00:17:37.130 [2024-11-20T19:18:42.169Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.130 [2024-11-20T19:18:42.169Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:37.130 Verification LBA range: start 0x0 length 0x2000 00:17:37.130 TLSTESTn1 : 10.02 3969.58 15.51 0.00 0.00 32199.87 4490.43 73400.32 00:17:37.130 [2024-11-20T19:18:42.169Z] =================================================================================================================== 00:17:37.130 [2024-11-20T19:18:42.169Z] Total : 3969.58 15.51 0.00 0.00 32199.87 4490.43 73400.32 00:17:37.130 0 00:17:37.130 20:18:41 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:37.130 20:18:41 -- target/tls.sh@45 -- # killprocess 3175611 00:17:37.130 20:18:41 -- common/autotest_common.sh@936 -- # '[' -z 3175611 ']' 00:17:37.130 20:18:41 -- common/autotest_common.sh@940 -- # kill -0 3175611 00:17:37.130 20:18:41 -- common/autotest_common.sh@941 -- # uname 00:17:37.130 20:18:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.130 20:18:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3175611 00:17:37.130 20:18:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:37.130 20:18:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:37.130 20:18:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3175611' 00:17:37.130 killing process with pid 3175611 00:17:37.130 20:18:41 -- common/autotest_common.sh@955 -- # kill 3175611 00:17:37.130 Received shutdown signal, test time was about 10.000000 seconds 00:17:37.130 00:17:37.130 Latency(us) 00:17:37.130 [2024-11-20T19:18:42.169Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.130 [2024-11-20T19:18:42.169Z] =================================================================================================================== 00:17:37.130 [2024-11-20T19:18:42.169Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:37.130 20:18:41 -- common/autotest_common.sh@960 -- # wait 3175611 00:17:37.130 20:18:41 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.130 20:18:41 -- common/autotest_common.sh@650 -- # local es=0 00:17:37.131 20:18:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.131 20:18:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:37.131 20:18:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.131 20:18:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:37.131 20:18:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.131 20:18:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.131 20:18:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.131 20:18:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.131 20:18:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:37.131 20:18:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:37.131 20:18:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.131 20:18:41 -- target/tls.sh@28 -- # bdevperf_pid=3177041 00:17:37.131 20:18:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.131 20:18:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.131 20:18:41 -- target/tls.sh@31 -- # waitforlisten 3177041 /var/tmp/bdevperf.sock 00:17:37.131 20:18:41 -- common/autotest_common.sh@829 -- # '[' -z 3177041 ']' 00:17:37.131 20:18:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.131 20:18:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.131 20:18:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.131 20:18:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.131 20:18:41 -- common/autotest_common.sh@10 -- # set +x 00:17:37.131 [2024-11-20 20:18:41.818446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.131 [2024-11-20 20:18:41.818518] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177041 ] 00:17:37.131 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.131 [2024-11-20 20:18:41.877703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.131 [2024-11-20 20:18:41.979892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.067 20:18:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.067 20:18:42 -- common/autotest_common.sh@862 -- # return 0 00:17:38.067 20:18:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:38.067 [2024-11-20 20:18:43.014043] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.067 [2024-11-20 20:18:43.019270] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:38.067 [2024-11-20 20:18:43.019742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd151f0 (107): Transport endpoint is not connected 00:17:38.067 [2024-11-20 20:18:43.020732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd151f0 (9): Bad file descriptor 00:17:38.067 [2024-11-20 20:18:43.021731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:38.067 [2024-11-20 20:18:43.021750] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:38.067 [2024-11-20 20:18:43.021778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:38.067 request: 00:17:38.067 { 00:17:38.067 "name": "TLSTEST", 00:17:38.067 "trtype": "tcp", 00:17:38.067 "traddr": "10.0.0.2", 00:17:38.067 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:38.067 "adrfam": "ipv4", 00:17:38.067 "trsvcid": "4420", 00:17:38.067 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.067 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:38.067 "method": "bdev_nvme_attach_controller", 00:17:38.067 "req_id": 1 00:17:38.067 } 00:17:38.067 Got JSON-RPC error response 00:17:38.067 response: 00:17:38.067 { 00:17:38.067 "code": -32602, 00:17:38.067 "message": "Invalid parameters" 00:17:38.067 } 00:17:38.067 20:18:43 -- target/tls.sh@36 -- # killprocess 3177041 00:17:38.067 20:18:43 -- common/autotest_common.sh@936 -- # '[' -z 3177041 ']' 00:17:38.067 20:18:43 -- common/autotest_common.sh@940 -- # kill -0 3177041 00:17:38.067 20:18:43 -- common/autotest_common.sh@941 -- # uname 00:17:38.067 20:18:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.067 20:18:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3177041 00:17:38.067 20:18:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:38.067 20:18:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:38.067 20:18:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3177041' 00:17:38.067 killing process with pid 3177041 00:17:38.067 20:18:43 -- common/autotest_common.sh@955 -- # kill 3177041 00:17:38.067 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.067 00:17:38.067 Latency(us) 00:17:38.067 [2024-11-20T19:18:43.106Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.067 [2024-11-20T19:18:43.106Z] =================================================================================================================== 00:17:38.067 [2024-11-20T19:18:43.106Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:38.067 20:18:43 -- common/autotest_common.sh@960 -- # wait 3177041 00:17:38.326 20:18:43 -- target/tls.sh@37 -- # return 1 00:17:38.326 20:18:43 -- common/autotest_common.sh@653 -- # es=1 00:17:38.326 20:18:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:38.326 20:18:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:38.326 20:18:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:38.326 20:18:43 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.326 20:18:43 -- common/autotest_common.sh@650 -- # local es=0 00:17:38.326 20:18:43 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.326 20:18:43 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:38.326 20:18:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.326 20:18:43 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:38.326 20:18:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.326 20:18:43 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.326 20:18:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:38.326 20:18:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:38.326 20:18:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:38.326 20:18:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:38.326 20:18:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.326 20:18:43 -- target/tls.sh@28 -- # bdevperf_pid=3177262 00:17:38.326 20:18:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.327 20:18:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.327 20:18:43 -- target/tls.sh@31 -- # waitforlisten 3177262 /var/tmp/bdevperf.sock 00:17:38.327 20:18:43 -- common/autotest_common.sh@829 -- # '[' -z 3177262 ']' 00:17:38.327 20:18:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.327 20:18:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.327 20:18:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.327 20:18:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.327 20:18:43 -- common/autotest_common.sh@10 -- # set +x 00:17:38.587 [2024-11-20 20:18:43.376251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.587 [2024-11-20 20:18:43.376329] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177262 ] 00:17:38.587 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.587 [2024-11-20 20:18:43.435806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.587 [2024-11-20 20:18:43.537099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.527 20:18:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.527 20:18:44 -- common/autotest_common.sh@862 -- # return 0 00:17:39.527 20:18:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:39.788 [2024-11-20 20:18:44.577659] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:39.788 [2024-11-20 20:18:44.583063] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:39.788 [2024-11-20 20:18:44.583103] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:39.788 [2024-11-20 20:18:44.583160] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:39.788 [2024-11-20 20:18:44.583648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5921f0 (107): Transport endpoint is not connected 00:17:39.788 [2024-11-20 20:18:44.584636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5921f0 (9): Bad file descriptor 00:17:39.788 [2024-11-20 20:18:44.585635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:39.788 [2024-11-20 20:18:44.585655] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:39.788 [2024-11-20 20:18:44.585686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:39.788 request: 00:17:39.788 { 00:17:39.788 "name": "TLSTEST", 00:17:39.788 "trtype": "tcp", 00:17:39.788 "traddr": "10.0.0.2", 00:17:39.788 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:39.788 "adrfam": "ipv4", 00:17:39.788 "trsvcid": "4420", 00:17:39.788 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:39.788 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:39.788 "method": "bdev_nvme_attach_controller", 00:17:39.788 "req_id": 1 00:17:39.788 } 00:17:39.788 Got JSON-RPC error response 00:17:39.788 response: 00:17:39.788 { 00:17:39.788 "code": -32602, 00:17:39.788 "message": "Invalid parameters" 00:17:39.788 } 00:17:39.788 20:18:44 -- target/tls.sh@36 -- # killprocess 3177262 00:17:39.788 20:18:44 -- common/autotest_common.sh@936 -- # '[' -z 3177262 ']' 00:17:39.788 20:18:44 -- common/autotest_common.sh@940 -- # kill -0 3177262 00:17:39.788 20:18:44 -- common/autotest_common.sh@941 -- # uname 00:17:39.788 20:18:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.788 20:18:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3177262 00:17:39.788 20:18:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:39.788 20:18:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:39.788 20:18:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3177262' 00:17:39.788 killing process with pid 3177262 00:17:39.788 20:18:44 -- common/autotest_common.sh@955 -- # kill 3177262 00:17:39.788 Received shutdown signal, test time was about 10.000000 seconds 00:17:39.788 00:17:39.788 Latency(us) 00:17:39.788 [2024-11-20T19:18:44.827Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.788 [2024-11-20T19:18:44.827Z] =================================================================================================================== 00:17:39.788 [2024-11-20T19:18:44.827Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:39.788 20:18:44 -- common/autotest_common.sh@960 -- # wait 3177262 00:17:40.049 20:18:44 -- target/tls.sh@37 -- # return 1 00:17:40.049 20:18:44 -- common/autotest_common.sh@653 -- # es=1 00:17:40.049 20:18:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:40.049 20:18:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:40.049 20:18:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:40.049 20:18:44 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.049 20:18:44 -- common/autotest_common.sh@650 -- # local es=0 00:17:40.049 20:18:44 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.049 20:18:44 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:40.049 20:18:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.049 20:18:44 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:40.049 20:18:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.049 20:18:44 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.049 20:18:44 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:40.049 20:18:44 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:40.049 20:18:44 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:40.049 20:18:44 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:40.049 20:18:44 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:40.049 20:18:44 -- target/tls.sh@28 -- # bdevperf_pid=3177410 00:17:40.049 20:18:44 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:40.049 20:18:44 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:40.049 20:18:44 -- target/tls.sh@31 -- # waitforlisten 3177410 /var/tmp/bdevperf.sock 00:17:40.049 20:18:44 -- common/autotest_common.sh@829 -- # '[' -z 3177410 ']' 00:17:40.049 20:18:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:40.049 20:18:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:40.049 20:18:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:40.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:40.049 20:18:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:40.049 20:18:44 -- common/autotest_common.sh@10 -- # set +x 00:17:40.049 [2024-11-20 20:18:44.946829] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:40.049 [2024-11-20 20:18:44.946901] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177410 ] 00:17:40.049 EAL: No free 2048 kB hugepages reported on node 1 00:17:40.049 [2024-11-20 20:18:45.002832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.310 [2024-11-20 20:18:45.105395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:40.877 20:18:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:40.877 20:18:45 -- common/autotest_common.sh@862 -- # return 0 00:17:40.877 20:18:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:41.135 [2024-11-20 20:18:46.125305] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:41.135 [2024-11-20 20:18:46.136164] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:41.135 [2024-11-20 20:18:46.136193] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:41.136 [2024-11-20 20:18:46.136251] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:41.136 [2024-11-20 20:18:46.137150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20581f0 (107): Transport endpoint is not connected 00:17:41.136 [2024-11-20 20:18:46.138142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20581f0 (9): Bad file descriptor 00:17:41.136 [2024-11-20 20:18:46.139141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:41.136 [2024-11-20 20:18:46.139160] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:41.136 [2024-11-20 20:18:46.139175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:41.136 request: 00:17:41.136 { 00:17:41.136 "name": "TLSTEST", 00:17:41.136 "trtype": "tcp", 00:17:41.136 "traddr": "10.0.0.2", 00:17:41.136 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:41.136 "adrfam": "ipv4", 00:17:41.136 "trsvcid": "4420", 00:17:41.136 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:41.136 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:41.136 "method": "bdev_nvme_attach_controller", 00:17:41.136 "req_id": 1 00:17:41.136 } 00:17:41.136 Got JSON-RPC error response 00:17:41.136 response: 00:17:41.136 { 00:17:41.136 "code": -32602, 00:17:41.136 "message": "Invalid parameters" 00:17:41.136 } 00:17:41.136 20:18:46 -- target/tls.sh@36 -- # killprocess 3177410 00:17:41.136 20:18:46 -- common/autotest_common.sh@936 -- # '[' -z 3177410 ']' 00:17:41.136 20:18:46 -- common/autotest_common.sh@940 -- # kill -0 3177410 00:17:41.136 20:18:46 -- common/autotest_common.sh@941 -- # uname 00:17:41.136 20:18:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:41.136 20:18:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3177410 00:17:41.396 20:18:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:41.396 20:18:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:41.396 20:18:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3177410' 00:17:41.396 killing process with pid 3177410 00:17:41.396 20:18:46 -- common/autotest_common.sh@955 -- # kill 3177410 00:17:41.396 Received shutdown signal, test time was about 10.000000 seconds 00:17:41.396 00:17:41.396 Latency(us) 00:17:41.396 [2024-11-20T19:18:46.435Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:41.396 [2024-11-20T19:18:46.435Z] =================================================================================================================== 00:17:41.396 [2024-11-20T19:18:46.435Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:41.396 20:18:46 -- common/autotest_common.sh@960 -- # wait 3177410 00:17:41.655 20:18:46 -- target/tls.sh@37 -- # return 1 00:17:41.655 20:18:46 -- common/autotest_common.sh@653 -- # es=1 00:17:41.655 20:18:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:41.655 20:18:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:41.655 20:18:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:41.655 20:18:46 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:41.655 20:18:46 -- common/autotest_common.sh@650 -- # local es=0 00:17:41.655 20:18:46 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:41.655 20:18:46 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:41.656 20:18:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:41.656 20:18:46 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:41.656 20:18:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:41.656 20:18:46 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:41.656 20:18:46 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:41.656 20:18:46 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:41.656 20:18:46 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:41.656 20:18:46 -- target/tls.sh@23 -- # psk= 00:17:41.656 20:18:46 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:41.656 20:18:46 -- target/tls.sh@28 -- # bdevperf_pid=3177697 00:17:41.656 20:18:46 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:41.656 20:18:46 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:41.656 20:18:46 -- target/tls.sh@31 -- # waitforlisten 3177697 /var/tmp/bdevperf.sock 00:17:41.656 20:18:46 -- common/autotest_common.sh@829 -- # '[' -z 3177697 ']' 00:17:41.656 20:18:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:41.656 20:18:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:41.656 20:18:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:41.656 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:41.656 20:18:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:41.656 20:18:46 -- common/autotest_common.sh@10 -- # set +x 00:17:41.656 [2024-11-20 20:18:46.492340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:41.656 [2024-11-20 20:18:46.492417] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177697 ] 00:17:41.656 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.656 [2024-11-20 20:18:46.548198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.656 [2024-11-20 20:18:46.648181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:42.619 20:18:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:42.619 20:18:47 -- common/autotest_common.sh@862 -- # return 0 00:17:42.619 20:18:47 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:42.905 [2024-11-20 20:18:47.700232] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:42.905 [2024-11-20 20:18:47.701796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x230a050 (9): Bad file descriptor 00:17:42.905 [2024-11-20 20:18:47.702792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:42.905 [2024-11-20 20:18:47.702812] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:42.905 [2024-11-20 20:18:47.702840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:42.905 request: 00:17:42.905 { 00:17:42.905 "name": "TLSTEST", 00:17:42.905 "trtype": "tcp", 00:17:42.905 "traddr": "10.0.0.2", 00:17:42.905 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:42.905 "adrfam": "ipv4", 00:17:42.905 "trsvcid": "4420", 00:17:42.905 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.905 "method": "bdev_nvme_attach_controller", 00:17:42.905 "req_id": 1 00:17:42.905 } 00:17:42.905 Got JSON-RPC error response 00:17:42.905 response: 00:17:42.905 { 00:17:42.905 "code": -32602, 00:17:42.905 "message": "Invalid parameters" 00:17:42.905 } 00:17:42.905 20:18:47 -- target/tls.sh@36 -- # killprocess 3177697 00:17:42.905 20:18:47 -- common/autotest_common.sh@936 -- # '[' -z 3177697 ']' 00:17:42.905 20:18:47 -- common/autotest_common.sh@940 -- # kill -0 3177697 00:17:42.905 20:18:47 -- common/autotest_common.sh@941 -- # uname 00:17:42.905 20:18:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.905 20:18:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3177697 00:17:42.905 20:18:47 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:42.905 20:18:47 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:42.905 20:18:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3177697' 00:17:42.905 killing process with pid 3177697 00:17:42.905 20:18:47 -- common/autotest_common.sh@955 -- # kill 3177697 00:17:42.905 Received shutdown signal, test time was about 10.000000 seconds 00:17:42.905 00:17:42.905 Latency(us) 00:17:42.905 [2024-11-20T19:18:47.944Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.905 [2024-11-20T19:18:47.944Z] =================================================================================================================== 00:17:42.905 [2024-11-20T19:18:47.944Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:42.905 20:18:47 -- common/autotest_common.sh@960 -- # wait 3177697 00:17:43.166 20:18:48 -- target/tls.sh@37 -- # return 1 00:17:43.166 20:18:48 -- common/autotest_common.sh@653 -- # es=1 00:17:43.166 20:18:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:43.166 20:18:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:43.166 20:18:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:43.166 20:18:48 -- target/tls.sh@167 -- # killprocess 3173652 00:17:43.166 20:18:48 -- common/autotest_common.sh@936 -- # '[' -z 3173652 ']' 00:17:43.166 20:18:48 -- common/autotest_common.sh@940 -- # kill -0 3173652 00:17:43.166 20:18:48 -- common/autotest_common.sh@941 -- # uname 00:17:43.166 20:18:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:43.166 20:18:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3173652 00:17:43.166 20:18:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:43.166 20:18:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:43.166 20:18:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3173652' 00:17:43.166 killing process with pid 3173652 00:17:43.166 20:18:48 -- common/autotest_common.sh@955 -- # kill 3173652 00:17:43.166 20:18:48 -- common/autotest_common.sh@960 -- # wait 3173652 00:17:43.424 20:18:48 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:43.424 20:18:48 -- target/tls.sh@49 -- # local key hash crc 00:17:43.424 20:18:48 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:43.424 20:18:48 -- target/tls.sh@51 -- # hash=02 00:17:43.424 20:18:48 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:43.424 20:18:48 -- target/tls.sh@52 -- # gzip -1 -c 00:17:43.424 20:18:48 -- target/tls.sh@52 -- # tail -c8 00:17:43.424 20:18:48 -- target/tls.sh@52 -- # head -c 4 00:17:43.424 20:18:48 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:43.424 20:18:48 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:43.424 20:18:48 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:43.424 20:18:48 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:43.424 20:18:48 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:43.424 20:18:48 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.424 20:18:48 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:43.424 20:18:48 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.424 20:18:48 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:43.424 20:18:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:43.424 20:18:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:43.424 20:18:48 -- common/autotest_common.sh@10 -- # set +x 00:17:43.424 20:18:48 -- nvmf/common.sh@469 -- # nvmfpid=3177872 00:17:43.424 20:18:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:43.424 20:18:48 -- nvmf/common.sh@470 -- # waitforlisten 3177872 00:17:43.424 20:18:48 -- common/autotest_common.sh@829 -- # '[' -z 3177872 ']' 00:17:43.424 20:18:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:43.424 20:18:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:43.424 20:18:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:43.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:43.424 20:18:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:43.424 20:18:48 -- common/autotest_common.sh@10 -- # set +x 00:17:43.424 [2024-11-20 20:18:48.411219] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:43.424 [2024-11-20 20:18:48.411312] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:43.424 EAL: No free 2048 kB hugepages reported on node 1 00:17:43.684 [2024-11-20 20:18:48.483272] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:43.684 [2024-11-20 20:18:48.602535] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:43.684 [2024-11-20 20:18:48.602686] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:43.684 [2024-11-20 20:18:48.602705] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:43.684 [2024-11-20 20:18:48.602718] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:43.684 [2024-11-20 20:18:48.602745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:44.622 20:18:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:44.622 20:18:49 -- common/autotest_common.sh@862 -- # return 0 00:17:44.622 20:18:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:44.622 20:18:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:44.622 20:18:49 -- common/autotest_common.sh@10 -- # set +x 00:17:44.622 20:18:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:44.622 20:18:49 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.622 20:18:49 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.622 20:18:49 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:44.880 [2024-11-20 20:18:49.698798] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:44.880 20:18:49 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:45.140 20:18:50 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:45.399 [2024-11-20 20:18:50.252319] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:45.399 [2024-11-20 20:18:50.252611] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:45.399 20:18:50 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:45.657 malloc0 00:17:45.657 20:18:50 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:45.915 20:18:50 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.172 20:18:51 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.172 20:18:51 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:46.172 20:18:51 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:46.172 20:18:51 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:46.172 20:18:51 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:46.172 20:18:51 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:46.172 20:18:51 -- target/tls.sh@28 -- # bdevperf_pid=3178292 00:17:46.172 20:18:51 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.172 20:18:51 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:46.172 20:18:51 -- target/tls.sh@31 -- # waitforlisten 3178292 /var/tmp/bdevperf.sock 00:17:46.172 20:18:51 -- common/autotest_common.sh@829 -- # '[' -z 3178292 ']' 00:17:46.172 20:18:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.172 20:18:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:46.172 20:18:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.172 20:18:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:46.172 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:46.432 [2024-11-20 20:18:51.219246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:46.432 [2024-11-20 20:18:51.219316] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3178292 ] 00:17:46.432 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.432 [2024-11-20 20:18:51.277966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.432 [2024-11-20 20:18:51.388175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.367 20:18:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.367 20:18:52 -- common/autotest_common.sh@862 -- # return 0 00:17:47.367 20:18:52 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:47.627 [2024-11-20 20:18:52.433240] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.627 TLSTESTn1 00:17:47.627 20:18:52 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:47.627 Running I/O for 10 seconds... 00:17:59.839 00:17:59.839 Latency(us) 00:17:59.839 [2024-11-20T19:19:04.878Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.839 [2024-11-20T19:19:04.878Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:59.839 Verification LBA range: start 0x0 length 0x2000 00:17:59.839 TLSTESTn1 : 10.02 4149.28 16.21 0.00 0.00 30809.38 5291.43 45049.93 00:17:59.839 [2024-11-20T19:19:04.878Z] =================================================================================================================== 00:17:59.839 [2024-11-20T19:19:04.878Z] Total : 4149.28 16.21 0.00 0.00 30809.38 5291.43 45049.93 00:17:59.839 0 00:17:59.839 20:19:02 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:59.839 20:19:02 -- target/tls.sh@45 -- # killprocess 3178292 00:17:59.839 20:19:02 -- common/autotest_common.sh@936 -- # '[' -z 3178292 ']' 00:17:59.839 20:19:02 -- common/autotest_common.sh@940 -- # kill -0 3178292 00:17:59.839 20:19:02 -- common/autotest_common.sh@941 -- # uname 00:17:59.839 20:19:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.839 20:19:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3178292 00:17:59.839 20:19:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:59.839 20:19:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:59.839 20:19:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3178292' 00:17:59.839 killing process with pid 3178292 00:17:59.839 20:19:02 -- common/autotest_common.sh@955 -- # kill 3178292 00:17:59.839 Received shutdown signal, test time was about 10.000000 seconds 00:17:59.839 00:17:59.839 Latency(us) 00:17:59.839 [2024-11-20T19:19:04.878Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.839 [2024-11-20T19:19:04.878Z] =================================================================================================================== 00:17:59.839 [2024-11-20T19:19:04.878Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:59.839 20:19:02 -- common/autotest_common.sh@960 -- # wait 3178292 00:17:59.839 20:19:02 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.839 20:19:02 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.839 20:19:02 -- common/autotest_common.sh@650 -- # local es=0 00:17:59.839 20:19:02 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.839 20:19:02 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:59.839 20:19:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.839 20:19:02 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:59.839 20:19:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.839 20:19:02 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.839 20:19:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:59.839 20:19:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:59.839 20:19:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:59.839 20:19:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:59.839 20:19:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:59.839 20:19:02 -- target/tls.sh@28 -- # bdevperf_pid=3179669 00:17:59.839 20:19:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:59.839 20:19:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:59.839 20:19:02 -- target/tls.sh@31 -- # waitforlisten 3179669 /var/tmp/bdevperf.sock 00:17:59.839 20:19:02 -- common/autotest_common.sh@829 -- # '[' -z 3179669 ']' 00:17:59.839 20:19:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.839 20:19:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.839 20:19:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.839 20:19:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.839 20:19:02 -- common/autotest_common.sh@10 -- # set +x 00:17:59.839 [2024-11-20 20:19:02.993536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:59.839 [2024-11-20 20:19:02.993610] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179669 ] 00:17:59.839 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.839 [2024-11-20 20:19:03.051313] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.839 [2024-11-20 20:19:03.157741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:59.839 20:19:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:59.839 20:19:03 -- common/autotest_common.sh@862 -- # return 0 00:17:59.839 20:19:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.839 [2024-11-20 20:19:04.212088] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:59.839 [2024-11-20 20:19:04.212152] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:59.839 request: 00:17:59.839 { 00:17:59.839 "name": "TLSTEST", 00:17:59.839 "trtype": "tcp", 00:17:59.839 "traddr": "10.0.0.2", 00:17:59.839 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:59.839 "adrfam": "ipv4", 00:17:59.839 "trsvcid": "4420", 00:17:59.839 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.839 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:59.839 "method": "bdev_nvme_attach_controller", 00:17:59.839 "req_id": 1 00:17:59.839 } 00:17:59.839 Got JSON-RPC error response 00:17:59.839 response: 00:17:59.839 { 00:17:59.839 "code": -22, 00:17:59.839 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:59.839 } 00:17:59.839 20:19:04 -- target/tls.sh@36 -- # killprocess 3179669 00:17:59.839 20:19:04 -- common/autotest_common.sh@936 -- # '[' -z 3179669 ']' 00:17:59.839 20:19:04 -- common/autotest_common.sh@940 -- # kill -0 3179669 00:17:59.839 20:19:04 -- common/autotest_common.sh@941 -- # uname 00:17:59.839 20:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.839 20:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179669 00:17:59.839 20:19:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:59.839 20:19:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:59.839 20:19:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179669' 00:17:59.839 killing process with pid 3179669 00:17:59.840 20:19:04 -- common/autotest_common.sh@955 -- # kill 3179669 00:17:59.840 Received shutdown signal, test time was about 10.000000 seconds 00:17:59.840 00:17:59.840 Latency(us) 00:17:59.840 [2024-11-20T19:19:04.879Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.840 [2024-11-20T19:19:04.879Z] =================================================================================================================== 00:17:59.840 [2024-11-20T19:19:04.879Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:59.840 20:19:04 -- common/autotest_common.sh@960 -- # wait 3179669 00:17:59.840 20:19:04 -- target/tls.sh@37 -- # return 1 00:17:59.840 20:19:04 -- common/autotest_common.sh@653 -- # es=1 00:17:59.840 20:19:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:59.840 20:19:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:59.840 20:19:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:59.840 20:19:04 -- target/tls.sh@183 -- # killprocess 3177872 00:17:59.840 20:19:04 -- common/autotest_common.sh@936 -- # '[' -z 3177872 ']' 00:17:59.840 20:19:04 -- common/autotest_common.sh@940 -- # kill -0 3177872 00:17:59.840 20:19:04 -- common/autotest_common.sh@941 -- # uname 00:17:59.840 20:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.840 20:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3177872 00:17:59.840 20:19:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:59.840 20:19:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:59.840 20:19:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3177872' 00:17:59.840 killing process with pid 3177872 00:17:59.840 20:19:04 -- common/autotest_common.sh@955 -- # kill 3177872 00:17:59.840 20:19:04 -- common/autotest_common.sh@960 -- # wait 3177872 00:17:59.840 20:19:04 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:59.840 20:19:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:59.840 20:19:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:59.840 20:19:04 -- common/autotest_common.sh@10 -- # set +x 00:17:59.840 20:19:04 -- nvmf/common.sh@469 -- # nvmfpid=3179948 00:17:59.840 20:19:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:59.840 20:19:04 -- nvmf/common.sh@470 -- # waitforlisten 3179948 00:17:59.840 20:19:04 -- common/autotest_common.sh@829 -- # '[' -z 3179948 ']' 00:17:59.840 20:19:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:59.840 20:19:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.840 20:19:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:59.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:59.840 20:19:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.840 20:19:04 -- common/autotest_common.sh@10 -- # set +x 00:18:00.101 [2024-11-20 20:19:04.898660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:00.101 [2024-11-20 20:19:04.898743] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:00.101 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.101 [2024-11-20 20:19:04.965248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.101 [2024-11-20 20:19:05.081549] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.101 [2024-11-20 20:19:05.081701] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.101 [2024-11-20 20:19:05.081717] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.101 [2024-11-20 20:19:05.081729] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.101 [2024-11-20 20:19:05.081756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:01.040 20:19:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.040 20:19:05 -- common/autotest_common.sh@862 -- # return 0 00:18:01.040 20:19:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:01.040 20:19:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:01.040 20:19:05 -- common/autotest_common.sh@10 -- # set +x 00:18:01.040 20:19:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:01.040 20:19:05 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.040 20:19:05 -- common/autotest_common.sh@650 -- # local es=0 00:18:01.040 20:19:05 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.040 20:19:05 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:01.040 20:19:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.040 20:19:05 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:01.040 20:19:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.040 20:19:05 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.040 20:19:05 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.040 20:19:05 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:01.298 [2024-11-20 20:19:06.144632] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:01.298 20:19:06 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:01.556 20:19:06 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:01.814 [2024-11-20 20:19:06.641950] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:01.814 [2024-11-20 20:19:06.642222] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:01.814 20:19:06 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:02.072 malloc0 00:18:02.072 20:19:06 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:02.331 20:19:07 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.590 [2024-11-20 20:19:07.396459] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:02.590 [2024-11-20 20:19:07.396498] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:02.590 [2024-11-20 20:19:07.396535] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:02.590 request: 00:18:02.590 { 00:18:02.590 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:02.590 "host": "nqn.2016-06.io.spdk:host1", 00:18:02.590 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:02.590 "method": "nvmf_subsystem_add_host", 00:18:02.590 "req_id": 1 00:18:02.590 } 00:18:02.590 Got JSON-RPC error response 00:18:02.590 response: 00:18:02.590 { 00:18:02.590 "code": -32603, 00:18:02.590 "message": "Internal error" 00:18:02.590 } 00:18:02.590 20:19:07 -- common/autotest_common.sh@653 -- # es=1 00:18:02.590 20:19:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:02.590 20:19:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:02.590 20:19:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:02.590 20:19:07 -- target/tls.sh@189 -- # killprocess 3179948 00:18:02.590 20:19:07 -- common/autotest_common.sh@936 -- # '[' -z 3179948 ']' 00:18:02.590 20:19:07 -- common/autotest_common.sh@940 -- # kill -0 3179948 00:18:02.590 20:19:07 -- common/autotest_common.sh@941 -- # uname 00:18:02.590 20:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:02.590 20:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179948 00:18:02.590 20:19:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:02.591 20:19:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:02.591 20:19:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179948' 00:18:02.591 killing process with pid 3179948 00:18:02.591 20:19:07 -- common/autotest_common.sh@955 -- # kill 3179948 00:18:02.591 20:19:07 -- common/autotest_common.sh@960 -- # wait 3179948 00:18:02.850 20:19:07 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.850 20:19:07 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:02.850 20:19:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:02.850 20:19:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:02.850 20:19:07 -- common/autotest_common.sh@10 -- # set +x 00:18:02.850 20:19:07 -- nvmf/common.sh@469 -- # nvmfpid=3180283 00:18:02.850 20:19:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:02.850 20:19:07 -- nvmf/common.sh@470 -- # waitforlisten 3180283 00:18:02.850 20:19:07 -- common/autotest_common.sh@829 -- # '[' -z 3180283 ']' 00:18:02.850 20:19:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.850 20:19:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.850 20:19:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.850 20:19:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.850 20:19:07 -- common/autotest_common.sh@10 -- # set +x 00:18:02.850 [2024-11-20 20:19:07.781411] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.850 [2024-11-20 20:19:07.781499] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.850 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.850 [2024-11-20 20:19:07.842565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.110 [2024-11-20 20:19:07.949135] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:03.110 [2024-11-20 20:19:07.949293] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:03.110 [2024-11-20 20:19:07.949311] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:03.110 [2024-11-20 20:19:07.949325] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:03.110 [2024-11-20 20:19:07.949354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:04.052 20:19:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.052 20:19:08 -- common/autotest_common.sh@862 -- # return 0 00:18:04.052 20:19:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:04.052 20:19:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:04.052 20:19:08 -- common/autotest_common.sh@10 -- # set +x 00:18:04.052 20:19:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:04.052 20:19:08 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.052 20:19:08 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.052 20:19:08 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:04.311 [2024-11-20 20:19:09.095013] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:04.311 20:19:09 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:04.569 20:19:09 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:04.827 [2024-11-20 20:19:09.688635] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:04.827 [2024-11-20 20:19:09.688886] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:04.827 20:19:09 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:05.088 malloc0 00:18:05.088 20:19:10 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:05.348 20:19:10 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:05.607 20:19:10 -- target/tls.sh@197 -- # bdevperf_pid=3180684 00:18:05.607 20:19:10 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:05.607 20:19:10 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:05.607 20:19:10 -- target/tls.sh@200 -- # waitforlisten 3180684 /var/tmp/bdevperf.sock 00:18:05.607 20:19:10 -- common/autotest_common.sh@829 -- # '[' -z 3180684 ']' 00:18:05.607 20:19:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:05.607 20:19:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:05.607 20:19:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:05.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:05.607 20:19:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:05.607 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:18:05.607 [2024-11-20 20:19:10.602024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:05.607 [2024-11-20 20:19:10.602113] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3180684 ] 00:18:05.607 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.867 [2024-11-20 20:19:10.661757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.867 [2024-11-20 20:19:10.766523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:06.805 20:19:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:06.805 20:19:11 -- common/autotest_common.sh@862 -- # return 0 00:18:06.805 20:19:11 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.063 [2024-11-20 20:19:11.876299] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:07.063 TLSTESTn1 00:18:07.063 20:19:11 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:07.322 20:19:12 -- target/tls.sh@205 -- # tgtconf='{ 00:18:07.322 "subsystems": [ 00:18:07.322 { 00:18:07.322 "subsystem": "iobuf", 00:18:07.322 "config": [ 00:18:07.322 { 00:18:07.322 "method": "iobuf_set_options", 00:18:07.322 "params": { 00:18:07.322 "small_pool_count": 8192, 00:18:07.322 "large_pool_count": 1024, 00:18:07.322 "small_bufsize": 8192, 00:18:07.322 "large_bufsize": 135168 00:18:07.322 } 00:18:07.322 } 00:18:07.322 ] 00:18:07.322 }, 00:18:07.322 { 00:18:07.322 "subsystem": "sock", 00:18:07.322 "config": [ 00:18:07.322 { 00:18:07.322 "method": "sock_impl_set_options", 00:18:07.322 "params": { 00:18:07.322 "impl_name": "posix", 00:18:07.322 "recv_buf_size": 2097152, 00:18:07.322 "send_buf_size": 2097152, 00:18:07.322 "enable_recv_pipe": true, 00:18:07.322 "enable_quickack": false, 00:18:07.322 "enable_placement_id": 0, 00:18:07.322 "enable_zerocopy_send_server": true, 00:18:07.322 "enable_zerocopy_send_client": false, 00:18:07.322 "zerocopy_threshold": 0, 00:18:07.322 "tls_version": 0, 00:18:07.322 "enable_ktls": false 00:18:07.322 } 00:18:07.322 }, 00:18:07.322 { 00:18:07.322 "method": "sock_impl_set_options", 00:18:07.322 "params": { 00:18:07.322 "impl_name": "ssl", 00:18:07.322 "recv_buf_size": 4096, 00:18:07.322 "send_buf_size": 4096, 00:18:07.322 "enable_recv_pipe": true, 00:18:07.322 "enable_quickack": false, 00:18:07.322 "enable_placement_id": 0, 00:18:07.322 "enable_zerocopy_send_server": true, 00:18:07.322 "enable_zerocopy_send_client": false, 00:18:07.322 "zerocopy_threshold": 0, 00:18:07.322 "tls_version": 0, 00:18:07.322 "enable_ktls": false 00:18:07.322 } 00:18:07.322 } 00:18:07.322 ] 00:18:07.322 }, 00:18:07.322 { 00:18:07.322 "subsystem": "vmd", 00:18:07.322 "config": [] 00:18:07.322 }, 00:18:07.322 { 00:18:07.322 "subsystem": "accel", 00:18:07.322 "config": [ 00:18:07.322 { 00:18:07.322 "method": "accel_set_options", 00:18:07.322 "params": { 00:18:07.322 "small_cache_size": 128, 00:18:07.322 "large_cache_size": 16, 00:18:07.322 "task_count": 2048, 00:18:07.322 "sequence_count": 2048, 00:18:07.322 "buf_count": 2048 00:18:07.322 } 00:18:07.322 } 00:18:07.322 ] 00:18:07.322 }, 00:18:07.322 { 00:18:07.322 "subsystem": "bdev", 00:18:07.322 "config": [ 00:18:07.322 { 00:18:07.322 "method": "bdev_set_options", 00:18:07.322 "params": { 00:18:07.322 "bdev_io_pool_size": 65535, 00:18:07.323 "bdev_io_cache_size": 256, 00:18:07.323 "bdev_auto_examine": true, 00:18:07.323 "iobuf_small_cache_size": 128, 00:18:07.323 "iobuf_large_cache_size": 16 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "bdev_raid_set_options", 00:18:07.323 "params": { 00:18:07.323 "process_window_size_kb": 1024 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "bdev_iscsi_set_options", 00:18:07.323 "params": { 00:18:07.323 "timeout_sec": 30 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "bdev_nvme_set_options", 00:18:07.323 "params": { 00:18:07.323 "action_on_timeout": "none", 00:18:07.323 "timeout_us": 0, 00:18:07.323 "timeout_admin_us": 0, 00:18:07.323 "keep_alive_timeout_ms": 10000, 00:18:07.323 "transport_retry_count": 4, 00:18:07.323 "arbitration_burst": 0, 00:18:07.323 "low_priority_weight": 0, 00:18:07.323 "medium_priority_weight": 0, 00:18:07.323 "high_priority_weight": 0, 00:18:07.323 "nvme_adminq_poll_period_us": 10000, 00:18:07.323 "nvme_ioq_poll_period_us": 0, 00:18:07.323 "io_queue_requests": 0, 00:18:07.323 "delay_cmd_submit": true, 00:18:07.323 "bdev_retry_count": 3, 00:18:07.323 "transport_ack_timeout": 0, 00:18:07.323 "ctrlr_loss_timeout_sec": 0, 00:18:07.323 "reconnect_delay_sec": 0, 00:18:07.323 "fast_io_fail_timeout_sec": 0, 00:18:07.323 "generate_uuids": false, 00:18:07.323 "transport_tos": 0, 00:18:07.323 "io_path_stat": false, 00:18:07.323 "allow_accel_sequence": false 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "bdev_nvme_set_hotplug", 00:18:07.323 "params": { 00:18:07.323 "period_us": 100000, 00:18:07.323 "enable": false 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "bdev_malloc_create", 00:18:07.323 "params": { 00:18:07.323 "name": "malloc0", 00:18:07.323 "num_blocks": 8192, 00:18:07.323 "block_size": 4096, 00:18:07.323 "physical_block_size": 4096, 00:18:07.323 "uuid": "7e312d27-14a1-4810-99d5-c75c4d1a0691", 00:18:07.323 "optimal_io_boundary": 0 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "bdev_wait_for_examine" 00:18:07.323 } 00:18:07.323 ] 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "subsystem": "nbd", 00:18:07.323 "config": [] 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "subsystem": "scheduler", 00:18:07.323 "config": [ 00:18:07.323 { 00:18:07.323 "method": "framework_set_scheduler", 00:18:07.323 "params": { 00:18:07.323 "name": "static" 00:18:07.323 } 00:18:07.323 } 00:18:07.323 ] 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "subsystem": "nvmf", 00:18:07.323 "config": [ 00:18:07.323 { 00:18:07.323 "method": "nvmf_set_config", 00:18:07.323 "params": { 00:18:07.323 "discovery_filter": "match_any", 00:18:07.323 "admin_cmd_passthru": { 00:18:07.323 "identify_ctrlr": false 00:18:07.323 } 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "nvmf_set_max_subsystems", 00:18:07.323 "params": { 00:18:07.323 "max_subsystems": 1024 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "nvmf_set_crdt", 00:18:07.323 "params": { 00:18:07.323 "crdt1": 0, 00:18:07.323 "crdt2": 0, 00:18:07.323 "crdt3": 0 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "nvmf_create_transport", 00:18:07.323 "params": { 00:18:07.323 "trtype": "TCP", 00:18:07.323 "max_queue_depth": 128, 00:18:07.323 "max_io_qpairs_per_ctrlr": 127, 00:18:07.323 "in_capsule_data_size": 4096, 00:18:07.323 "max_io_size": 131072, 00:18:07.323 "io_unit_size": 131072, 00:18:07.323 "max_aq_depth": 128, 00:18:07.323 "num_shared_buffers": 511, 00:18:07.323 "buf_cache_size": 4294967295, 00:18:07.323 "dif_insert_or_strip": false, 00:18:07.323 "zcopy": false, 00:18:07.323 "c2h_success": false, 00:18:07.323 "sock_priority": 0, 00:18:07.323 "abort_timeout_sec": 1 00:18:07.323 } 00:18:07.323 }, 00:18:07.323 { 00:18:07.323 "method": "nvmf_create_subsystem", 00:18:07.323 "params": { 00:18:07.324 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.324 "allow_any_host": false, 00:18:07.324 "serial_number": "SPDK00000000000001", 00:18:07.324 "model_number": "SPDK bdev Controller", 00:18:07.324 "max_namespaces": 10, 00:18:07.324 "min_cntlid": 1, 00:18:07.324 "max_cntlid": 65519, 00:18:07.324 "ana_reporting": false 00:18:07.324 } 00:18:07.324 }, 00:18:07.324 { 00:18:07.324 "method": "nvmf_subsystem_add_host", 00:18:07.324 "params": { 00:18:07.324 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.324 "host": "nqn.2016-06.io.spdk:host1", 00:18:07.324 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:07.324 } 00:18:07.324 }, 00:18:07.324 { 00:18:07.324 "method": "nvmf_subsystem_add_ns", 00:18:07.324 "params": { 00:18:07.324 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.324 "namespace": { 00:18:07.324 "nsid": 1, 00:18:07.324 "bdev_name": "malloc0", 00:18:07.324 "nguid": "7E312D2714A1481099D5C75C4D1A0691", 00:18:07.324 "uuid": "7e312d27-14a1-4810-99d5-c75c4d1a0691" 00:18:07.324 } 00:18:07.324 } 00:18:07.324 }, 00:18:07.324 { 00:18:07.324 "method": "nvmf_subsystem_add_listener", 00:18:07.324 "params": { 00:18:07.324 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.324 "listen_address": { 00:18:07.324 "trtype": "TCP", 00:18:07.324 "adrfam": "IPv4", 00:18:07.324 "traddr": "10.0.0.2", 00:18:07.324 "trsvcid": "4420" 00:18:07.324 }, 00:18:07.324 "secure_channel": true 00:18:07.324 } 00:18:07.324 } 00:18:07.324 ] 00:18:07.324 } 00:18:07.324 ] 00:18:07.324 }' 00:18:07.324 20:19:12 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:07.893 20:19:12 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:07.893 "subsystems": [ 00:18:07.893 { 00:18:07.893 "subsystem": "iobuf", 00:18:07.893 "config": [ 00:18:07.893 { 00:18:07.893 "method": "iobuf_set_options", 00:18:07.893 "params": { 00:18:07.893 "small_pool_count": 8192, 00:18:07.893 "large_pool_count": 1024, 00:18:07.893 "small_bufsize": 8192, 00:18:07.893 "large_bufsize": 135168 00:18:07.893 } 00:18:07.893 } 00:18:07.893 ] 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "subsystem": "sock", 00:18:07.893 "config": [ 00:18:07.893 { 00:18:07.893 "method": "sock_impl_set_options", 00:18:07.893 "params": { 00:18:07.893 "impl_name": "posix", 00:18:07.893 "recv_buf_size": 2097152, 00:18:07.893 "send_buf_size": 2097152, 00:18:07.893 "enable_recv_pipe": true, 00:18:07.893 "enable_quickack": false, 00:18:07.893 "enable_placement_id": 0, 00:18:07.893 "enable_zerocopy_send_server": true, 00:18:07.893 "enable_zerocopy_send_client": false, 00:18:07.893 "zerocopy_threshold": 0, 00:18:07.893 "tls_version": 0, 00:18:07.893 "enable_ktls": false 00:18:07.893 } 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "method": "sock_impl_set_options", 00:18:07.893 "params": { 00:18:07.893 "impl_name": "ssl", 00:18:07.893 "recv_buf_size": 4096, 00:18:07.893 "send_buf_size": 4096, 00:18:07.893 "enable_recv_pipe": true, 00:18:07.893 "enable_quickack": false, 00:18:07.893 "enable_placement_id": 0, 00:18:07.893 "enable_zerocopy_send_server": true, 00:18:07.893 "enable_zerocopy_send_client": false, 00:18:07.893 "zerocopy_threshold": 0, 00:18:07.893 "tls_version": 0, 00:18:07.893 "enable_ktls": false 00:18:07.893 } 00:18:07.893 } 00:18:07.893 ] 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "subsystem": "vmd", 00:18:07.893 "config": [] 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "subsystem": "accel", 00:18:07.893 "config": [ 00:18:07.893 { 00:18:07.893 "method": "accel_set_options", 00:18:07.893 "params": { 00:18:07.893 "small_cache_size": 128, 00:18:07.893 "large_cache_size": 16, 00:18:07.893 "task_count": 2048, 00:18:07.893 "sequence_count": 2048, 00:18:07.893 "buf_count": 2048 00:18:07.893 } 00:18:07.893 } 00:18:07.893 ] 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "subsystem": "bdev", 00:18:07.893 "config": [ 00:18:07.893 { 00:18:07.893 "method": "bdev_set_options", 00:18:07.893 "params": { 00:18:07.893 "bdev_io_pool_size": 65535, 00:18:07.893 "bdev_io_cache_size": 256, 00:18:07.893 "bdev_auto_examine": true, 00:18:07.893 "iobuf_small_cache_size": 128, 00:18:07.893 "iobuf_large_cache_size": 16 00:18:07.893 } 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "method": "bdev_raid_set_options", 00:18:07.893 "params": { 00:18:07.893 "process_window_size_kb": 1024 00:18:07.893 } 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "method": "bdev_iscsi_set_options", 00:18:07.893 "params": { 00:18:07.893 "timeout_sec": 30 00:18:07.893 } 00:18:07.893 }, 00:18:07.893 { 00:18:07.893 "method": "bdev_nvme_set_options", 00:18:07.893 "params": { 00:18:07.893 "action_on_timeout": "none", 00:18:07.893 "timeout_us": 0, 00:18:07.893 "timeout_admin_us": 0, 00:18:07.893 "keep_alive_timeout_ms": 10000, 00:18:07.893 "transport_retry_count": 4, 00:18:07.893 "arbitration_burst": 0, 00:18:07.893 "low_priority_weight": 0, 00:18:07.893 "medium_priority_weight": 0, 00:18:07.893 "high_priority_weight": 0, 00:18:07.893 "nvme_adminq_poll_period_us": 10000, 00:18:07.894 "nvme_ioq_poll_period_us": 0, 00:18:07.894 "io_queue_requests": 512, 00:18:07.894 "delay_cmd_submit": true, 00:18:07.894 "bdev_retry_count": 3, 00:18:07.894 "transport_ack_timeout": 0, 00:18:07.894 "ctrlr_loss_timeout_sec": 0, 00:18:07.894 "reconnect_delay_sec": 0, 00:18:07.894 "fast_io_fail_timeout_sec": 0, 00:18:07.894 "generate_uuids": false, 00:18:07.894 "transport_tos": 0, 00:18:07.894 "io_path_stat": false, 00:18:07.894 "allow_accel_sequence": false 00:18:07.894 } 00:18:07.894 }, 00:18:07.894 { 00:18:07.894 "method": "bdev_nvme_attach_controller", 00:18:07.894 "params": { 00:18:07.894 "name": "TLSTEST", 00:18:07.894 "trtype": "TCP", 00:18:07.894 "adrfam": "IPv4", 00:18:07.894 "traddr": "10.0.0.2", 00:18:07.894 "trsvcid": "4420", 00:18:07.894 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.894 "prchk_reftag": false, 00:18:07.894 "prchk_guard": false, 00:18:07.894 "ctrlr_loss_timeout_sec": 0, 00:18:07.894 "reconnect_delay_sec": 0, 00:18:07.894 "fast_io_fail_timeout_sec": 0, 00:18:07.894 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:07.894 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:07.894 "hdgst": false, 00:18:07.894 "ddgst": false 00:18:07.894 } 00:18:07.894 }, 00:18:07.894 { 00:18:07.894 "method": "bdev_nvme_set_hotplug", 00:18:07.894 "params": { 00:18:07.894 "period_us": 100000, 00:18:07.894 "enable": false 00:18:07.894 } 00:18:07.894 }, 00:18:07.894 { 00:18:07.894 "method": "bdev_wait_for_examine" 00:18:07.894 } 00:18:07.894 ] 00:18:07.894 }, 00:18:07.894 { 00:18:07.894 "subsystem": "nbd", 00:18:07.894 "config": [] 00:18:07.894 } 00:18:07.894 ] 00:18:07.894 }' 00:18:07.894 20:19:12 -- target/tls.sh@208 -- # killprocess 3180684 00:18:07.894 20:19:12 -- common/autotest_common.sh@936 -- # '[' -z 3180684 ']' 00:18:07.894 20:19:12 -- common/autotest_common.sh@940 -- # kill -0 3180684 00:18:07.894 20:19:12 -- common/autotest_common.sh@941 -- # uname 00:18:07.894 20:19:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:07.894 20:19:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180684 00:18:07.894 20:19:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:07.894 20:19:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:07.894 20:19:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180684' 00:18:07.894 killing process with pid 3180684 00:18:07.894 20:19:12 -- common/autotest_common.sh@955 -- # kill 3180684 00:18:07.894 Received shutdown signal, test time was about 10.000000 seconds 00:18:07.894 00:18:07.894 Latency(us) 00:18:07.894 [2024-11-20T19:19:12.933Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.894 [2024-11-20T19:19:12.933Z] =================================================================================================================== 00:18:07.894 [2024-11-20T19:19:12.933Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:07.894 20:19:12 -- common/autotest_common.sh@960 -- # wait 3180684 00:18:08.155 20:19:12 -- target/tls.sh@209 -- # killprocess 3180283 00:18:08.155 20:19:12 -- common/autotest_common.sh@936 -- # '[' -z 3180283 ']' 00:18:08.155 20:19:12 -- common/autotest_common.sh@940 -- # kill -0 3180283 00:18:08.155 20:19:12 -- common/autotest_common.sh@941 -- # uname 00:18:08.155 20:19:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.155 20:19:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180283 00:18:08.155 20:19:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:08.155 20:19:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:08.155 20:19:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180283' 00:18:08.155 killing process with pid 3180283 00:18:08.155 20:19:12 -- common/autotest_common.sh@955 -- # kill 3180283 00:18:08.155 20:19:12 -- common/autotest_common.sh@960 -- # wait 3180283 00:18:08.415 20:19:13 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:08.415 20:19:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:08.415 20:19:13 -- target/tls.sh@212 -- # echo '{ 00:18:08.415 "subsystems": [ 00:18:08.415 { 00:18:08.415 "subsystem": "iobuf", 00:18:08.415 "config": [ 00:18:08.415 { 00:18:08.415 "method": "iobuf_set_options", 00:18:08.415 "params": { 00:18:08.415 "small_pool_count": 8192, 00:18:08.415 "large_pool_count": 1024, 00:18:08.415 "small_bufsize": 8192, 00:18:08.415 "large_bufsize": 135168 00:18:08.415 } 00:18:08.415 } 00:18:08.415 ] 00:18:08.415 }, 00:18:08.415 { 00:18:08.415 "subsystem": "sock", 00:18:08.415 "config": [ 00:18:08.415 { 00:18:08.415 "method": "sock_impl_set_options", 00:18:08.415 "params": { 00:18:08.415 "impl_name": "posix", 00:18:08.415 "recv_buf_size": 2097152, 00:18:08.415 "send_buf_size": 2097152, 00:18:08.415 "enable_recv_pipe": true, 00:18:08.415 "enable_quickack": false, 00:18:08.415 "enable_placement_id": 0, 00:18:08.415 "enable_zerocopy_send_server": true, 00:18:08.415 "enable_zerocopy_send_client": false, 00:18:08.415 "zerocopy_threshold": 0, 00:18:08.415 "tls_version": 0, 00:18:08.415 "enable_ktls": false 00:18:08.415 } 00:18:08.415 }, 00:18:08.415 { 00:18:08.415 "method": "sock_impl_set_options", 00:18:08.415 "params": { 00:18:08.415 "impl_name": "ssl", 00:18:08.415 "recv_buf_size": 4096, 00:18:08.415 "send_buf_size": 4096, 00:18:08.415 "enable_recv_pipe": true, 00:18:08.415 "enable_quickack": false, 00:18:08.415 "enable_placement_id": 0, 00:18:08.415 "enable_zerocopy_send_server": true, 00:18:08.415 "enable_zerocopy_send_client": false, 00:18:08.415 "zerocopy_threshold": 0, 00:18:08.415 "tls_version": 0, 00:18:08.415 "enable_ktls": false 00:18:08.415 } 00:18:08.415 } 00:18:08.415 ] 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "subsystem": "vmd", 00:18:08.416 "config": [] 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "subsystem": "accel", 00:18:08.416 "config": [ 00:18:08.416 { 00:18:08.416 "method": "accel_set_options", 00:18:08.416 "params": { 00:18:08.416 "small_cache_size": 128, 00:18:08.416 "large_cache_size": 16, 00:18:08.416 "task_count": 2048, 00:18:08.416 "sequence_count": 2048, 00:18:08.416 "buf_count": 2048 00:18:08.416 } 00:18:08.416 } 00:18:08.416 ] 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "subsystem": "bdev", 00:18:08.416 "config": [ 00:18:08.416 { 00:18:08.416 "method": "bdev_set_options", 00:18:08.416 "params": { 00:18:08.416 "bdev_io_pool_size": 65535, 00:18:08.416 "bdev_io_cache_size": 256, 00:18:08.416 "bdev_auto_examine": true, 00:18:08.416 "iobuf_small_cache_size": 128, 00:18:08.416 "iobuf_large_cache_size": 16 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "bdev_raid_set_options", 00:18:08.416 "params": { 00:18:08.416 "process_window_size_kb": 1024 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "bdev_iscsi_set_options", 00:18:08.416 "params": { 00:18:08.416 "timeout_sec": 30 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "bdev_nvme_set_options", 00:18:08.416 "params": { 00:18:08.416 "action_on_timeout": "none", 00:18:08.416 "timeout_us": 0, 00:18:08.416 "timeout_admin_us": 0, 00:18:08.416 "keep_alive_timeout_ms": 10000, 00:18:08.416 "transport_retry_count": 4, 00:18:08.416 "arbitration_burst": 0, 00:18:08.416 "low_priority_weight": 0, 00:18:08.416 "medium_priority_weight": 0, 00:18:08.416 "high_priority_weight": 0, 00:18:08.416 "nvme_adminq_poll_period_us": 10000, 00:18:08.416 "nvme_ioq_poll_period_us": 0, 00:18:08.416 "io_queue_requests": 0, 00:18:08.416 "delay_cmd_submit": true, 00:18:08.416 "bdev_retry_count": 3, 00:18:08.416 "transport_ack_timeout": 0, 00:18:08.416 "ctrlr_loss_timeout_sec": 0, 00:18:08.416 "reconnect_delay_sec": 0, 00:18:08.416 "fast_io_fail_timeout_sec": 0, 00:18:08.416 "generate_uuids": false, 00:18:08.416 "transport_tos": 0, 00:18:08.416 "io_path_stat": false, 00:18:08.416 "allow_accel_sequence": false 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "bdev_nvme_set_hotplug", 00:18:08.416 "params": { 00:18:08.416 "period_us": 100000, 00:18:08.416 "enable": false 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "bdev_malloc_create", 00:18:08.416 "params": { 00:18:08.416 "name": "malloc0", 00:18:08.416 "num_blocks": 8192, 00:18:08.416 "block_size": 4096, 00:18:08.416 "physical_block_size": 4096, 00:18:08.416 "uuid": "7e312d27-14a1-4810-99d5-c75c4d1a0691", 00:18:08.416 "optimal_io_boundary": 0 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "bdev_wait_for_examine" 00:18:08.416 } 00:18:08.416 ] 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "subsystem": "nbd", 00:18:08.416 "config": [] 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "subsystem": "scheduler", 00:18:08.416 "config": [ 00:18:08.416 { 00:18:08.416 "method": "framework_set_scheduler", 00:18:08.416 "params": { 00:18:08.416 "name": "static" 00:18:08.416 } 00:18:08.416 } 00:18:08.416 ] 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "subsystem": "nvmf", 00:18:08.416 "config": [ 00:18:08.416 { 00:18:08.416 "method": "nvmf_set_config", 00:18:08.416 "params": { 00:18:08.416 "discovery_filter": "match_any", 00:18:08.416 "admin_cmd_passthru": { 00:18:08.416 "identify_ctrlr": false 00:18:08.416 } 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_set_max_subsystems", 00:18:08.416 "params": { 00:18:08.416 "max_subsystems": 1024 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_set_crdt", 00:18:08.416 "params": { 00:18:08.416 "crdt1": 0, 00:18:08.416 "crdt2": 0, 00:18:08.416 "crdt3": 0 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_create_transport", 00:18:08.416 "params": { 00:18:08.416 "trtype": "TCP", 00:18:08.416 "max_queue_depth": 128, 00:18:08.416 "max_io_qpairs_per_ctrlr": 127, 00:18:08.416 "in_capsule_data_size": 4096, 00:18:08.416 "max_io_size": 131072, 00:18:08.416 "io_unit_size": 131072, 00:18:08.416 "max_aq_depth": 128, 00:18:08.416 "num_shared_buffers": 511, 00:18:08.416 "buf_cache_size": 4294967295, 00:18:08.416 "dif_insert_or_strip": false, 00:18:08.416 "zcopy": false, 00:18:08.416 "c2h_success": false, 00:18:08.416 "sock_priority": 0, 00:18:08.416 "abort_timeout_sec": 1 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_create_subsystem", 00:18:08.416 "params": { 00:18:08.416 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.416 "allow_any_host": false, 00:18:08.416 "serial_number": "SPDK00000000000001", 00:18:08.416 "model_number": "SPDK bdev Controller", 00:18:08.416 "max_namespaces": 10, 00:18:08.416 "min_cntlid": 1, 00:18:08.416 "max_cntlid": 65519, 00:18:08.416 "ana_reporting": false 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_subsystem_add_host", 00:18:08.416 "params": { 00:18:08.416 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.416 "host": "nqn.2016-06.io.spdk:host1", 00:18:08.416 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_subsystem_add_ns", 00:18:08.416 "params": { 00:18:08.416 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.416 "namespace": { 00:18:08.416 "nsid": 1, 00:18:08.416 "bdev_name": "malloc0", 00:18:08.416 "nguid": "7E312D2714A1481099D5C75C4D1A0691", 00:18:08.416 "uuid": "7e312d27-14a1-4810-99d5-c75c4d1a0691" 00:18:08.416 } 00:18:08.416 } 00:18:08.416 }, 00:18:08.416 { 00:18:08.416 "method": "nvmf_subsystem_add_listener", 00:18:08.416 "params": { 00:18:08.417 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.417 "listen_address": { 00:18:08.417 "trtype": "TCP", 00:18:08.417 "adrfam": "IPv4", 00:18:08.417 "traddr": "10.0.0.2", 00:18:08.417 "trsvcid": "4420" 00:18:08.417 }, 00:18:08.417 "secure_channel": true 00:18:08.417 } 00:18:08.417 } 00:18:08.417 ] 00:18:08.417 } 00:18:08.417 ] 00:18:08.417 }' 00:18:08.417 20:19:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:08.417 20:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:08.417 20:19:13 -- nvmf/common.sh@469 -- # nvmfpid=3180982 00:18:08.417 20:19:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:08.417 20:19:13 -- nvmf/common.sh@470 -- # waitforlisten 3180982 00:18:08.417 20:19:13 -- common/autotest_common.sh@829 -- # '[' -z 3180982 ']' 00:18:08.417 20:19:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:08.417 20:19:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.417 20:19:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:08.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:08.417 20:19:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.417 20:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:08.417 [2024-11-20 20:19:13.329879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:08.417 [2024-11-20 20:19:13.329960] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:08.417 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.417 [2024-11-20 20:19:13.396985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.676 [2024-11-20 20:19:13.512477] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:08.676 [2024-11-20 20:19:13.512636] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:08.676 [2024-11-20 20:19:13.512653] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:08.676 [2024-11-20 20:19:13.512665] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:08.676 [2024-11-20 20:19:13.512694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:08.935 [2024-11-20 20:19:13.736904] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:08.935 [2024-11-20 20:19:13.768927] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:08.935 [2024-11-20 20:19:13.769217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:09.502 20:19:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.502 20:19:14 -- common/autotest_common.sh@862 -- # return 0 00:18:09.502 20:19:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:09.502 20:19:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:09.502 20:19:14 -- common/autotest_common.sh@10 -- # set +x 00:18:09.502 20:19:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:09.502 20:19:14 -- target/tls.sh@216 -- # bdevperf_pid=3181141 00:18:09.502 20:19:14 -- target/tls.sh@217 -- # waitforlisten 3181141 /var/tmp/bdevperf.sock 00:18:09.502 20:19:14 -- common/autotest_common.sh@829 -- # '[' -z 3181141 ']' 00:18:09.502 20:19:14 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:09.502 20:19:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:09.502 20:19:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:09.502 20:19:14 -- target/tls.sh@213 -- # echo '{ 00:18:09.502 "subsystems": [ 00:18:09.502 { 00:18:09.502 "subsystem": "iobuf", 00:18:09.502 "config": [ 00:18:09.502 { 00:18:09.502 "method": "iobuf_set_options", 00:18:09.502 "params": { 00:18:09.502 "small_pool_count": 8192, 00:18:09.502 "large_pool_count": 1024, 00:18:09.502 "small_bufsize": 8192, 00:18:09.502 "large_bufsize": 135168 00:18:09.502 } 00:18:09.502 } 00:18:09.502 ] 00:18:09.502 }, 00:18:09.502 { 00:18:09.502 "subsystem": "sock", 00:18:09.502 "config": [ 00:18:09.502 { 00:18:09.502 "method": "sock_impl_set_options", 00:18:09.502 "params": { 00:18:09.502 "impl_name": "posix", 00:18:09.502 "recv_buf_size": 2097152, 00:18:09.502 "send_buf_size": 2097152, 00:18:09.502 "enable_recv_pipe": true, 00:18:09.502 "enable_quickack": false, 00:18:09.503 "enable_placement_id": 0, 00:18:09.503 "enable_zerocopy_send_server": true, 00:18:09.503 "enable_zerocopy_send_client": false, 00:18:09.503 "zerocopy_threshold": 0, 00:18:09.503 "tls_version": 0, 00:18:09.503 "enable_ktls": false 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "sock_impl_set_options", 00:18:09.503 "params": { 00:18:09.503 "impl_name": "ssl", 00:18:09.503 "recv_buf_size": 4096, 00:18:09.503 "send_buf_size": 4096, 00:18:09.503 "enable_recv_pipe": true, 00:18:09.503 "enable_quickack": false, 00:18:09.503 "enable_placement_id": 0, 00:18:09.503 "enable_zerocopy_send_server": true, 00:18:09.503 "enable_zerocopy_send_client": false, 00:18:09.503 "zerocopy_threshold": 0, 00:18:09.503 "tls_version": 0, 00:18:09.503 "enable_ktls": false 00:18:09.503 } 00:18:09.503 } 00:18:09.503 ] 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "subsystem": "vmd", 00:18:09.503 "config": [] 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "subsystem": "accel", 00:18:09.503 "config": [ 00:18:09.503 { 00:18:09.503 "method": "accel_set_options", 00:18:09.503 "params": { 00:18:09.503 "small_cache_size": 128, 00:18:09.503 "large_cache_size": 16, 00:18:09.503 "task_count": 2048, 00:18:09.503 "sequence_count": 2048, 00:18:09.503 "buf_count": 2048 00:18:09.503 } 00:18:09.503 } 00:18:09.503 ] 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "subsystem": "bdev", 00:18:09.503 "config": [ 00:18:09.503 { 00:18:09.503 "method": "bdev_set_options", 00:18:09.503 "params": { 00:18:09.503 "bdev_io_pool_size": 65535, 00:18:09.503 "bdev_io_cache_size": 256, 00:18:09.503 "bdev_auto_examine": true, 00:18:09.503 "iobuf_small_cache_size": 128, 00:18:09.503 "iobuf_large_cache_size": 16 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "bdev_raid_set_options", 00:18:09.503 "params": { 00:18:09.503 "process_window_size_kb": 1024 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "bdev_iscsi_set_options", 00:18:09.503 "params": { 00:18:09.503 "timeout_sec": 30 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "bdev_nvme_set_options", 00:18:09.503 "params": { 00:18:09.503 "action_on_timeout": "none", 00:18:09.503 "timeout_us": 0, 00:18:09.503 "timeout_admin_us": 0, 00:18:09.503 "keep_alive_timeout_ms": 10000, 00:18:09.503 "transport_retry_count": 4, 00:18:09.503 "arbitration_burst": 0, 00:18:09.503 "low_priority_weight": 0, 00:18:09.503 "medium_priority_weight": 0, 00:18:09.503 "high_priority_weight": 0, 00:18:09.503 "nvme_adminq_poll_period_us": 10000, 00:18:09.503 "nvme_ioq_poll_period_us": 0, 00:18:09.503 "io_queue_requests": 512, 00:18:09.503 "delay_cmd_submit": true, 00:18:09.503 "bdev_retry_count": 3, 00:18:09.503 "transport_ack_timeout": 0, 00:18:09.503 "ctrlr_loss_timeout_sec": 0, 00:18:09.503 "reconnect_delay_sec": 0, 00:18:09.503 "fast_io_fail_timeout_sec": 0, 00:18:09.503 "generate_uuids": false, 00:18:09.503 "transport_tos": 0, 00:18:09.503 "io_path_stat": false, 00:18:09.503 "allow_accel_sequence": false 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "bdev_nvme_attach_controller", 00:18:09.503 "params": { 00:18:09.503 "name": "TLSTEST", 00:18:09.503 "trtype": "TCP", 00:18:09.503 "adrfam": "IPv4", 00:18:09.503 "traddr": "10.0.0.2", 00:18:09.503 "trsvcid": "4420", 00:18:09.503 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:09.503 "prchk_reftag": false, 00:18:09.503 "prchk_guard": false, 00:18:09.503 "ctrlr_loss_timeout_sec": 0, 00:18:09.503 "reconnect_delay_sec": 0, 00:18:09.503 "fast_io_fail_timeout_sec": 0, 00:18:09.503 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:09.503 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:09.503 "hdgst": false, 00:18:09.503 "ddgst": false 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "bdev_nvme_set_hotplug", 00:18:09.503 "params": { 00:18:09.503 "period_us": 100000, 00:18:09.503 "enable": false 00:18:09.503 } 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "method": "bdev_wait_for_examine" 00:18:09.503 } 00:18:09.503 ] 00:18:09.503 }, 00:18:09.503 { 00:18:09.503 "subsystem": "nbd", 00:18:09.503 "config": [] 00:18:09.503 } 00:18:09.503 ] 00:18:09.503 }' 00:18:09.503 20:19:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:09.503 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:09.503 20:19:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:09.503 20:19:14 -- common/autotest_common.sh@10 -- # set +x 00:18:09.503 [2024-11-20 20:19:14.356518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:09.503 [2024-11-20 20:19:14.356590] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3181141 ] 00:18:09.503 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.503 [2024-11-20 20:19:14.412503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:09.503 [2024-11-20 20:19:14.516475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:09.764 [2024-11-20 20:19:14.675241] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:10.334 20:19:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:10.334 20:19:15 -- common/autotest_common.sh@862 -- # return 0 00:18:10.334 20:19:15 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:10.592 Running I/O for 10 seconds... 00:18:20.579 00:18:20.579 Latency(us) 00:18:20.579 [2024-11-20T19:19:25.618Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.579 [2024-11-20T19:19:25.618Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:20.579 Verification LBA range: start 0x0 length 0x2000 00:18:20.579 TLSTESTn1 : 10.02 4646.77 18.15 0.00 0.00 27506.36 4830.25 46215.02 00:18:20.579 [2024-11-20T19:19:25.618Z] =================================================================================================================== 00:18:20.579 [2024-11-20T19:19:25.618Z] Total : 4646.77 18.15 0.00 0.00 27506.36 4830.25 46215.02 00:18:20.579 0 00:18:20.579 20:19:25 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:20.579 20:19:25 -- target/tls.sh@223 -- # killprocess 3181141 00:18:20.579 20:19:25 -- common/autotest_common.sh@936 -- # '[' -z 3181141 ']' 00:18:20.579 20:19:25 -- common/autotest_common.sh@940 -- # kill -0 3181141 00:18:20.579 20:19:25 -- common/autotest_common.sh@941 -- # uname 00:18:20.579 20:19:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.579 20:19:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3181141 00:18:20.579 20:19:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:20.579 20:19:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:20.579 20:19:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3181141' 00:18:20.579 killing process with pid 3181141 00:18:20.579 20:19:25 -- common/autotest_common.sh@955 -- # kill 3181141 00:18:20.579 Received shutdown signal, test time was about 10.000000 seconds 00:18:20.579 00:18:20.579 Latency(us) 00:18:20.579 [2024-11-20T19:19:25.618Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.579 [2024-11-20T19:19:25.618Z] =================================================================================================================== 00:18:20.579 [2024-11-20T19:19:25.618Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:20.579 20:19:25 -- common/autotest_common.sh@960 -- # wait 3181141 00:18:20.838 20:19:25 -- target/tls.sh@224 -- # killprocess 3180982 00:18:20.838 20:19:25 -- common/autotest_common.sh@936 -- # '[' -z 3180982 ']' 00:18:20.838 20:19:25 -- common/autotest_common.sh@940 -- # kill -0 3180982 00:18:20.838 20:19:25 -- common/autotest_common.sh@941 -- # uname 00:18:20.838 20:19:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.838 20:19:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3180982 00:18:20.838 20:19:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:20.838 20:19:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:20.838 20:19:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3180982' 00:18:20.838 killing process with pid 3180982 00:18:20.838 20:19:25 -- common/autotest_common.sh@955 -- # kill 3180982 00:18:20.838 20:19:25 -- common/autotest_common.sh@960 -- # wait 3180982 00:18:21.097 20:19:26 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:21.097 20:19:26 -- target/tls.sh@227 -- # cleanup 00:18:21.097 20:19:26 -- target/tls.sh@15 -- # process_shm --id 0 00:18:21.097 20:19:26 -- common/autotest_common.sh@806 -- # type=--id 00:18:21.097 20:19:26 -- common/autotest_common.sh@807 -- # id=0 00:18:21.097 20:19:26 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:21.097 20:19:26 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:21.356 20:19:26 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:21.356 20:19:26 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:21.356 20:19:26 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:21.356 20:19:26 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:21.356 nvmf_trace.0 00:18:21.356 20:19:26 -- common/autotest_common.sh@821 -- # return 0 00:18:21.356 20:19:26 -- target/tls.sh@16 -- # killprocess 3181141 00:18:21.356 20:19:26 -- common/autotest_common.sh@936 -- # '[' -z 3181141 ']' 00:18:21.356 20:19:26 -- common/autotest_common.sh@940 -- # kill -0 3181141 00:18:21.356 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3181141) - No such process 00:18:21.356 20:19:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3181141 is not found' 00:18:21.356 Process with pid 3181141 is not found 00:18:21.356 20:19:26 -- target/tls.sh@17 -- # nvmftestfini 00:18:21.356 20:19:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:21.356 20:19:26 -- nvmf/common.sh@116 -- # sync 00:18:21.356 20:19:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:21.356 20:19:26 -- nvmf/common.sh@119 -- # set +e 00:18:21.356 20:19:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:21.356 20:19:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:21.356 rmmod nvme_tcp 00:18:21.356 rmmod nvme_fabrics 00:18:21.356 rmmod nvme_keyring 00:18:21.356 20:19:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:21.356 20:19:26 -- nvmf/common.sh@123 -- # set -e 00:18:21.356 20:19:26 -- nvmf/common.sh@124 -- # return 0 00:18:21.356 20:19:26 -- nvmf/common.sh@477 -- # '[' -n 3180982 ']' 00:18:21.356 20:19:26 -- nvmf/common.sh@478 -- # killprocess 3180982 00:18:21.356 20:19:26 -- common/autotest_common.sh@936 -- # '[' -z 3180982 ']' 00:18:21.356 20:19:26 -- common/autotest_common.sh@940 -- # kill -0 3180982 00:18:21.356 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3180982) - No such process 00:18:21.356 20:19:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3180982 is not found' 00:18:21.356 Process with pid 3180982 is not found 00:18:21.356 20:19:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:21.356 20:19:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:21.356 20:19:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:21.356 20:19:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:21.356 20:19:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:21.356 20:19:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.356 20:19:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.356 20:19:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.323 20:19:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.323 20:19:28 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:23.323 00:18:23.323 real 1m16.115s 00:18:23.323 user 2m3.272s 00:18:23.323 sys 0m23.694s 00:18:23.323 20:19:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:23.323 20:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:23.323 ************************************ 00:18:23.323 END TEST nvmf_tls 00:18:23.323 ************************************ 00:18:23.323 20:19:28 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:23.323 20:19:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.323 20:19:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.323 20:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:23.323 ************************************ 00:18:23.323 START TEST nvmf_fips 00:18:23.323 ************************************ 00:18:23.323 20:19:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:23.323 * Looking for test storage... 00:18:23.323 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:23.323 20:19:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:23.323 20:19:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:23.323 20:19:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:23.583 20:19:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:23.583 20:19:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:23.583 20:19:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.583 20:19:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.583 20:19:28 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.583 20:19:28 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.583 20:19:28 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.583 20:19:28 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.583 20:19:28 -- scripts/common.sh@337 -- # local 'op=<' 00:18:23.583 20:19:28 -- scripts/common.sh@339 -- # ver1_l=2 00:18:23.583 20:19:28 -- scripts/common.sh@340 -- # ver2_l=1 00:18:23.583 20:19:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.583 20:19:28 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.583 20:19:28 -- scripts/common.sh@344 -- # : 1 00:18:23.583 20:19:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.583 20:19:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.583 20:19:28 -- scripts/common.sh@364 -- # decimal 1 00:18:23.583 20:19:28 -- scripts/common.sh@352 -- # local d=1 00:18:23.583 20:19:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.583 20:19:28 -- scripts/common.sh@354 -- # echo 1 00:18:23.583 20:19:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.583 20:19:28 -- scripts/common.sh@365 -- # decimal 2 00:18:23.583 20:19:28 -- scripts/common.sh@352 -- # local d=2 00:18:23.583 20:19:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:23.583 20:19:28 -- scripts/common.sh@354 -- # echo 2 00:18:23.583 20:19:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:23.583 20:19:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.583 20:19:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.583 20:19:28 -- scripts/common.sh@367 -- # return 0 00:18:23.583 20:19:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:23.583 20:19:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:23.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.583 --rc genhtml_branch_coverage=1 00:18:23.583 --rc genhtml_function_coverage=1 00:18:23.583 --rc genhtml_legend=1 00:18:23.583 --rc geninfo_all_blocks=1 00:18:23.583 --rc geninfo_unexecuted_blocks=1 00:18:23.583 00:18:23.583 ' 00:18:23.583 20:19:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:23.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.583 --rc genhtml_branch_coverage=1 00:18:23.583 --rc genhtml_function_coverage=1 00:18:23.583 --rc genhtml_legend=1 00:18:23.583 --rc geninfo_all_blocks=1 00:18:23.583 --rc geninfo_unexecuted_blocks=1 00:18:23.583 00:18:23.583 ' 00:18:23.583 20:19:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:23.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.583 --rc genhtml_branch_coverage=1 00:18:23.583 --rc genhtml_function_coverage=1 00:18:23.583 --rc genhtml_legend=1 00:18:23.583 --rc geninfo_all_blocks=1 00:18:23.583 --rc geninfo_unexecuted_blocks=1 00:18:23.583 00:18:23.583 ' 00:18:23.583 20:19:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:23.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.583 --rc genhtml_branch_coverage=1 00:18:23.583 --rc genhtml_function_coverage=1 00:18:23.583 --rc genhtml_legend=1 00:18:23.583 --rc geninfo_all_blocks=1 00:18:23.583 --rc geninfo_unexecuted_blocks=1 00:18:23.583 00:18:23.583 ' 00:18:23.583 20:19:28 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.583 20:19:28 -- nvmf/common.sh@7 -- # uname -s 00:18:23.583 20:19:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.583 20:19:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.583 20:19:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.583 20:19:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.583 20:19:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.583 20:19:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.583 20:19:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.583 20:19:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.583 20:19:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.583 20:19:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.583 20:19:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.583 20:19:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.583 20:19:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.583 20:19:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.583 20:19:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.583 20:19:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.583 20:19:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.583 20:19:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.583 20:19:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.583 20:19:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.583 20:19:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.583 20:19:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.583 20:19:28 -- paths/export.sh@5 -- # export PATH 00:18:23.583 20:19:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.583 20:19:28 -- nvmf/common.sh@46 -- # : 0 00:18:23.583 20:19:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.583 20:19:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.583 20:19:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.583 20:19:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.584 20:19:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.584 20:19:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.584 20:19:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.584 20:19:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.584 20:19:28 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:23.584 20:19:28 -- fips/fips.sh@89 -- # check_openssl_version 00:18:23.584 20:19:28 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:23.584 20:19:28 -- fips/fips.sh@85 -- # openssl version 00:18:23.584 20:19:28 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:23.584 20:19:28 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:23.584 20:19:28 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:23.584 20:19:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.584 20:19:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.584 20:19:28 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.584 20:19:28 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.584 20:19:28 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.584 20:19:28 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.584 20:19:28 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:23.584 20:19:28 -- scripts/common.sh@339 -- # ver1_l=3 00:18:23.584 20:19:28 -- scripts/common.sh@340 -- # ver2_l=3 00:18:23.584 20:19:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.584 20:19:28 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.584 20:19:28 -- scripts/common.sh@347 -- # : 1 00:18:23.584 20:19:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.584 20:19:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.584 20:19:28 -- scripts/common.sh@364 -- # decimal 3 00:18:23.584 20:19:28 -- scripts/common.sh@352 -- # local d=3 00:18:23.584 20:19:28 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:23.584 20:19:28 -- scripts/common.sh@354 -- # echo 3 00:18:23.584 20:19:28 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:23.584 20:19:28 -- scripts/common.sh@365 -- # decimal 3 00:18:23.584 20:19:28 -- scripts/common.sh@352 -- # local d=3 00:18:23.584 20:19:28 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:23.584 20:19:28 -- scripts/common.sh@354 -- # echo 3 00:18:23.584 20:19:28 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:23.584 20:19:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.584 20:19:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.584 20:19:28 -- scripts/common.sh@363 -- # (( v++ )) 00:18:23.584 20:19:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.584 20:19:28 -- scripts/common.sh@364 -- # decimal 1 00:18:23.584 20:19:28 -- scripts/common.sh@352 -- # local d=1 00:18:23.584 20:19:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.584 20:19:28 -- scripts/common.sh@354 -- # echo 1 00:18:23.584 20:19:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.584 20:19:28 -- scripts/common.sh@365 -- # decimal 0 00:18:23.584 20:19:28 -- scripts/common.sh@352 -- # local d=0 00:18:23.584 20:19:28 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:23.584 20:19:28 -- scripts/common.sh@354 -- # echo 0 00:18:23.584 20:19:28 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:23.584 20:19:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.584 20:19:28 -- scripts/common.sh@366 -- # return 0 00:18:23.584 20:19:28 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:23.584 20:19:28 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:23.584 20:19:28 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:23.584 20:19:28 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:23.584 20:19:28 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:23.584 20:19:28 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:23.584 20:19:28 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:23.584 20:19:28 -- fips/fips.sh@113 -- # build_openssl_config 00:18:23.584 20:19:28 -- fips/fips.sh@37 -- # cat 00:18:23.584 20:19:28 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:23.584 20:19:28 -- fips/fips.sh@58 -- # cat - 00:18:23.584 20:19:28 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:23.584 20:19:28 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:23.584 20:19:28 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:23.584 20:19:28 -- fips/fips.sh@116 -- # openssl list -providers 00:18:23.584 20:19:28 -- fips/fips.sh@116 -- # grep name 00:18:23.584 20:19:28 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:23.584 20:19:28 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:23.584 20:19:28 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:23.584 20:19:28 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:23.584 20:19:28 -- fips/fips.sh@127 -- # : 00:18:23.584 20:19:28 -- common/autotest_common.sh@650 -- # local es=0 00:18:23.584 20:19:28 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:23.584 20:19:28 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:23.584 20:19:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:23.584 20:19:28 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:23.584 20:19:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:23.584 20:19:28 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:23.584 20:19:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:23.584 20:19:28 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:23.584 20:19:28 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:23.584 20:19:28 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:23.584 Error setting digest 00:18:23.584 40C27F09E37F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:23.584 40C27F09E37F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:23.584 20:19:28 -- common/autotest_common.sh@653 -- # es=1 00:18:23.584 20:19:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:23.584 20:19:28 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:23.584 20:19:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:23.584 20:19:28 -- fips/fips.sh@130 -- # nvmftestinit 00:18:23.584 20:19:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.584 20:19:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.584 20:19:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.584 20:19:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.584 20:19:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.584 20:19:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.584 20:19:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.584 20:19:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.584 20:19:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.584 20:19:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.584 20:19:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.584 20:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:26.123 20:19:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:26.124 20:19:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:26.124 20:19:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:26.124 20:19:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:26.124 20:19:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:26.124 20:19:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:26.124 20:19:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:26.124 20:19:30 -- nvmf/common.sh@294 -- # net_devs=() 00:18:26.124 20:19:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:26.124 20:19:30 -- nvmf/common.sh@295 -- # e810=() 00:18:26.124 20:19:30 -- nvmf/common.sh@295 -- # local -ga e810 00:18:26.124 20:19:30 -- nvmf/common.sh@296 -- # x722=() 00:18:26.124 20:19:30 -- nvmf/common.sh@296 -- # local -ga x722 00:18:26.124 20:19:30 -- nvmf/common.sh@297 -- # mlx=() 00:18:26.124 20:19:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:26.124 20:19:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:26.124 20:19:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:26.124 20:19:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:26.124 20:19:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:26.124 20:19:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:26.124 20:19:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:26.124 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:26.124 20:19:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:26.124 20:19:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:26.124 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:26.124 20:19:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:26.124 20:19:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:26.124 20:19:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:26.124 20:19:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:26.124 20:19:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:26.124 20:19:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:26.124 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:26.124 20:19:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:26.124 20:19:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:26.124 20:19:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:26.124 20:19:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:26.124 20:19:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:26.124 20:19:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:26.124 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:26.124 20:19:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:26.124 20:19:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:26.124 20:19:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:26.124 20:19:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:26.124 20:19:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:26.124 20:19:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:26.124 20:19:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:26.124 20:19:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:26.124 20:19:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:26.124 20:19:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:26.124 20:19:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:26.124 20:19:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:26.124 20:19:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:26.124 20:19:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:26.124 20:19:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:26.124 20:19:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:26.124 20:19:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:26.124 20:19:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:26.124 20:19:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:26.124 20:19:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:26.124 20:19:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:26.124 20:19:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:26.124 20:19:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:26.124 20:19:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:26.124 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:26.124 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:18:26.124 00:18:26.124 --- 10.0.0.2 ping statistics --- 00:18:26.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:26.124 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:18:26.124 20:19:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:26.124 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:26.124 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:18:26.124 00:18:26.124 --- 10.0.0.1 ping statistics --- 00:18:26.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:26.124 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:18:26.124 20:19:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:26.124 20:19:30 -- nvmf/common.sh@410 -- # return 0 00:18:26.124 20:19:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:26.124 20:19:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:26.124 20:19:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:26.124 20:19:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:26.124 20:19:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:26.124 20:19:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:26.124 20:19:30 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:26.124 20:19:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:26.124 20:19:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:26.124 20:19:30 -- common/autotest_common.sh@10 -- # set +x 00:18:26.124 20:19:30 -- nvmf/common.sh@469 -- # nvmfpid=3184597 00:18:26.124 20:19:30 -- nvmf/common.sh@470 -- # waitforlisten 3184597 00:18:26.124 20:19:30 -- common/autotest_common.sh@829 -- # '[' -z 3184597 ']' 00:18:26.124 20:19:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:26.124 20:19:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:26.124 20:19:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.124 20:19:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:26.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:26.124 20:19:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.124 20:19:30 -- common/autotest_common.sh@10 -- # set +x 00:18:26.125 [2024-11-20 20:19:30.831710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.125 [2024-11-20 20:19:30.831797] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:26.125 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.125 [2024-11-20 20:19:30.898169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.125 [2024-11-20 20:19:31.005194] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:26.125 [2024-11-20 20:19:31.005353] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:26.125 [2024-11-20 20:19:31.005369] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:26.125 [2024-11-20 20:19:31.005391] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:26.125 [2024-11-20 20:19:31.005426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:27.065 20:19:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.065 20:19:31 -- common/autotest_common.sh@862 -- # return 0 00:18:27.065 20:19:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:27.065 20:19:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:27.065 20:19:31 -- common/autotest_common.sh@10 -- # set +x 00:18:27.065 20:19:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:27.065 20:19:31 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:27.065 20:19:31 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:27.065 20:19:31 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.065 20:19:31 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:27.065 20:19:31 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.065 20:19:31 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.065 20:19:31 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.065 20:19:31 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:27.065 [2024-11-20 20:19:32.075189] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:27.065 [2024-11-20 20:19:32.091175] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:27.065 [2024-11-20 20:19:32.091395] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:27.324 malloc0 00:18:27.324 20:19:32 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:27.324 20:19:32 -- fips/fips.sh@147 -- # bdevperf_pid=3184764 00:18:27.324 20:19:32 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:27.324 20:19:32 -- fips/fips.sh@148 -- # waitforlisten 3184764 /var/tmp/bdevperf.sock 00:18:27.324 20:19:32 -- common/autotest_common.sh@829 -- # '[' -z 3184764 ']' 00:18:27.324 20:19:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:27.324 20:19:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:27.324 20:19:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:27.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:27.324 20:19:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:27.324 20:19:32 -- common/autotest_common.sh@10 -- # set +x 00:18:27.324 [2024-11-20 20:19:32.211393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:27.324 [2024-11-20 20:19:32.211475] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3184764 ] 00:18:27.324 EAL: No free 2048 kB hugepages reported on node 1 00:18:27.324 [2024-11-20 20:19:32.267477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:27.584 [2024-11-20 20:19:32.370685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:28.155 20:19:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:28.413 20:19:33 -- common/autotest_common.sh@862 -- # return 0 00:18:28.413 20:19:33 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:28.671 [2024-11-20 20:19:33.471481] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:28.671 TLSTESTn1 00:18:28.671 20:19:33 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:28.671 Running I/O for 10 seconds... 00:18:40.883 00:18:40.883 Latency(us) 00:18:40.883 [2024-11-20T19:19:45.922Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:40.883 [2024-11-20T19:19:45.922Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:40.883 Verification LBA range: start 0x0 length 0x2000 00:18:40.883 TLSTESTn1 : 10.02 4589.93 17.93 0.00 0.00 27848.24 5121.52 43690.67 00:18:40.883 [2024-11-20T19:19:45.922Z] =================================================================================================================== 00:18:40.883 [2024-11-20T19:19:45.922Z] Total : 4589.93 17.93 0.00 0.00 27848.24 5121.52 43690.67 00:18:40.883 0 00:18:40.883 20:19:43 -- fips/fips.sh@1 -- # cleanup 00:18:40.883 20:19:43 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:40.883 20:19:43 -- common/autotest_common.sh@806 -- # type=--id 00:18:40.883 20:19:43 -- common/autotest_common.sh@807 -- # id=0 00:18:40.883 20:19:43 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:40.883 20:19:43 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:40.883 20:19:43 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:40.883 20:19:43 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:40.883 20:19:43 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:40.883 20:19:43 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:40.883 nvmf_trace.0 00:18:40.883 20:19:43 -- common/autotest_common.sh@821 -- # return 0 00:18:40.883 20:19:43 -- fips/fips.sh@16 -- # killprocess 3184764 00:18:40.883 20:19:43 -- common/autotest_common.sh@936 -- # '[' -z 3184764 ']' 00:18:40.883 20:19:43 -- common/autotest_common.sh@940 -- # kill -0 3184764 00:18:40.883 20:19:43 -- common/autotest_common.sh@941 -- # uname 00:18:40.883 20:19:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:40.883 20:19:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3184764 00:18:40.883 20:19:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:40.883 20:19:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:40.883 20:19:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3184764' 00:18:40.883 killing process with pid 3184764 00:18:40.883 20:19:43 -- common/autotest_common.sh@955 -- # kill 3184764 00:18:40.883 Received shutdown signal, test time was about 10.000000 seconds 00:18:40.883 00:18:40.883 Latency(us) 00:18:40.883 [2024-11-20T19:19:45.922Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:40.883 [2024-11-20T19:19:45.922Z] =================================================================================================================== 00:18:40.883 [2024-11-20T19:19:45.922Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:40.883 20:19:43 -- common/autotest_common.sh@960 -- # wait 3184764 00:18:40.883 20:19:44 -- fips/fips.sh@17 -- # nvmftestfini 00:18:40.883 20:19:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:40.883 20:19:44 -- nvmf/common.sh@116 -- # sync 00:18:40.883 20:19:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:40.883 20:19:44 -- nvmf/common.sh@119 -- # set +e 00:18:40.883 20:19:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:40.883 20:19:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:40.883 rmmod nvme_tcp 00:18:40.883 rmmod nvme_fabrics 00:18:40.883 rmmod nvme_keyring 00:18:40.883 20:19:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:40.883 20:19:44 -- nvmf/common.sh@123 -- # set -e 00:18:40.883 20:19:44 -- nvmf/common.sh@124 -- # return 0 00:18:40.883 20:19:44 -- nvmf/common.sh@477 -- # '[' -n 3184597 ']' 00:18:40.883 20:19:44 -- nvmf/common.sh@478 -- # killprocess 3184597 00:18:40.883 20:19:44 -- common/autotest_common.sh@936 -- # '[' -z 3184597 ']' 00:18:40.883 20:19:44 -- common/autotest_common.sh@940 -- # kill -0 3184597 00:18:40.883 20:19:44 -- common/autotest_common.sh@941 -- # uname 00:18:40.883 20:19:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:40.883 20:19:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3184597 00:18:40.883 20:19:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:40.883 20:19:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:40.883 20:19:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3184597' 00:18:40.883 killing process with pid 3184597 00:18:40.883 20:19:44 -- common/autotest_common.sh@955 -- # kill 3184597 00:18:40.883 20:19:44 -- common/autotest_common.sh@960 -- # wait 3184597 00:18:40.883 20:19:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:40.883 20:19:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:40.883 20:19:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:40.883 20:19:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:40.883 20:19:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:40.883 20:19:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.883 20:19:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.883 20:19:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.825 20:19:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.825 20:19:46 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:41.825 00:18:41.825 real 0m18.210s 00:18:41.825 user 0m23.872s 00:18:41.825 sys 0m5.939s 00:18:41.825 20:19:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:41.825 20:19:46 -- common/autotest_common.sh@10 -- # set +x 00:18:41.825 ************************************ 00:18:41.825 END TEST nvmf_fips 00:18:41.825 ************************************ 00:18:41.825 20:19:46 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:41.825 20:19:46 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:41.825 20:19:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:41.825 20:19:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:41.825 20:19:46 -- common/autotest_common.sh@10 -- # set +x 00:18:41.825 ************************************ 00:18:41.825 START TEST nvmf_fuzz 00:18:41.825 ************************************ 00:18:41.825 20:19:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:41.825 * Looking for test storage... 00:18:41.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:41.825 20:19:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:41.825 20:19:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:41.825 20:19:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:41.825 20:19:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:41.825 20:19:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:41.825 20:19:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:41.825 20:19:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:41.825 20:19:46 -- scripts/common.sh@335 -- # IFS=.-: 00:18:41.825 20:19:46 -- scripts/common.sh@335 -- # read -ra ver1 00:18:41.825 20:19:46 -- scripts/common.sh@336 -- # IFS=.-: 00:18:41.825 20:19:46 -- scripts/common.sh@336 -- # read -ra ver2 00:18:41.825 20:19:46 -- scripts/common.sh@337 -- # local 'op=<' 00:18:41.825 20:19:46 -- scripts/common.sh@339 -- # ver1_l=2 00:18:41.825 20:19:46 -- scripts/common.sh@340 -- # ver2_l=1 00:18:41.825 20:19:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:41.825 20:19:46 -- scripts/common.sh@343 -- # case "$op" in 00:18:41.825 20:19:46 -- scripts/common.sh@344 -- # : 1 00:18:41.825 20:19:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:41.825 20:19:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:41.825 20:19:46 -- scripts/common.sh@364 -- # decimal 1 00:18:41.825 20:19:46 -- scripts/common.sh@352 -- # local d=1 00:18:41.825 20:19:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:41.825 20:19:46 -- scripts/common.sh@354 -- # echo 1 00:18:41.825 20:19:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:41.825 20:19:46 -- scripts/common.sh@365 -- # decimal 2 00:18:41.825 20:19:46 -- scripts/common.sh@352 -- # local d=2 00:18:41.825 20:19:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:41.825 20:19:46 -- scripts/common.sh@354 -- # echo 2 00:18:41.825 20:19:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:41.825 20:19:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:41.825 20:19:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:41.825 20:19:46 -- scripts/common.sh@367 -- # return 0 00:18:41.825 20:19:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:41.825 20:19:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:41.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.825 --rc genhtml_branch_coverage=1 00:18:41.825 --rc genhtml_function_coverage=1 00:18:41.825 --rc genhtml_legend=1 00:18:41.825 --rc geninfo_all_blocks=1 00:18:41.825 --rc geninfo_unexecuted_blocks=1 00:18:41.825 00:18:41.825 ' 00:18:41.825 20:19:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:41.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.825 --rc genhtml_branch_coverage=1 00:18:41.825 --rc genhtml_function_coverage=1 00:18:41.825 --rc genhtml_legend=1 00:18:41.825 --rc geninfo_all_blocks=1 00:18:41.825 --rc geninfo_unexecuted_blocks=1 00:18:41.825 00:18:41.825 ' 00:18:41.825 20:19:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:41.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.825 --rc genhtml_branch_coverage=1 00:18:41.825 --rc genhtml_function_coverage=1 00:18:41.825 --rc genhtml_legend=1 00:18:41.825 --rc geninfo_all_blocks=1 00:18:41.825 --rc geninfo_unexecuted_blocks=1 00:18:41.825 00:18:41.825 ' 00:18:41.825 20:19:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:41.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.825 --rc genhtml_branch_coverage=1 00:18:41.825 --rc genhtml_function_coverage=1 00:18:41.825 --rc genhtml_legend=1 00:18:41.825 --rc geninfo_all_blocks=1 00:18:41.825 --rc geninfo_unexecuted_blocks=1 00:18:41.825 00:18:41.825 ' 00:18:41.825 20:19:46 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:41.825 20:19:46 -- nvmf/common.sh@7 -- # uname -s 00:18:41.825 20:19:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:41.825 20:19:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:41.825 20:19:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:41.825 20:19:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:41.825 20:19:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:41.825 20:19:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:41.825 20:19:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:41.825 20:19:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:41.825 20:19:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:41.825 20:19:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:41.825 20:19:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.825 20:19:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.825 20:19:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:41.825 20:19:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:41.825 20:19:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:41.825 20:19:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:41.825 20:19:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:41.825 20:19:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:41.825 20:19:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:41.825 20:19:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.825 20:19:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.826 20:19:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.826 20:19:46 -- paths/export.sh@5 -- # export PATH 00:18:41.826 20:19:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.826 20:19:46 -- nvmf/common.sh@46 -- # : 0 00:18:41.826 20:19:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:41.826 20:19:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:41.826 20:19:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:41.826 20:19:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:41.826 20:19:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:41.826 20:19:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:41.826 20:19:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:41.826 20:19:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:41.826 20:19:46 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:41.826 20:19:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:41.826 20:19:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:41.826 20:19:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:41.826 20:19:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:41.826 20:19:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:41.826 20:19:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.826 20:19:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.826 20:19:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.826 20:19:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:41.826 20:19:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:41.826 20:19:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:41.826 20:19:46 -- common/autotest_common.sh@10 -- # set +x 00:18:43.730 20:19:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.730 20:19:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.730 20:19:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.730 20:19:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.730 20:19:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.730 20:19:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.730 20:19:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.730 20:19:48 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.730 20:19:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.730 20:19:48 -- nvmf/common.sh@295 -- # e810=() 00:18:43.730 20:19:48 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.730 20:19:48 -- nvmf/common.sh@296 -- # x722=() 00:18:43.730 20:19:48 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.730 20:19:48 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.730 20:19:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.730 20:19:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.730 20:19:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.730 20:19:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.730 20:19:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.730 20:19:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.730 20:19:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:43.730 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:43.730 20:19:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.730 20:19:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:43.730 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:43.730 20:19:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.730 20:19:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.730 20:19:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.730 20:19:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.730 20:19:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.730 20:19:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:43.730 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:43.730 20:19:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.730 20:19:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.730 20:19:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.730 20:19:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.730 20:19:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.730 20:19:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:43.730 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:43.730 20:19:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.730 20:19:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.730 20:19:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.730 20:19:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.730 20:19:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.730 20:19:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.730 20:19:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.730 20:19:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.730 20:19:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.730 20:19:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.730 20:19:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.730 20:19:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.730 20:19:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.730 20:19:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.730 20:19:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.730 20:19:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.730 20:19:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:43.730 20:19:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:43.730 20:19:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:43.730 20:19:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:43.730 20:19:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:43.730 20:19:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:43.730 20:19:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:43.730 20:19:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:43.730 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:43.730 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:18:43.730 00:18:43.730 --- 10.0.0.2 ping statistics --- 00:18:43.730 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.730 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:18:43.730 20:19:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:43.730 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:43.730 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:18:43.730 00:18:43.730 --- 10.0.0.1 ping statistics --- 00:18:43.730 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.730 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:18:43.730 20:19:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:43.730 20:19:48 -- nvmf/common.sh@410 -- # return 0 00:18:43.730 20:19:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:43.730 20:19:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:43.730 20:19:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:43.730 20:19:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:43.989 20:19:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:43.989 20:19:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:43.989 20:19:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:43.989 20:19:48 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3188207 00:18:43.989 20:19:48 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:43.989 20:19:48 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:43.989 20:19:48 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3188207 00:18:43.989 20:19:48 -- common/autotest_common.sh@829 -- # '[' -z 3188207 ']' 00:18:43.989 20:19:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:43.989 20:19:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:43.989 20:19:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:43.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:43.989 20:19:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:43.989 20:19:48 -- common/autotest_common.sh@10 -- # set +x 00:18:44.927 20:19:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:44.927 20:19:49 -- common/autotest_common.sh@862 -- # return 0 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:44.927 20:19:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.927 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:18:44.927 20:19:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:44.927 20:19:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.927 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:18:44.927 Malloc0 00:18:44.927 20:19:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:44.927 20:19:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.927 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:18:44.927 20:19:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:44.927 20:19:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.927 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:18:44.927 20:19:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:44.927 20:19:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.927 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:18:44.927 20:19:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:44.927 20:19:49 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:17.099 Fuzzing completed. Shutting down the fuzz application 00:19:17.099 00:19:17.099 Dumping successful admin opcodes: 00:19:17.099 8, 9, 10, 24, 00:19:17.099 Dumping successful io opcodes: 00:19:17.099 0, 9, 00:19:17.099 NS: 0x200003aeff00 I/O qp, Total commands completed: 486371, total successful commands: 2799, random_seed: 1513909504 00:19:17.099 NS: 0x200003aeff00 admin qp, Total commands completed: 59008, total successful commands: 470, random_seed: 1124938368 00:19:17.099 20:20:20 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:17.099 Fuzzing completed. Shutting down the fuzz application 00:19:17.099 00:19:17.099 Dumping successful admin opcodes: 00:19:17.099 24, 00:19:17.099 Dumping successful io opcodes: 00:19:17.099 00:19:17.099 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3742338375 00:19:17.099 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3742473276 00:19:17.099 20:20:21 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:17.099 20:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.099 20:20:21 -- common/autotest_common.sh@10 -- # set +x 00:19:17.099 20:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.099 20:20:21 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:17.099 20:20:21 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:17.099 20:20:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:17.099 20:20:21 -- nvmf/common.sh@116 -- # sync 00:19:17.099 20:20:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:17.099 20:20:21 -- nvmf/common.sh@119 -- # set +e 00:19:17.099 20:20:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:17.099 20:20:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:17.099 rmmod nvme_tcp 00:19:17.099 rmmod nvme_fabrics 00:19:17.099 rmmod nvme_keyring 00:19:17.099 20:20:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:17.099 20:20:21 -- nvmf/common.sh@123 -- # set -e 00:19:17.099 20:20:21 -- nvmf/common.sh@124 -- # return 0 00:19:17.099 20:20:21 -- nvmf/common.sh@477 -- # '[' -n 3188207 ']' 00:19:17.099 20:20:21 -- nvmf/common.sh@478 -- # killprocess 3188207 00:19:17.099 20:20:21 -- common/autotest_common.sh@936 -- # '[' -z 3188207 ']' 00:19:17.099 20:20:21 -- common/autotest_common.sh@940 -- # kill -0 3188207 00:19:17.099 20:20:21 -- common/autotest_common.sh@941 -- # uname 00:19:17.099 20:20:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:17.099 20:20:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3188207 00:19:17.099 20:20:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:17.099 20:20:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:17.099 20:20:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3188207' 00:19:17.099 killing process with pid 3188207 00:19:17.099 20:20:21 -- common/autotest_common.sh@955 -- # kill 3188207 00:19:17.099 20:20:21 -- common/autotest_common.sh@960 -- # wait 3188207 00:19:17.359 20:20:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:17.359 20:20:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:17.359 20:20:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:17.359 20:20:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:17.360 20:20:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:17.360 20:20:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:17.360 20:20:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:17.360 20:20:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:19.266 20:20:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:19.266 20:20:24 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:19.266 00:19:19.266 real 0m37.744s 00:19:19.266 user 0m52.847s 00:19:19.266 sys 0m14.866s 00:19:19.266 20:20:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:19.266 20:20:24 -- common/autotest_common.sh@10 -- # set +x 00:19:19.266 ************************************ 00:19:19.266 END TEST nvmf_fuzz 00:19:19.266 ************************************ 00:19:19.266 20:20:24 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:19.266 20:20:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:19.266 20:20:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:19.266 20:20:24 -- common/autotest_common.sh@10 -- # set +x 00:19:19.525 ************************************ 00:19:19.525 START TEST nvmf_multiconnection 00:19:19.525 ************************************ 00:19:19.525 20:20:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:19.525 * Looking for test storage... 00:19:19.525 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:19.525 20:20:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:19.525 20:20:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:19.525 20:20:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:19.525 20:20:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:19.525 20:20:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:19.525 20:20:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:19.525 20:20:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:19.525 20:20:24 -- scripts/common.sh@335 -- # IFS=.-: 00:19:19.525 20:20:24 -- scripts/common.sh@335 -- # read -ra ver1 00:19:19.525 20:20:24 -- scripts/common.sh@336 -- # IFS=.-: 00:19:19.525 20:20:24 -- scripts/common.sh@336 -- # read -ra ver2 00:19:19.525 20:20:24 -- scripts/common.sh@337 -- # local 'op=<' 00:19:19.525 20:20:24 -- scripts/common.sh@339 -- # ver1_l=2 00:19:19.525 20:20:24 -- scripts/common.sh@340 -- # ver2_l=1 00:19:19.525 20:20:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:19.525 20:20:24 -- scripts/common.sh@343 -- # case "$op" in 00:19:19.525 20:20:24 -- scripts/common.sh@344 -- # : 1 00:19:19.525 20:20:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:19.525 20:20:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:19.525 20:20:24 -- scripts/common.sh@364 -- # decimal 1 00:19:19.525 20:20:24 -- scripts/common.sh@352 -- # local d=1 00:19:19.525 20:20:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:19.525 20:20:24 -- scripts/common.sh@354 -- # echo 1 00:19:19.525 20:20:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:19.525 20:20:24 -- scripts/common.sh@365 -- # decimal 2 00:19:19.525 20:20:24 -- scripts/common.sh@352 -- # local d=2 00:19:19.525 20:20:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:19.525 20:20:24 -- scripts/common.sh@354 -- # echo 2 00:19:19.525 20:20:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:19.525 20:20:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:19.525 20:20:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:19.525 20:20:24 -- scripts/common.sh@367 -- # return 0 00:19:19.525 20:20:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:19.525 20:20:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:19.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.525 --rc genhtml_branch_coverage=1 00:19:19.525 --rc genhtml_function_coverage=1 00:19:19.525 --rc genhtml_legend=1 00:19:19.525 --rc geninfo_all_blocks=1 00:19:19.525 --rc geninfo_unexecuted_blocks=1 00:19:19.525 00:19:19.525 ' 00:19:19.525 20:20:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:19.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.525 --rc genhtml_branch_coverage=1 00:19:19.525 --rc genhtml_function_coverage=1 00:19:19.525 --rc genhtml_legend=1 00:19:19.525 --rc geninfo_all_blocks=1 00:19:19.525 --rc geninfo_unexecuted_blocks=1 00:19:19.525 00:19:19.525 ' 00:19:19.525 20:20:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:19.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.525 --rc genhtml_branch_coverage=1 00:19:19.525 --rc genhtml_function_coverage=1 00:19:19.525 --rc genhtml_legend=1 00:19:19.525 --rc geninfo_all_blocks=1 00:19:19.525 --rc geninfo_unexecuted_blocks=1 00:19:19.525 00:19:19.525 ' 00:19:19.525 20:20:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:19.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.525 --rc genhtml_branch_coverage=1 00:19:19.525 --rc genhtml_function_coverage=1 00:19:19.525 --rc genhtml_legend=1 00:19:19.525 --rc geninfo_all_blocks=1 00:19:19.525 --rc geninfo_unexecuted_blocks=1 00:19:19.525 00:19:19.525 ' 00:19:19.525 20:20:24 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:19.525 20:20:24 -- nvmf/common.sh@7 -- # uname -s 00:19:19.525 20:20:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:19.525 20:20:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:19.525 20:20:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:19.525 20:20:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:19.525 20:20:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:19.525 20:20:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:19.525 20:20:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:19.525 20:20:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:19.525 20:20:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:19.525 20:20:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:19.525 20:20:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:19.525 20:20:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:19.525 20:20:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:19.525 20:20:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:19.525 20:20:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:19.525 20:20:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:19.525 20:20:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:19.525 20:20:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:19.525 20:20:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:19.525 20:20:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.525 20:20:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.525 20:20:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.525 20:20:24 -- paths/export.sh@5 -- # export PATH 00:19:19.525 20:20:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.525 20:20:24 -- nvmf/common.sh@46 -- # : 0 00:19:19.525 20:20:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:19.525 20:20:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:19.525 20:20:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:19.525 20:20:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:19.525 20:20:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:19.525 20:20:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:19.525 20:20:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:19.525 20:20:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:19.526 20:20:24 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:19.526 20:20:24 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:19.526 20:20:24 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:19.526 20:20:24 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:19.526 20:20:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:19.526 20:20:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:19.526 20:20:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:19.526 20:20:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:19.526 20:20:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:19.526 20:20:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:19.526 20:20:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:19.526 20:20:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:19.526 20:20:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:19.526 20:20:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:19.526 20:20:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:19.526 20:20:24 -- common/autotest_common.sh@10 -- # set +x 00:19:21.429 20:20:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:21.429 20:20:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:21.688 20:20:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:21.688 20:20:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:21.688 20:20:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:21.688 20:20:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:21.688 20:20:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:21.688 20:20:26 -- nvmf/common.sh@294 -- # net_devs=() 00:19:21.688 20:20:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:21.688 20:20:26 -- nvmf/common.sh@295 -- # e810=() 00:19:21.688 20:20:26 -- nvmf/common.sh@295 -- # local -ga e810 00:19:21.688 20:20:26 -- nvmf/common.sh@296 -- # x722=() 00:19:21.688 20:20:26 -- nvmf/common.sh@296 -- # local -ga x722 00:19:21.688 20:20:26 -- nvmf/common.sh@297 -- # mlx=() 00:19:21.688 20:20:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:21.688 20:20:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:21.688 20:20:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:21.688 20:20:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:21.688 20:20:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:21.688 20:20:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:21.688 20:20:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:21.688 20:20:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:21.689 20:20:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:21.689 20:20:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:21.689 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:21.689 20:20:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:21.689 20:20:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:21.689 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:21.689 20:20:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:21.689 20:20:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:21.689 20:20:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:21.689 20:20:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:21.689 20:20:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:21.689 20:20:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:21.689 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:21.689 20:20:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:21.689 20:20:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:21.689 20:20:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:21.689 20:20:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:21.689 20:20:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:21.689 20:20:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:21.689 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:21.689 20:20:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:21.689 20:20:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:21.689 20:20:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:21.689 20:20:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:21.689 20:20:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:21.689 20:20:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:21.689 20:20:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:21.689 20:20:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:21.689 20:20:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:21.689 20:20:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:21.689 20:20:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:21.689 20:20:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:21.689 20:20:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:21.689 20:20:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:21.689 20:20:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:21.689 20:20:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:21.689 20:20:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:21.689 20:20:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:21.689 20:20:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:21.689 20:20:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:21.689 20:20:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:21.689 20:20:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:21.689 20:20:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:21.689 20:20:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:21.689 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:21.689 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.285 ms 00:19:21.689 00:19:21.689 --- 10.0.0.2 ping statistics --- 00:19:21.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:21.689 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:19:21.689 20:20:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:21.689 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:21.689 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:19:21.689 00:19:21.689 --- 10.0.0.1 ping statistics --- 00:19:21.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:21.689 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:19:21.689 20:20:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:21.689 20:20:26 -- nvmf/common.sh@410 -- # return 0 00:19:21.689 20:20:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:21.689 20:20:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:21.689 20:20:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:21.689 20:20:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:21.689 20:20:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:21.689 20:20:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:21.689 20:20:26 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:21.689 20:20:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:21.689 20:20:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:21.689 20:20:26 -- common/autotest_common.sh@10 -- # set +x 00:19:21.689 20:20:26 -- nvmf/common.sh@469 -- # nvmfpid=3194090 00:19:21.689 20:20:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:21.689 20:20:26 -- nvmf/common.sh@470 -- # waitforlisten 3194090 00:19:21.689 20:20:26 -- common/autotest_common.sh@829 -- # '[' -z 3194090 ']' 00:19:21.689 20:20:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:21.689 20:20:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:21.689 20:20:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:21.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:21.689 20:20:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:21.689 20:20:26 -- common/autotest_common.sh@10 -- # set +x 00:19:21.689 [2024-11-20 20:20:26.670498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:21.689 [2024-11-20 20:20:26.670582] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:21.689 EAL: No free 2048 kB hugepages reported on node 1 00:19:21.949 [2024-11-20 20:20:26.739254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:21.949 [2024-11-20 20:20:26.856689] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:21.949 [2024-11-20 20:20:26.856833] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:21.949 [2024-11-20 20:20:26.856866] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:21.949 [2024-11-20 20:20:26.856879] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:21.949 [2024-11-20 20:20:26.856930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:21.949 [2024-11-20 20:20:26.856985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:21.949 [2024-11-20 20:20:26.856955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:21.949 [2024-11-20 20:20:26.856987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:22.887 20:20:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:22.887 20:20:27 -- common/autotest_common.sh@862 -- # return 0 00:19:22.887 20:20:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:22.887 20:20:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:22.887 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.887 20:20:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:22.887 20:20:27 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:22.887 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.887 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.887 [2024-11-20 20:20:27.686709] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:22.887 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.887 20:20:27 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:22.887 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.887 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:22.887 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.887 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.887 Malloc1 00:19:22.887 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.887 20:20:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:22.887 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.887 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.887 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.887 20:20:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:22.887 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.887 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.887 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.887 20:20:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:22.887 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.887 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.887 [2024-11-20 20:20:27.743986] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:22.887 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.888 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 Malloc2 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.888 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 Malloc3 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.888 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 Malloc4 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.888 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:22.888 Malloc5 00:19:22.888 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.888 20:20:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:22.888 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.888 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.147 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 Malloc6 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.147 20:20:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:23.147 20:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:27 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 Malloc7 00:19:23.147 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:23.147 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:23.147 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:23.147 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.147 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.147 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.147 20:20:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.147 20:20:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 Malloc8 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.148 20:20:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 Malloc9 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.148 20:20:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 Malloc10 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.148 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.148 20:20:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:23.148 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.148 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.406 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.406 20:20:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:23.407 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.407 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.407 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.407 20:20:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.407 20:20:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:23.407 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.407 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.407 Malloc11 00:19:23.407 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.407 20:20:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:23.407 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.407 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.407 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.407 20:20:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:23.407 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.407 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.407 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.407 20:20:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:23.407 20:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.407 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:19:23.407 20:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.407 20:20:28 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:23.407 20:20:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.407 20:20:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:23.977 20:20:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:23.977 20:20:28 -- common/autotest_common.sh@1187 -- # local i=0 00:19:23.977 20:20:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:23.977 20:20:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:23.977 20:20:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:25.888 20:20:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:25.888 20:20:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:25.888 20:20:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:25.888 20:20:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:25.888 20:20:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.888 20:20:30 -- common/autotest_common.sh@1197 -- # return 0 00:19:25.888 20:20:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:25.888 20:20:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:26.824 20:20:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:26.824 20:20:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:26.824 20:20:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.824 20:20:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:26.824 20:20:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.761 20:20:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:28.761 20:20:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:28.761 20:20:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:28.761 20:20:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:28.761 20:20:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.761 20:20:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:28.761 20:20:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:28.761 20:20:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:29.330 20:20:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:29.330 20:20:34 -- common/autotest_common.sh@1187 -- # local i=0 00:19:29.330 20:20:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:29.330 20:20:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:29.330 20:20:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:31.233 20:20:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:31.233 20:20:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:31.233 20:20:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:31.233 20:20:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:31.233 20:20:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:31.233 20:20:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:31.233 20:20:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.233 20:20:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:32.170 20:20:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:32.170 20:20:36 -- common/autotest_common.sh@1187 -- # local i=0 00:19:32.170 20:20:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:32.170 20:20:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:32.170 20:20:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:34.071 20:20:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:34.071 20:20:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:34.071 20:20:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:34.071 20:20:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:34.071 20:20:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:34.071 20:20:38 -- common/autotest_common.sh@1197 -- # return 0 00:19:34.071 20:20:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.071 20:20:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:34.636 20:20:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:34.636 20:20:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:34.636 20:20:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:34.636 20:20:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:34.636 20:20:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:37.171 20:20:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:37.171 20:20:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:37.171 20:20:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:37.171 20:20:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:37.171 20:20:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.171 20:20:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:37.171 20:20:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.171 20:20:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:37.738 20:20:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:37.738 20:20:42 -- common/autotest_common.sh@1187 -- # local i=0 00:19:37.738 20:20:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:37.738 20:20:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:37.738 20:20:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.640 20:20:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.640 20:20:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.640 20:20:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:39.640 20:20:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:39.640 20:20:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:39.640 20:20:44 -- common/autotest_common.sh@1197 -- # return 0 00:19:39.640 20:20:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:39.640 20:20:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:40.590 20:20:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:40.590 20:20:45 -- common/autotest_common.sh@1187 -- # local i=0 00:19:40.590 20:20:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:40.590 20:20:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:40.591 20:20:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:42.494 20:20:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:42.494 20:20:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:42.494 20:20:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:42.494 20:20:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:42.494 20:20:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:42.494 20:20:47 -- common/autotest_common.sh@1197 -- # return 0 00:19:42.494 20:20:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.494 20:20:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:43.430 20:20:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:43.430 20:20:48 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.430 20:20:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.430 20:20:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.430 20:20:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.346 20:20:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.346 20:20:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.346 20:20:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:45.346 20:20:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.346 20:20:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.346 20:20:50 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.346 20:20:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.347 20:20:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:46.284 20:20:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:46.284 20:20:51 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.284 20:20:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.284 20:20:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.284 20:20:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:48.191 20:20:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:48.191 20:20:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:48.191 20:20:53 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:48.191 20:20:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:48.191 20:20:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.191 20:20:53 -- common/autotest_common.sh@1197 -- # return 0 00:19:48.191 20:20:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.191 20:20:53 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:49.130 20:20:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:49.130 20:20:53 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.130 20:20:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.130 20:20:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:49.130 20:20:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.033 20:20:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.033 20:20:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.033 20:20:55 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:51.033 20:20:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.033 20:20:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.033 20:20:55 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.033 20:20:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.033 20:20:55 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:51.968 20:20:56 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:51.968 20:20:56 -- common/autotest_common.sh@1187 -- # local i=0 00:19:51.968 20:20:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:51.968 20:20:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:51.968 20:20:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.878 20:20:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.878 20:20:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.878 20:20:58 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:53.878 20:20:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.878 20:20:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.878 20:20:58 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.878 20:20:58 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:53.878 [global] 00:19:53.878 thread=1 00:19:53.878 invalidate=1 00:19:53.878 rw=read 00:19:53.878 time_based=1 00:19:53.878 runtime=10 00:19:53.878 ioengine=libaio 00:19:53.878 direct=1 00:19:53.878 bs=262144 00:19:53.878 iodepth=64 00:19:53.878 norandommap=1 00:19:53.878 numjobs=1 00:19:53.878 00:19:53.878 [job0] 00:19:53.878 filename=/dev/nvme0n1 00:19:53.878 [job1] 00:19:53.878 filename=/dev/nvme10n1 00:19:53.878 [job2] 00:19:53.878 filename=/dev/nvme1n1 00:19:53.878 [job3] 00:19:53.878 filename=/dev/nvme2n1 00:19:53.878 [job4] 00:19:53.878 filename=/dev/nvme3n1 00:19:53.878 [job5] 00:19:53.878 filename=/dev/nvme4n1 00:19:53.878 [job6] 00:19:53.878 filename=/dev/nvme5n1 00:19:53.878 [job7] 00:19:53.878 filename=/dev/nvme6n1 00:19:53.878 [job8] 00:19:53.878 filename=/dev/nvme7n1 00:19:53.878 [job9] 00:19:53.878 filename=/dev/nvme8n1 00:19:53.878 [job10] 00:19:53.878 filename=/dev/nvme9n1 00:19:54.137 Could not set queue depth (nvme0n1) 00:19:54.137 Could not set queue depth (nvme10n1) 00:19:54.137 Could not set queue depth (nvme1n1) 00:19:54.137 Could not set queue depth (nvme2n1) 00:19:54.137 Could not set queue depth (nvme3n1) 00:19:54.137 Could not set queue depth (nvme4n1) 00:19:54.137 Could not set queue depth (nvme5n1) 00:19:54.137 Could not set queue depth (nvme6n1) 00:19:54.137 Could not set queue depth (nvme7n1) 00:19:54.137 Could not set queue depth (nvme8n1) 00:19:54.137 Could not set queue depth (nvme9n1) 00:19:54.137 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.137 fio-3.35 00:19:54.137 Starting 11 threads 00:20:06.347 00:20:06.347 job0: (groupid=0, jobs=1): err= 0: pid=3198606: Wed Nov 20 20:21:09 2024 00:20:06.347 read: IOPS=598, BW=150MiB/s (157MB/s)(1508MiB/10076msec) 00:20:06.347 slat (usec): min=10, max=146484, avg=1337.05, stdev=5395.39 00:20:06.347 clat (usec): min=1722, max=346086, avg=105480.54, stdev=55217.84 00:20:06.347 lat (usec): min=1745, max=366434, avg=106817.60, stdev=56070.33 00:20:06.347 clat percentiles (msec): 00:20:06.347 | 1.00th=[ 8], 5.00th=[ 25], 10.00th=[ 35], 20.00th=[ 50], 00:20:06.347 | 30.00th=[ 68], 40.00th=[ 92], 50.00th=[ 110], 60.00th=[ 127], 00:20:06.347 | 70.00th=[ 138], 80.00th=[ 150], 90.00th=[ 167], 95.00th=[ 182], 00:20:06.347 | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 342], 00:20:06.347 | 99.99th=[ 347] 00:20:06.347 bw ( KiB/s): min=63488, max=416958, per=7.79%, avg=152733.95, stdev=78901.23, samples=20 00:20:06.347 iops : min= 248, max= 1628, avg=596.50, stdev=308.08, samples=20 00:20:06.347 lat (msec) : 2=0.02%, 4=0.17%, 10=1.29%, 20=1.81%, 50=17.36% 00:20:06.347 lat (msec) : 100=24.37%, 250=53.71%, 500=1.28% 00:20:06.347 cpu : usr=0.27%, sys=1.90%, ctx=1122, majf=0, minf=4097 00:20:06.347 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:06.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.347 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.347 issued rwts: total=6032,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.347 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.347 job1: (groupid=0, jobs=1): err= 0: pid=3198607: Wed Nov 20 20:21:09 2024 00:20:06.347 read: IOPS=777, BW=194MiB/s (204MB/s)(1966MiB/10115msec) 00:20:06.347 slat (usec): min=9, max=107125, avg=993.41, stdev=4318.36 00:20:06.347 clat (msec): min=2, max=328, avg=81.25, stdev=56.37 00:20:06.347 lat (msec): min=2, max=401, avg=82.25, stdev=57.02 00:20:06.347 clat percentiles (msec): 00:20:06.347 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 26], 20.00th=[ 29], 00:20:06.347 | 30.00th=[ 34], 40.00th=[ 49], 50.00th=[ 73], 60.00th=[ 92], 00:20:06.347 | 70.00th=[ 110], 80.00th=[ 134], 90.00th=[ 159], 95.00th=[ 174], 00:20:06.347 | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 326], 99.95th=[ 326], 00:20:06.347 | 99.99th=[ 330] 00:20:06.347 bw ( KiB/s): min=94720, max=544256, per=10.19%, avg=199651.35, stdev=119725.80, samples=20 00:20:06.347 iops : min= 370, max= 2126, avg=779.85, stdev=467.66, samples=20 00:20:06.347 lat (msec) : 4=0.66%, 10=2.63%, 20=2.82%, 50=34.61%, 100=24.07% 00:20:06.347 lat (msec) : 250=33.88%, 500=1.32% 00:20:06.347 cpu : usr=0.39%, sys=2.25%, ctx=1524, majf=0, minf=4097 00:20:06.347 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:06.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.347 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.347 issued rwts: total=7865,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.347 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.347 job2: (groupid=0, jobs=1): err= 0: pid=3198608: Wed Nov 20 20:21:09 2024 00:20:06.347 read: IOPS=562, BW=141MiB/s (147MB/s)(1410MiB/10032msec) 00:20:06.347 slat (usec): min=10, max=160953, avg=1226.67, stdev=5651.30 00:20:06.347 clat (msec): min=2, max=422, avg=112.55, stdev=48.97 00:20:06.347 lat (msec): min=2, max=422, avg=113.78, stdev=49.63 00:20:06.347 clat percentiles (msec): 00:20:06.347 | 1.00th=[ 12], 5.00th=[ 25], 10.00th=[ 50], 20.00th=[ 77], 00:20:06.347 | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 115], 60.00th=[ 126], 00:20:06.347 | 70.00th=[ 138], 80.00th=[ 150], 90.00th=[ 163], 95.00th=[ 176], 00:20:06.347 | 99.00th=[ 296], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 376], 00:20:06.347 | 99.99th=[ 422] 00:20:06.347 bw ( KiB/s): min=75624, max=290816, per=7.28%, avg=142737.00, stdev=47945.70, samples=20 00:20:06.347 iops : min= 295, max= 1136, avg=557.50, stdev=187.34, samples=20 00:20:06.347 lat (msec) : 4=0.30%, 10=0.62%, 20=1.97%, 50=7.13%, 100=29.70% 00:20:06.347 lat (msec) : 250=58.79%, 500=1.49% 00:20:06.347 cpu : usr=0.38%, sys=1.57%, ctx=1139, majf=0, minf=4097 00:20:06.347 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:06.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.347 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.347 issued rwts: total=5639,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.347 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.347 job3: (groupid=0, jobs=1): err= 0: pid=3198609: Wed Nov 20 20:21:09 2024 00:20:06.347 read: IOPS=641, BW=160MiB/s (168MB/s)(1623MiB/10119msec) 00:20:06.347 slat (usec): min=10, max=131799, avg=1105.82, stdev=4976.23 00:20:06.347 clat (usec): min=1283, max=369872, avg=98547.23, stdev=57497.06 00:20:06.347 lat (usec): min=1302, max=369927, avg=99653.05, stdev=58282.78 00:20:06.347 clat percentiles (msec): 00:20:06.347 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 36], 00:20:06.347 | 30.00th=[ 56], 40.00th=[ 85], 50.00th=[ 100], 60.00th=[ 117], 00:20:06.347 | 70.00th=[ 134], 80.00th=[ 146], 90.00th=[ 165], 95.00th=[ 182], 00:20:06.347 | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 326], 99.95th=[ 372], 00:20:06.347 | 99.99th=[ 372] 00:20:06.347 bw ( KiB/s): min=62464, max=324982, per=8.39%, avg=164531.40, stdev=70176.60, samples=20 00:20:06.347 iops : min= 244, max= 1269, avg=642.55, stdev=274.14, samples=20 00:20:06.347 lat (msec) : 2=0.03%, 4=0.25%, 10=2.17%, 20=3.59%, 50=22.62% 00:20:06.347 lat (msec) : 100=22.04%, 250=48.08%, 500=1.22% 00:20:06.347 cpu : usr=0.43%, sys=1.79%, ctx=1305, majf=0, minf=4097 00:20:06.347 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:06.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.347 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.347 issued rwts: total=6493,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.347 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.347 job4: (groupid=0, jobs=1): err= 0: pid=3198610: Wed Nov 20 20:21:09 2024 00:20:06.347 read: IOPS=597, BW=149MiB/s (157MB/s)(1498MiB/10028msec) 00:20:06.347 slat (usec): min=13, max=57826, avg=1443.76, stdev=4537.78 00:20:06.347 clat (msec): min=4, max=228, avg=105.61, stdev=37.65 00:20:06.347 lat (msec): min=4, max=229, avg=107.06, stdev=38.33 00:20:06.347 clat percentiles (msec): 00:20:06.347 | 1.00th=[ 21], 5.00th=[ 41], 10.00th=[ 58], 20.00th=[ 74], 00:20:06.347 | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 105], 60.00th=[ 116], 00:20:06.348 | 70.00th=[ 130], 80.00th=[ 142], 90.00th=[ 155], 95.00th=[ 165], 00:20:06.348 | 99.00th=[ 184], 99.50th=[ 190], 99.90th=[ 199], 99.95th=[ 201], 00:20:06.348 | 99.99th=[ 230] 00:20:06.348 bw ( KiB/s): min=94720, max=246272, per=7.74%, avg=151691.40, stdev=42789.91, samples=20 00:20:06.348 iops : min= 370, max= 962, avg=592.50, stdev=167.15, samples=20 00:20:06.348 lat (msec) : 10=0.17%, 20=0.78%, 50=6.49%, 100=37.86%, 250=54.69% 00:20:06.348 cpu : usr=0.40%, sys=1.93%, ctx=1193, majf=0, minf=4097 00:20:06.348 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:06.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.348 issued rwts: total=5990,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.348 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.348 job5: (groupid=0, jobs=1): err= 0: pid=3198611: Wed Nov 20 20:21:09 2024 00:20:06.348 read: IOPS=769, BW=192MiB/s (202MB/s)(1945MiB/10114msec) 00:20:06.348 slat (usec): min=14, max=132619, avg=1029.59, stdev=5128.03 00:20:06.348 clat (msec): min=3, max=329, avg=82.12, stdev=59.60 00:20:06.348 lat (msec): min=3, max=374, avg=83.15, stdev=60.44 00:20:06.348 clat percentiles (msec): 00:20:06.348 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 30], 00:20:06.348 | 30.00th=[ 34], 40.00th=[ 51], 50.00th=[ 63], 60.00th=[ 81], 00:20:06.348 | 70.00th=[ 126], 80.00th=[ 144], 90.00th=[ 163], 95.00th=[ 180], 00:20:06.348 | 99.00th=[ 243], 99.50th=[ 266], 99.90th=[ 309], 99.95th=[ 317], 00:20:06.348 | 99.99th=[ 330] 00:20:06.348 bw ( KiB/s): min=101376, max=427520, per=10.07%, avg=197412.45, stdev=93602.42, samples=20 00:20:06.348 iops : min= 396, max= 1670, avg=771.05, stdev=365.55, samples=20 00:20:06.348 lat (msec) : 4=0.09%, 10=2.38%, 20=8.79%, 50=28.54%, 100=25.87% 00:20:06.348 lat (msec) : 250=33.54%, 500=0.78% 00:20:06.348 cpu : usr=0.40%, sys=2.55%, ctx=1485, majf=0, minf=3721 00:20:06.348 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:06.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.348 issued rwts: total=7778,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.348 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.348 job6: (groupid=0, jobs=1): err= 0: pid=3198612: Wed Nov 20 20:21:09 2024 00:20:06.348 read: IOPS=765, BW=191MiB/s (201MB/s)(1928MiB/10077msec) 00:20:06.348 slat (usec): min=9, max=156878, avg=963.76, stdev=4180.99 00:20:06.348 clat (usec): min=937, max=317135, avg=82602.40, stdev=44333.16 00:20:06.348 lat (usec): min=973, max=317196, avg=83566.16, stdev=44882.05 00:20:06.348 clat percentiles (msec): 00:20:06.348 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 29], 20.00th=[ 44], 00:20:06.348 | 30.00th=[ 54], 40.00th=[ 66], 50.00th=[ 78], 60.00th=[ 90], 00:20:06.348 | 70.00th=[ 108], 80.00th=[ 126], 90.00th=[ 146], 95.00th=[ 159], 00:20:06.348 | 99.00th=[ 188], 99.50th=[ 197], 99.90th=[ 226], 99.95th=[ 228], 00:20:06.348 | 99.99th=[ 317] 00:20:06.348 bw ( KiB/s): min=113664, max=392192, per=9.99%, avg=195743.05, stdev=72776.20, samples=20 00:20:06.348 iops : min= 444, max= 1532, avg=764.50, stdev=284.36, samples=20 00:20:06.348 lat (usec) : 1000=0.01% 00:20:06.348 lat (msec) : 4=0.19%, 10=2.71%, 20=4.40%, 50=19.45%, 100=39.67% 00:20:06.348 lat (msec) : 250=33.54%, 500=0.03% 00:20:06.348 cpu : usr=0.37%, sys=2.39%, ctx=1521, majf=0, minf=4097 00:20:06.348 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:06.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.348 issued rwts: total=7711,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.348 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.348 job7: (groupid=0, jobs=1): err= 0: pid=3198613: Wed Nov 20 20:21:09 2024 00:20:06.348 read: IOPS=1136, BW=284MiB/s (298MB/s)(2863MiB/10076msec) 00:20:06.348 slat (usec): min=9, max=173855, avg=641.47, stdev=3194.00 00:20:06.348 clat (usec): min=1413, max=337864, avg=55618.54, stdev=44542.91 00:20:06.348 lat (usec): min=1435, max=412350, avg=56260.00, stdev=44969.52 00:20:06.348 clat percentiles (msec): 00:20:06.348 | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 21], 20.00th=[ 30], 00:20:06.348 | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 34], 60.00th=[ 41], 00:20:06.348 | 70.00th=[ 64], 80.00th=[ 88], 90.00th=[ 123], 95.00th=[ 146], 00:20:06.348 | 99.00th=[ 197], 99.50th=[ 266], 99.90th=[ 330], 99.95th=[ 330], 00:20:06.348 | 99.99th=[ 338] 00:20:06.348 bw ( KiB/s): min=95232, max=510464, per=14.87%, avg=291479.95, stdev=142196.81, samples=20 00:20:06.348 iops : min= 372, max= 1994, avg=1138.55, stdev=555.48, samples=20 00:20:06.348 lat (msec) : 2=0.03%, 4=0.38%, 10=5.33%, 20=4.02%, 50=53.32% 00:20:06.348 lat (msec) : 100=21.34%, 250=15.03%, 500=0.56% 00:20:06.348 cpu : usr=0.65%, sys=3.22%, ctx=2249, majf=0, minf=4097 00:20:06.348 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:20:06.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.348 issued rwts: total=11453,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.348 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.348 job8: (groupid=0, jobs=1): err= 0: pid=3198614: Wed Nov 20 20:21:09 2024 00:20:06.348 read: IOPS=662, BW=166MiB/s (174MB/s)(1674MiB/10115msec) 00:20:06.348 slat (usec): min=9, max=130683, avg=939.98, stdev=5645.61 00:20:06.348 clat (usec): min=718, max=401384, avg=95657.30, stdev=61113.51 00:20:06.348 lat (usec): min=748, max=401419, avg=96597.28, stdev=61963.95 00:20:06.348 clat percentiles (msec): 00:20:06.348 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 18], 20.00th=[ 39], 00:20:06.348 | 30.00th=[ 55], 40.00th=[ 72], 50.00th=[ 91], 60.00th=[ 114], 00:20:06.348 | 70.00th=[ 130], 80.00th=[ 144], 90.00th=[ 171], 95.00th=[ 201], 00:20:06.348 | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 355], 00:20:06.348 | 99.99th=[ 401] 00:20:06.348 bw ( KiB/s): min=62464, max=241664, per=8.66%, avg=169808.25, stdev=56893.64, samples=20 00:20:06.348 iops : min= 244, max= 944, avg=663.20, stdev=222.36, samples=20 00:20:06.348 lat (usec) : 750=0.01%, 1000=0.03% 00:20:06.348 lat (msec) : 2=0.94%, 4=1.60%, 10=3.87%, 20=4.58%, 50=16.25% 00:20:06.348 lat (msec) : 100=26.56%, 250=44.47%, 500=1.69% 00:20:06.348 cpu : usr=0.35%, sys=1.76%, ctx=1597, majf=0, minf=4097 00:20:06.348 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:06.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.348 issued rwts: total=6697,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.348 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.348 job9: (groupid=0, jobs=1): err= 0: pid=3198615: Wed Nov 20 20:21:09 2024 00:20:06.348 read: IOPS=595, BW=149MiB/s (156MB/s)(1501MiB/10076msec) 00:20:06.348 slat (usec): min=13, max=231720, avg=1350.50, stdev=6439.37 00:20:06.348 clat (msec): min=3, max=530, avg=106.00, stdev=58.58 00:20:06.348 lat (msec): min=3, max=530, avg=107.35, stdev=59.53 00:20:06.348 clat percentiles (msec): 00:20:06.348 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 31], 20.00th=[ 54], 00:20:06.348 | 30.00th=[ 68], 40.00th=[ 88], 50.00th=[ 107], 60.00th=[ 125], 00:20:06.348 | 70.00th=[ 140], 80.00th=[ 155], 90.00th=[ 174], 95.00th=[ 192], 00:20:06.348 | 99.00th=[ 275], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], 00:20:06.348 | 99.99th=[ 531] 00:20:06.348 bw ( KiB/s): min=63872, max=303104, per=7.76%, avg=152068.70, stdev=59770.80, samples=20 00:20:06.348 iops : min= 249, max= 1184, avg=593.90, stdev=233.58, samples=20 00:20:06.348 lat (msec) : 4=0.43%, 10=1.62%, 20=4.55%, 50=11.36%, 100=28.35% 00:20:06.348 lat (msec) : 250=51.96%, 500=1.70%, 750=0.03% 00:20:06.348 cpu : usr=0.34%, sys=1.87%, ctx=1227, majf=0, minf=4097 00:20:06.348 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:06.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.348 issued rwts: total=6003,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.348 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.348 job10: (groupid=0, jobs=1): err= 0: pid=3198616: Wed Nov 20 20:21:09 2024 00:20:06.348 read: IOPS=575, BW=144MiB/s (151MB/s)(1456MiB/10113msec) 00:20:06.348 slat (usec): min=9, max=85163, avg=1384.96, stdev=5162.50 00:20:06.348 clat (usec): min=1976, max=348221, avg=109693.46, stdev=57649.79 00:20:06.348 lat (msec): min=2, max=355, avg=111.08, stdev=58.56 00:20:06.348 clat percentiles (msec): 00:20:06.348 | 1.00th=[ 11], 5.00th=[ 18], 10.00th=[ 30], 20.00th=[ 59], 00:20:06.348 | 30.00th=[ 74], 40.00th=[ 96], 50.00th=[ 114], 60.00th=[ 130], 00:20:06.348 | 70.00th=[ 142], 80.00th=[ 153], 90.00th=[ 171], 95.00th=[ 199], 00:20:06.348 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 326], 99.95th=[ 351], 00:20:06.348 | 99.99th=[ 351] 00:20:06.348 bw ( KiB/s): min=64000, max=246784, per=7.52%, avg=147362.05, stdev=56112.16, samples=20 00:20:06.349 iops : min= 250, max= 964, avg=575.55, stdev=219.22, samples=20 00:20:06.349 lat (msec) : 2=0.02%, 4=0.02%, 10=1.06%, 20=4.96%, 50=10.29% 00:20:06.349 lat (msec) : 100=26.16%, 250=55.34%, 500=2.15% 00:20:06.349 cpu : usr=0.26%, sys=1.80%, ctx=1163, majf=0, minf=4098 00:20:06.349 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:06.349 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.349 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.349 issued rwts: total=5822,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.349 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.349 00:20:06.349 Run status group 0 (all jobs): 00:20:06.349 READ: bw=1914MiB/s (2007MB/s), 141MiB/s-284MiB/s (147MB/s-298MB/s), io=18.9GiB (20.3GB), run=10028-10119msec 00:20:06.349 00:20:06.349 Disk stats (read/write): 00:20:06.349 nvme0n1: ios=11897/0, merge=0/0, ticks=1233842/0, in_queue=1233842, util=97.39% 00:20:06.349 nvme10n1: ios=15572/0, merge=0/0, ticks=1233436/0, in_queue=1233436, util=97.57% 00:20:06.349 nvme1n1: ios=10930/0, merge=0/0, ticks=1242573/0, in_queue=1242573, util=97.83% 00:20:06.349 nvme2n1: ios=12836/0, merge=0/0, ticks=1238323/0, in_queue=1238323, util=97.95% 00:20:06.349 nvme3n1: ios=11686/0, merge=0/0, ticks=1235706/0, in_queue=1235706, util=98.03% 00:20:06.349 nvme4n1: ios=15398/0, merge=0/0, ticks=1233240/0, in_queue=1233240, util=98.34% 00:20:06.349 nvme5n1: ios=15232/0, merge=0/0, ticks=1237278/0, in_queue=1237278, util=98.48% 00:20:06.349 nvme6n1: ios=22697/0, merge=0/0, ticks=1242251/0, in_queue=1242251, util=98.57% 00:20:06.349 nvme7n1: ios=13252/0, merge=0/0, ticks=1240607/0, in_queue=1240607, util=98.93% 00:20:06.349 nvme8n1: ios=11869/0, merge=0/0, ticks=1237676/0, in_queue=1237676, util=99.08% 00:20:06.349 nvme9n1: ios=11519/0, merge=0/0, ticks=1233936/0, in_queue=1233936, util=99.23% 00:20:06.349 20:21:09 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:06.349 [global] 00:20:06.349 thread=1 00:20:06.349 invalidate=1 00:20:06.349 rw=randwrite 00:20:06.349 time_based=1 00:20:06.349 runtime=10 00:20:06.349 ioengine=libaio 00:20:06.349 direct=1 00:20:06.349 bs=262144 00:20:06.349 iodepth=64 00:20:06.349 norandommap=1 00:20:06.349 numjobs=1 00:20:06.349 00:20:06.349 [job0] 00:20:06.349 filename=/dev/nvme0n1 00:20:06.349 [job1] 00:20:06.349 filename=/dev/nvme10n1 00:20:06.349 [job2] 00:20:06.349 filename=/dev/nvme1n1 00:20:06.349 [job3] 00:20:06.349 filename=/dev/nvme2n1 00:20:06.349 [job4] 00:20:06.349 filename=/dev/nvme3n1 00:20:06.349 [job5] 00:20:06.349 filename=/dev/nvme4n1 00:20:06.349 [job6] 00:20:06.349 filename=/dev/nvme5n1 00:20:06.349 [job7] 00:20:06.349 filename=/dev/nvme6n1 00:20:06.349 [job8] 00:20:06.349 filename=/dev/nvme7n1 00:20:06.349 [job9] 00:20:06.349 filename=/dev/nvme8n1 00:20:06.349 [job10] 00:20:06.349 filename=/dev/nvme9n1 00:20:06.349 Could not set queue depth (nvme0n1) 00:20:06.349 Could not set queue depth (nvme10n1) 00:20:06.349 Could not set queue depth (nvme1n1) 00:20:06.349 Could not set queue depth (nvme2n1) 00:20:06.349 Could not set queue depth (nvme3n1) 00:20:06.349 Could not set queue depth (nvme4n1) 00:20:06.349 Could not set queue depth (nvme5n1) 00:20:06.349 Could not set queue depth (nvme6n1) 00:20:06.349 Could not set queue depth (nvme7n1) 00:20:06.349 Could not set queue depth (nvme8n1) 00:20:06.349 Could not set queue depth (nvme9n1) 00:20:06.349 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.349 fio-3.35 00:20:06.349 Starting 11 threads 00:20:16.336 00:20:16.336 job0: (groupid=0, jobs=1): err= 0: pid=3200274: Wed Nov 20 20:21:20 2024 00:20:16.336 write: IOPS=609, BW=152MiB/s (160MB/s)(1548MiB/10161msec); 0 zone resets 00:20:16.336 slat (usec): min=16, max=35466, avg=1397.15, stdev=3290.00 00:20:16.336 clat (usec): min=726, max=324281, avg=103607.09, stdev=63926.07 00:20:16.336 lat (usec): min=763, max=324341, avg=105004.24, stdev=64804.03 00:20:16.336 clat percentiles (msec): 00:20:16.336 | 1.00th=[ 4], 5.00th=[ 15], 10.00th=[ 26], 20.00th=[ 52], 00:20:16.336 | 30.00th=[ 68], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 108], 00:20:16.336 | 70.00th=[ 125], 80.00th=[ 150], 90.00th=[ 205], 95.00th=[ 224], 00:20:16.336 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 284], 00:20:16.336 | 99.99th=[ 326] 00:20:16.336 bw ( KiB/s): min=71536, max=312832, per=12.24%, avg=156864.55, stdev=72632.12, samples=20 00:20:16.336 iops : min= 279, max= 1222, avg=612.70, stdev=283.72, samples=20 00:20:16.336 lat (usec) : 750=0.02%, 1000=0.08% 00:20:16.336 lat (msec) : 2=0.36%, 4=0.63%, 10=2.23%, 20=4.14%, 50=10.19% 00:20:16.336 lat (msec) : 100=37.72%, 250=41.65%, 500=2.99% 00:20:16.336 cpu : usr=1.99%, sys=2.01%, ctx=2614, majf=0, minf=2 00:20:16.336 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:16.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.336 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.336 issued rwts: total=0,6190,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.336 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.336 job1: (groupid=0, jobs=1): err= 0: pid=3200286: Wed Nov 20 20:21:20 2024 00:20:16.336 write: IOPS=422, BW=106MiB/s (111MB/s)(1081MiB/10226msec); 0 zone resets 00:20:16.336 slat (usec): min=17, max=152089, avg=1426.48, stdev=5232.50 00:20:16.336 clat (usec): min=952, max=510642, avg=149841.50, stdev=102029.03 00:20:16.336 lat (usec): min=983, max=510671, avg=151267.98, stdev=103128.21 00:20:16.336 clat percentiles (msec): 00:20:16.336 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 22], 20.00th=[ 42], 00:20:16.336 | 30.00th=[ 81], 40.00th=[ 122], 50.00th=[ 140], 60.00th=[ 159], 00:20:16.336 | 70.00th=[ 197], 80.00th=[ 245], 90.00th=[ 288], 95.00th=[ 330], 00:20:16.336 | 99.00th=[ 409], 99.50th=[ 435], 99.90th=[ 493], 99.95th=[ 493], 00:20:16.336 | 99.99th=[ 510] 00:20:16.336 bw ( KiB/s): min=55296, max=198656, per=8.51%, avg=109058.00, stdev=43848.54, samples=20 00:20:16.336 iops : min= 216, max= 776, avg=425.95, stdev=171.32, samples=20 00:20:16.336 lat (usec) : 1000=0.02% 00:20:16.336 lat (msec) : 2=0.49%, 4=0.74%, 10=1.57%, 20=6.34%, 50=13.34% 00:20:16.336 lat (msec) : 100=12.88%, 250=46.67%, 500=17.90%, 750=0.05% 00:20:16.336 cpu : usr=1.31%, sys=1.47%, ctx=2823, majf=0, minf=1 00:20:16.336 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:20:16.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.336 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.336 issued rwts: total=0,4324,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.336 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.336 job2: (groupid=0, jobs=1): err= 0: pid=3200287: Wed Nov 20 20:21:20 2024 00:20:16.336 write: IOPS=366, BW=91.7MiB/s (96.1MB/s)(929MiB/10131msec); 0 zone resets 00:20:16.336 slat (usec): min=22, max=80099, avg=2643.71, stdev=5098.57 00:20:16.336 clat (msec): min=23, max=380, avg=171.81, stdev=48.85 00:20:16.336 lat (msec): min=23, max=380, avg=174.45, stdev=49.29 00:20:16.336 clat percentiles (msec): 00:20:16.336 | 1.00th=[ 101], 5.00th=[ 114], 10.00th=[ 120], 20.00th=[ 127], 00:20:16.336 | 30.00th=[ 140], 40.00th=[ 148], 50.00th=[ 159], 60.00th=[ 174], 00:20:16.336 | 70.00th=[ 201], 80.00th=[ 218], 90.00th=[ 243], 95.00th=[ 262], 00:20:16.336 | 99.00th=[ 296], 99.50th=[ 305], 99.90th=[ 363], 99.95th=[ 380], 00:20:16.336 | 99.99th=[ 380] 00:20:16.336 bw ( KiB/s): min=57344, max=139264, per=7.29%, avg=93478.90, stdev=23099.47, samples=20 00:20:16.336 iops : min= 224, max= 544, avg=365.15, stdev=90.23, samples=20 00:20:16.336 lat (msec) : 50=0.43%, 100=0.57%, 250=91.52%, 500=7.48% 00:20:16.336 cpu : usr=1.12%, sys=1.23%, ctx=956, majf=0, minf=1 00:20:16.336 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:16.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.336 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.336 issued rwts: total=0,3715,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.336 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.336 job3: (groupid=0, jobs=1): err= 0: pid=3200288: Wed Nov 20 20:21:20 2024 00:20:16.336 write: IOPS=357, BW=89.4MiB/s (93.7MB/s)(908MiB/10161msec); 0 zone resets 00:20:16.336 slat (usec): min=21, max=106085, avg=2298.11, stdev=5921.05 00:20:16.336 clat (usec): min=1654, max=435939, avg=176499.89, stdev=89254.43 00:20:16.336 lat (usec): min=1712, max=436011, avg=178798.01, stdev=90326.67 00:20:16.336 clat percentiles (msec): 00:20:16.336 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 48], 20.00th=[ 134], 00:20:16.336 | 30.00th=[ 146], 40.00th=[ 155], 50.00th=[ 167], 60.00th=[ 184], 00:20:16.336 | 70.00th=[ 199], 80.00th=[ 234], 90.00th=[ 313], 95.00th=[ 359], 00:20:16.336 | 99.00th=[ 384], 99.50th=[ 397], 99.90th=[ 422], 99.95th=[ 435], 00:20:16.336 | 99.99th=[ 435] 00:20:16.336 bw ( KiB/s): min=45568, max=136942, per=7.13%, avg=91385.70, stdev=23157.43, samples=20 00:20:16.336 iops : min= 178, max= 534, avg=356.90, stdev=90.39, samples=20 00:20:16.336 lat (msec) : 2=0.08%, 4=1.82%, 10=0.96%, 20=3.72%, 50=3.91% 00:20:16.336 lat (msec) : 100=5.17%, 250=66.78%, 500=17.56% 00:20:16.336 cpu : usr=1.06%, sys=1.15%, ctx=1587, majf=0, minf=1 00:20:16.336 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:16.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.336 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.336 issued rwts: total=0,3633,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.336 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.336 job4: (groupid=0, jobs=1): err= 0: pid=3200289: Wed Nov 20 20:21:20 2024 00:20:16.336 write: IOPS=599, BW=150MiB/s (157MB/s)(1531MiB/10223msec); 0 zone resets 00:20:16.336 slat (usec): min=14, max=255439, avg=1405.60, stdev=6034.69 00:20:16.336 clat (usec): min=774, max=514476, avg=105274.73, stdev=76977.91 00:20:16.336 lat (usec): min=834, max=514509, avg=106680.33, stdev=77824.17 00:20:16.336 clat percentiles (msec): 00:20:16.336 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 28], 20.00th=[ 41], 00:20:16.336 | 30.00th=[ 64], 40.00th=[ 79], 50.00th=[ 87], 60.00th=[ 105], 00:20:16.336 | 70.00th=[ 117], 80.00th=[ 150], 90.00th=[ 224], 95.00th=[ 268], 00:20:16.336 | 99.00th=[ 388], 99.50th=[ 439], 99.90th=[ 481], 99.95th=[ 498], 00:20:16.336 | 99.99th=[ 514] 00:20:16.336 bw ( KiB/s): min=55808, max=374784, per=12.11%, avg=155195.50, stdev=74285.74, samples=20 00:20:16.336 iops : min= 218, max= 1464, avg=606.20, stdev=290.19, samples=20 00:20:16.336 lat (usec) : 1000=0.11% 00:20:16.336 lat (msec) : 2=0.03%, 4=0.44%, 10=2.22%, 20=4.60%, 50=19.44% 00:20:16.336 lat (msec) : 100=30.02%, 250=36.11%, 500=6.97%, 750=0.03% 00:20:16.336 cpu : usr=1.87%, sys=2.08%, ctx=2301, majf=0, minf=1 00:20:16.336 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:16.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.336 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.336 issued rwts: total=0,6125,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.336 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.336 job5: (groupid=0, jobs=1): err= 0: pid=3200290: Wed Nov 20 20:21:20 2024 00:20:16.336 write: IOPS=356, BW=89.2MiB/s (93.6MB/s)(912MiB/10221msec); 0 zone resets 00:20:16.336 slat (usec): min=18, max=96360, avg=2130.59, stdev=5894.57 00:20:16.336 clat (usec): min=1559, max=535943, avg=177082.78, stdev=100486.08 00:20:16.336 lat (usec): min=1596, max=535968, avg=179213.36, stdev=101973.63 00:20:16.336 clat percentiles (msec): 00:20:16.336 | 1.00th=[ 10], 5.00th=[ 24], 10.00th=[ 43], 20.00th=[ 72], 00:20:16.336 | 30.00th=[ 111], 40.00th=[ 148], 50.00th=[ 182], 60.00th=[ 209], 00:20:16.336 | 70.00th=[ 236], 80.00th=[ 264], 90.00th=[ 313], 95.00th=[ 342], 00:20:16.336 | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 523], 99.95th=[ 535], 00:20:16.336 | 99.99th=[ 535] 00:20:16.336 bw ( KiB/s): min=45056, max=253952, per=7.16%, avg=91775.90, stdev=52947.57, samples=20 00:20:16.337 iops : min= 176, max= 992, avg=358.45, stdev=206.84, samples=20 00:20:16.337 lat (msec) : 2=0.03%, 4=0.36%, 10=0.77%, 20=2.44%, 50=8.28% 00:20:16.337 lat (msec) : 100=16.42%, 250=46.63%, 500=24.81%, 750=0.27% 00:20:16.337 cpu : usr=1.02%, sys=1.35%, ctx=1843, majf=0, minf=1 00:20:16.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:16.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.337 issued rwts: total=0,3648,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.337 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.337 job6: (groupid=0, jobs=1): err= 0: pid=3200291: Wed Nov 20 20:21:20 2024 00:20:16.337 write: IOPS=443, BW=111MiB/s (116MB/s)(1130MiB/10191msec); 0 zone resets 00:20:16.337 slat (usec): min=18, max=65560, avg=1754.00, stdev=4461.97 00:20:16.337 clat (usec): min=798, max=466316, avg=142447.12, stdev=90089.21 00:20:16.337 lat (usec): min=831, max=466400, avg=144201.13, stdev=91062.65 00:20:16.337 clat percentiles (msec): 00:20:16.337 | 1.00th=[ 3], 5.00th=[ 21], 10.00th=[ 37], 20.00th=[ 48], 00:20:16.337 | 30.00th=[ 86], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 159], 00:20:16.337 | 70.00th=[ 192], 80.00th=[ 236], 90.00th=[ 275], 95.00th=[ 296], 00:20:16.337 | 99.00th=[ 334], 99.50th=[ 372], 99.90th=[ 456], 99.95th=[ 468], 00:20:16.337 | 99.99th=[ 468] 00:20:16.337 bw ( KiB/s): min=55296, max=297984, per=8.90%, avg=114060.15, stdev=62878.68, samples=20 00:20:16.337 iops : min= 216, max= 1164, avg=445.50, stdev=245.60, samples=20 00:20:16.337 lat (usec) : 1000=0.13% 00:20:16.337 lat (msec) : 2=0.51%, 4=0.93%, 10=0.71%, 20=2.46%, 50=15.84% 00:20:16.337 lat (msec) : 100=14.54%, 250=48.35%, 500=16.53% 00:20:16.337 cpu : usr=1.45%, sys=1.56%, ctx=1993, majf=0, minf=1 00:20:16.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:16.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.337 issued rwts: total=0,4519,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.337 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.337 job7: (groupid=0, jobs=1): err= 0: pid=3200292: Wed Nov 20 20:21:20 2024 00:20:16.337 write: IOPS=804, BW=201MiB/s (211MB/s)(2041MiB/10153msec); 0 zone resets 00:20:16.337 slat (usec): min=16, max=64094, avg=748.45, stdev=2366.86 00:20:16.337 clat (usec): min=888, max=316329, avg=78752.53, stdev=59227.10 00:20:16.337 lat (usec): min=928, max=316399, avg=79500.98, stdev=59745.32 00:20:16.337 clat percentiles (msec): 00:20:16.337 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 15], 20.00th=[ 30], 00:20:16.337 | 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 62], 60.00th=[ 86], 00:20:16.337 | 70.00th=[ 109], 80.00th=[ 131], 90.00th=[ 163], 95.00th=[ 188], 00:20:16.337 | 99.00th=[ 247], 99.50th=[ 262], 99.90th=[ 300], 99.95th=[ 305], 00:20:16.337 | 99.99th=[ 317] 00:20:16.337 bw ( KiB/s): min=102400, max=414914, per=16.18%, avg=207356.70, stdev=87405.38, samples=20 00:20:16.337 iops : min= 400, max= 1620, avg=809.90, stdev=341.38, samples=20 00:20:16.337 lat (usec) : 1000=0.07% 00:20:16.337 lat (msec) : 2=0.85%, 4=1.87%, 10=4.18%, 20=6.80%, 50=30.63% 00:20:16.337 lat (msec) : 100=19.73%, 250=35.00%, 500=0.87% 00:20:16.337 cpu : usr=2.23%, sys=2.84%, ctx=5045, majf=0, minf=1 00:20:16.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:16.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.337 issued rwts: total=0,8164,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.337 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.337 job8: (groupid=0, jobs=1): err= 0: pid=3200293: Wed Nov 20 20:21:20 2024 00:20:16.337 write: IOPS=388, BW=97.1MiB/s (102MB/s)(993MiB/10224msec); 0 zone resets 00:20:16.337 slat (usec): min=23, max=86034, avg=2133.66, stdev=4860.73 00:20:16.337 clat (msec): min=6, max=483, avg=162.49, stdev=61.89 00:20:16.337 lat (msec): min=6, max=484, avg=164.62, stdev=62.71 00:20:16.337 clat percentiles (msec): 00:20:16.337 | 1.00th=[ 24], 5.00th=[ 69], 10.00th=[ 95], 20.00th=[ 117], 00:20:16.337 | 30.00th=[ 129], 40.00th=[ 144], 50.00th=[ 155], 60.00th=[ 169], 00:20:16.337 | 70.00th=[ 188], 80.00th=[ 213], 90.00th=[ 247], 95.00th=[ 266], 00:20:16.337 | 99.00th=[ 326], 99.50th=[ 409], 99.90th=[ 468], 99.95th=[ 485], 00:20:16.337 | 99.99th=[ 485] 00:20:16.337 bw ( KiB/s): min=61440, max=142848, per=7.80%, avg=99992.95, stdev=26643.41, samples=20 00:20:16.337 iops : min= 240, max= 558, avg=390.55, stdev=104.14, samples=20 00:20:16.337 lat (msec) : 10=0.05%, 20=0.73%, 50=2.17%, 100=8.49%, 250=79.90% 00:20:16.337 lat (msec) : 500=8.66% 00:20:16.337 cpu : usr=1.22%, sys=1.42%, ctx=1628, majf=0, minf=1 00:20:16.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:20:16.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.337 issued rwts: total=0,3970,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.337 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.337 job9: (groupid=0, jobs=1): err= 0: pid=3200294: Wed Nov 20 20:21:20 2024 00:20:16.337 write: IOPS=315, BW=78.9MiB/s (82.8MB/s)(805MiB/10190msec); 0 zone resets 00:20:16.337 slat (usec): min=23, max=151552, avg=2747.23, stdev=6254.97 00:20:16.337 clat (msec): min=5, max=467, avg=199.81, stdev=76.41 00:20:16.337 lat (msec): min=5, max=467, avg=202.56, stdev=77.21 00:20:16.337 clat percentiles (msec): 00:20:16.337 | 1.00th=[ 19], 5.00th=[ 83], 10.00th=[ 134], 20.00th=[ 146], 00:20:16.337 | 30.00th=[ 155], 40.00th=[ 165], 50.00th=[ 182], 60.00th=[ 205], 00:20:16.337 | 70.00th=[ 232], 80.00th=[ 275], 90.00th=[ 309], 95.00th=[ 334], 00:20:16.337 | 99.00th=[ 401], 99.50th=[ 418], 99.90th=[ 464], 99.95th=[ 468], 00:20:16.337 | 99.99th=[ 468] 00:20:16.337 bw ( KiB/s): min=51200, max=110592, per=6.30%, avg=80767.45, stdev=20396.82, samples=20 00:20:16.337 iops : min= 200, max= 432, avg=315.45, stdev=79.63, samples=20 00:20:16.337 lat (msec) : 10=0.50%, 20=0.65%, 50=2.08%, 100=2.58%, 250=67.81% 00:20:16.337 lat (msec) : 500=26.38% 00:20:16.337 cpu : usr=1.10%, sys=1.07%, ctx=1165, majf=0, minf=1 00:20:16.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=1.0%, >=64=98.0% 00:20:16.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.337 issued rwts: total=0,3218,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.337 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.337 job10: (groupid=0, jobs=1): err= 0: pid=3200295: Wed Nov 20 20:21:20 2024 00:20:16.337 write: IOPS=360, BW=90.2MiB/s (94.6MB/s)(920MiB/10200msec); 0 zone resets 00:20:16.337 slat (usec): min=20, max=76480, avg=2122.96, stdev=5493.82 00:20:16.337 clat (usec): min=1080, max=484416, avg=175086.29, stdev=96255.80 00:20:16.337 lat (usec): min=1141, max=484482, avg=177209.26, stdev=97417.58 00:20:16.337 clat percentiles (msec): 00:20:16.337 | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 19], 20.00th=[ 110], 00:20:16.337 | 30.00th=[ 144], 40.00th=[ 155], 50.00th=[ 174], 60.00th=[ 199], 00:20:16.337 | 70.00th=[ 220], 80.00th=[ 266], 90.00th=[ 309], 95.00th=[ 330], 00:20:16.337 | 99.00th=[ 347], 99.50th=[ 368], 99.90th=[ 472], 99.95th=[ 485], 00:20:16.337 | 99.99th=[ 485] 00:20:16.337 bw ( KiB/s): min=53248, max=141824, per=7.23%, avg=92614.35, stdev=27378.09, samples=20 00:20:16.337 iops : min= 208, max= 554, avg=361.75, stdev=106.97, samples=20 00:20:16.337 lat (msec) : 2=0.14%, 4=0.87%, 10=5.90%, 20=3.99%, 50=6.19% 00:20:16.337 lat (msec) : 100=2.42%, 250=57.19%, 500=23.31% 00:20:16.337 cpu : usr=1.16%, sys=1.33%, ctx=1936, majf=0, minf=1 00:20:16.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:16.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.337 issued rwts: total=0,3681,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.337 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.337 00:20:16.337 Run status group 0 (all jobs): 00:20:16.337 WRITE: bw=1251MiB/s (1312MB/s), 78.9MiB/s-201MiB/s (82.8MB/s-211MB/s), io=12.5GiB (13.4GB), run=10131-10226msec 00:20:16.337 00:20:16.337 Disk stats (read/write): 00:20:16.337 nvme0n1: ios=49/11953, merge=0/0, ticks=113/1207501, in_queue=1207614, util=97.62% 00:20:16.337 nvme10n1: ios=41/8597, merge=0/0, ticks=36/1244382, in_queue=1244418, util=97.47% 00:20:16.337 nvme1n1: ios=0/7224, merge=0/0, ticks=0/1196725, in_queue=1196725, util=97.42% 00:20:16.337 nvme2n1: ios=50/7054, merge=0/0, ticks=1719/1198989, in_queue=1200708, util=99.95% 00:20:16.337 nvme3n1: ios=51/12204, merge=0/0, ticks=5634/1146615, in_queue=1152249, util=99.95% 00:20:16.337 nvme4n1: ios=0/7252, merge=0/0, ticks=0/1236686, in_queue=1236686, util=98.22% 00:20:16.337 nvme5n1: ios=24/9023, merge=0/0, ticks=346/1238865, in_queue=1239211, util=100.00% 00:20:16.337 nvme6n1: ios=41/16128, merge=0/0, ticks=884/1220775, in_queue=1221659, util=99.96% 00:20:16.337 nvme7n1: ios=39/7891, merge=0/0, ticks=753/1233347, in_queue=1234100, util=99.99% 00:20:16.337 nvme8n1: ios=0/6421, merge=0/0, ticks=0/1237668, in_queue=1237668, util=99.04% 00:20:16.337 nvme9n1: ios=0/7335, merge=0/0, ticks=0/1238668, in_queue=1238668, util=99.09% 00:20:16.337 20:21:20 -- target/multiconnection.sh@36 -- # sync 00:20:16.337 20:21:20 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:16.337 20:21:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.337 20:21:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:16.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:16.337 20:21:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:16.337 20:21:20 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.337 20:21:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.337 20:21:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:16.337 20:21:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.337 20:21:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:16.337 20:21:20 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.337 20:21:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:16.337 20:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.337 20:21:20 -- common/autotest_common.sh@10 -- # set +x 00:20:16.337 20:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.337 20:21:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.338 20:21:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:16.338 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:16.338 20:21:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:16.338 20:21:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.338 20:21:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.338 20:21:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:16.338 20:21:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.338 20:21:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:16.338 20:21:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.338 20:21:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:16.338 20:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.338 20:21:21 -- common/autotest_common.sh@10 -- # set +x 00:20:16.338 20:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.338 20:21:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.338 20:21:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:16.599 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:16.599 20:21:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:16.599 20:21:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.599 20:21:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.599 20:21:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:16.599 20:21:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.599 20:21:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:16.599 20:21:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.599 20:21:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:16.599 20:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.599 20:21:21 -- common/autotest_common.sh@10 -- # set +x 00:20:16.599 20:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.599 20:21:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.599 20:21:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:16.858 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:16.858 20:21:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:16.858 20:21:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.858 20:21:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.858 20:21:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:16.858 20:21:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.858 20:21:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:16.858 20:21:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.858 20:21:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:16.858 20:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.858 20:21:21 -- common/autotest_common.sh@10 -- # set +x 00:20:16.858 20:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.858 20:21:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.858 20:21:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:16.858 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:16.858 20:21:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:16.858 20:21:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.858 20:21:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.858 20:21:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:16.858 20:21:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.858 20:21:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:17.118 20:21:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.118 20:21:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:17.118 20:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.118 20:21:21 -- common/autotest_common.sh@10 -- # set +x 00:20:17.118 20:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.118 20:21:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.118 20:21:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:17.379 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:17.379 20:21:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:17.379 20:21:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.379 20:21:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.379 20:21:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:17.379 20:21:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.379 20:21:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:17.379 20:21:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.379 20:21:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:17.379 20:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.379 20:21:22 -- common/autotest_common.sh@10 -- # set +x 00:20:17.379 20:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.379 20:21:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.379 20:21:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:17.639 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:17.639 20:21:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:17.639 20:21:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.639 20:21:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:17.639 20:21:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.639 20:21:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.639 20:21:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:17.639 20:21:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.639 20:21:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:17.639 20:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.639 20:21:22 -- common/autotest_common.sh@10 -- # set +x 00:20:17.639 20:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.639 20:21:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.639 20:21:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:17.898 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:17.898 20:21:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:17.898 20:21:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.898 20:21:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.898 20:21:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:17.898 20:21:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.898 20:21:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:17.898 20:21:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.898 20:21:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:17.898 20:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.898 20:21:22 -- common/autotest_common.sh@10 -- # set +x 00:20:17.898 20:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.898 20:21:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.898 20:21:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:17.898 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:17.898 20:21:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:17.898 20:21:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.898 20:21:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.898 20:21:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:17.898 20:21:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.898 20:21:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:17.898 20:21:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.898 20:21:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:17.898 20:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.898 20:21:22 -- common/autotest_common.sh@10 -- # set +x 00:20:17.898 20:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.898 20:21:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.898 20:21:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:18.157 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:18.157 20:21:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:18.157 20:21:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:18.157 20:21:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:18.157 20:21:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:18.157 20:21:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:18.157 20:21:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:18.157 20:21:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:18.157 20:21:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:18.157 20:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:18.157 20:21:22 -- common/autotest_common.sh@10 -- # set +x 00:20:18.157 20:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:18.157 20:21:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:18.157 20:21:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:18.157 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:18.157 20:21:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:18.157 20:21:23 -- common/autotest_common.sh@1208 -- # local i=0 00:20:18.157 20:21:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:18.157 20:21:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:18.157 20:21:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:18.157 20:21:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:18.157 20:21:23 -- common/autotest_common.sh@1220 -- # return 0 00:20:18.157 20:21:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:18.157 20:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:18.157 20:21:23 -- common/autotest_common.sh@10 -- # set +x 00:20:18.157 20:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:18.157 20:21:23 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:18.157 20:21:23 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:18.157 20:21:23 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:18.157 20:21:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:18.157 20:21:23 -- nvmf/common.sh@116 -- # sync 00:20:18.157 20:21:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:18.157 20:21:23 -- nvmf/common.sh@119 -- # set +e 00:20:18.157 20:21:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:18.157 20:21:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:18.157 rmmod nvme_tcp 00:20:18.157 rmmod nvme_fabrics 00:20:18.157 rmmod nvme_keyring 00:20:18.157 20:21:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:18.157 20:21:23 -- nvmf/common.sh@123 -- # set -e 00:20:18.157 20:21:23 -- nvmf/common.sh@124 -- # return 0 00:20:18.157 20:21:23 -- nvmf/common.sh@477 -- # '[' -n 3194090 ']' 00:20:18.157 20:21:23 -- nvmf/common.sh@478 -- # killprocess 3194090 00:20:18.157 20:21:23 -- common/autotest_common.sh@936 -- # '[' -z 3194090 ']' 00:20:18.157 20:21:23 -- common/autotest_common.sh@940 -- # kill -0 3194090 00:20:18.157 20:21:23 -- common/autotest_common.sh@941 -- # uname 00:20:18.157 20:21:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:18.157 20:21:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3194090 00:20:18.157 20:21:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:18.157 20:21:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:18.157 20:21:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3194090' 00:20:18.157 killing process with pid 3194090 00:20:18.157 20:21:23 -- common/autotest_common.sh@955 -- # kill 3194090 00:20:18.157 20:21:23 -- common/autotest_common.sh@960 -- # wait 3194090 00:20:18.729 20:21:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:18.729 20:21:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:18.729 20:21:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:18.729 20:21:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:18.729 20:21:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:18.729 20:21:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:18.729 20:21:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:18.729 20:21:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:21.272 20:21:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:21.272 00:20:21.272 real 1m1.462s 00:20:21.272 user 3m23.981s 00:20:21.272 sys 0m25.246s 00:20:21.272 20:21:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:21.272 20:21:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.272 ************************************ 00:20:21.272 END TEST nvmf_multiconnection 00:20:21.272 ************************************ 00:20:21.272 20:21:25 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:21.272 20:21:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:21.272 20:21:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:21.272 20:21:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.272 ************************************ 00:20:21.272 START TEST nvmf_initiator_timeout 00:20:21.272 ************************************ 00:20:21.272 20:21:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:21.272 * Looking for test storage... 00:20:21.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:21.272 20:21:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:21.272 20:21:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:21.272 20:21:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:21.272 20:21:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:21.272 20:21:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:21.272 20:21:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:21.272 20:21:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:21.272 20:21:25 -- scripts/common.sh@335 -- # IFS=.-: 00:20:21.272 20:21:25 -- scripts/common.sh@335 -- # read -ra ver1 00:20:21.272 20:21:25 -- scripts/common.sh@336 -- # IFS=.-: 00:20:21.272 20:21:25 -- scripts/common.sh@336 -- # read -ra ver2 00:20:21.272 20:21:25 -- scripts/common.sh@337 -- # local 'op=<' 00:20:21.272 20:21:25 -- scripts/common.sh@339 -- # ver1_l=2 00:20:21.272 20:21:25 -- scripts/common.sh@340 -- # ver2_l=1 00:20:21.272 20:21:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:21.272 20:21:25 -- scripts/common.sh@343 -- # case "$op" in 00:20:21.272 20:21:25 -- scripts/common.sh@344 -- # : 1 00:20:21.272 20:21:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:21.272 20:21:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:21.272 20:21:25 -- scripts/common.sh@364 -- # decimal 1 00:20:21.272 20:21:25 -- scripts/common.sh@352 -- # local d=1 00:20:21.272 20:21:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:21.272 20:21:25 -- scripts/common.sh@354 -- # echo 1 00:20:21.272 20:21:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:21.272 20:21:25 -- scripts/common.sh@365 -- # decimal 2 00:20:21.272 20:21:25 -- scripts/common.sh@352 -- # local d=2 00:20:21.272 20:21:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:21.272 20:21:25 -- scripts/common.sh@354 -- # echo 2 00:20:21.272 20:21:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:21.272 20:21:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:21.272 20:21:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:21.272 20:21:25 -- scripts/common.sh@367 -- # return 0 00:20:21.272 20:21:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:21.272 20:21:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.272 --rc genhtml_branch_coverage=1 00:20:21.272 --rc genhtml_function_coverage=1 00:20:21.272 --rc genhtml_legend=1 00:20:21.272 --rc geninfo_all_blocks=1 00:20:21.272 --rc geninfo_unexecuted_blocks=1 00:20:21.272 00:20:21.272 ' 00:20:21.272 20:21:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.272 --rc genhtml_branch_coverage=1 00:20:21.272 --rc genhtml_function_coverage=1 00:20:21.272 --rc genhtml_legend=1 00:20:21.272 --rc geninfo_all_blocks=1 00:20:21.272 --rc geninfo_unexecuted_blocks=1 00:20:21.272 00:20:21.272 ' 00:20:21.272 20:21:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.272 --rc genhtml_branch_coverage=1 00:20:21.272 --rc genhtml_function_coverage=1 00:20:21.272 --rc genhtml_legend=1 00:20:21.272 --rc geninfo_all_blocks=1 00:20:21.272 --rc geninfo_unexecuted_blocks=1 00:20:21.272 00:20:21.272 ' 00:20:21.272 20:21:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.272 --rc genhtml_branch_coverage=1 00:20:21.272 --rc genhtml_function_coverage=1 00:20:21.272 --rc genhtml_legend=1 00:20:21.272 --rc geninfo_all_blocks=1 00:20:21.272 --rc geninfo_unexecuted_blocks=1 00:20:21.272 00:20:21.272 ' 00:20:21.272 20:21:25 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:21.272 20:21:25 -- nvmf/common.sh@7 -- # uname -s 00:20:21.272 20:21:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:21.272 20:21:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:21.272 20:21:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:21.272 20:21:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:21.272 20:21:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:21.272 20:21:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:21.272 20:21:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:21.272 20:21:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:21.272 20:21:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:21.272 20:21:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:21.272 20:21:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:21.272 20:21:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:21.272 20:21:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:21.272 20:21:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:21.272 20:21:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:21.272 20:21:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:21.272 20:21:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:21.272 20:21:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:21.272 20:21:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:21.272 20:21:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.272 20:21:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.273 20:21:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.273 20:21:25 -- paths/export.sh@5 -- # export PATH 00:20:21.273 20:21:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.273 20:21:25 -- nvmf/common.sh@46 -- # : 0 00:20:21.273 20:21:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:21.273 20:21:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:21.273 20:21:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:21.273 20:21:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:21.273 20:21:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:21.273 20:21:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:21.273 20:21:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:21.273 20:21:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:21.273 20:21:25 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:21.273 20:21:25 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:21.273 20:21:25 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:21.273 20:21:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:21.273 20:21:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:21.273 20:21:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:21.273 20:21:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:21.273 20:21:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:21.273 20:21:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:21.273 20:21:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:21.273 20:21:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:21.273 20:21:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:21.273 20:21:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:21.273 20:21:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:21.273 20:21:25 -- common/autotest_common.sh@10 -- # set +x 00:20:23.202 20:21:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:23.202 20:21:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:23.202 20:21:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:23.202 20:21:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:23.202 20:21:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:23.202 20:21:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:23.202 20:21:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:23.202 20:21:28 -- nvmf/common.sh@294 -- # net_devs=() 00:20:23.202 20:21:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:23.202 20:21:28 -- nvmf/common.sh@295 -- # e810=() 00:20:23.202 20:21:28 -- nvmf/common.sh@295 -- # local -ga e810 00:20:23.202 20:21:28 -- nvmf/common.sh@296 -- # x722=() 00:20:23.202 20:21:28 -- nvmf/common.sh@296 -- # local -ga x722 00:20:23.202 20:21:28 -- nvmf/common.sh@297 -- # mlx=() 00:20:23.202 20:21:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:23.202 20:21:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:23.202 20:21:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:23.202 20:21:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:23.202 20:21:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:23.202 20:21:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:23.202 20:21:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:23.202 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:23.202 20:21:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:23.202 20:21:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:23.202 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:23.202 20:21:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:23.202 20:21:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:23.202 20:21:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:23.202 20:21:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:23.202 20:21:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:23.202 20:21:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:23.202 20:21:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:23.202 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:23.202 20:21:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:23.202 20:21:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:23.202 20:21:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:23.202 20:21:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:23.202 20:21:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:23.202 20:21:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:23.202 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:23.202 20:21:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:23.203 20:21:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:23.203 20:21:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:23.203 20:21:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:23.203 20:21:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:23.203 20:21:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:23.203 20:21:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:23.203 20:21:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:23.203 20:21:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:23.203 20:21:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:23.203 20:21:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:23.203 20:21:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:23.203 20:21:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:23.203 20:21:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:23.203 20:21:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:23.203 20:21:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:23.203 20:21:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:23.203 20:21:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:23.203 20:21:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:23.203 20:21:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:23.203 20:21:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:23.203 20:21:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:23.203 20:21:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:23.203 20:21:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:23.203 20:21:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:23.487 20:21:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:23.487 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:23.487 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:20:23.487 00:20:23.487 --- 10.0.0.2 ping statistics --- 00:20:23.487 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:23.487 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:20:23.487 20:21:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:23.487 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:23.487 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:20:23.487 00:20:23.487 --- 10.0.0.1 ping statistics --- 00:20:23.487 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:23.487 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:20:23.487 20:21:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:23.487 20:21:28 -- nvmf/common.sh@410 -- # return 0 00:20:23.487 20:21:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:23.487 20:21:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:23.487 20:21:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:23.487 20:21:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:23.487 20:21:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:23.487 20:21:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:23.487 20:21:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:23.487 20:21:28 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:23.487 20:21:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:23.487 20:21:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:23.487 20:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:23.487 20:21:28 -- nvmf/common.sh@469 -- # nvmfpid=3203814 00:20:23.487 20:21:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:23.487 20:21:28 -- nvmf/common.sh@470 -- # waitforlisten 3203814 00:20:23.487 20:21:28 -- common/autotest_common.sh@829 -- # '[' -z 3203814 ']' 00:20:23.487 20:21:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:23.487 20:21:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:23.487 20:21:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:23.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:23.487 20:21:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:23.487 20:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:23.487 [2024-11-20 20:21:28.300806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:23.487 [2024-11-20 20:21:28.300884] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:23.487 EAL: No free 2048 kB hugepages reported on node 1 00:20:23.487 [2024-11-20 20:21:28.365936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:23.487 [2024-11-20 20:21:28.479271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:23.487 [2024-11-20 20:21:28.479423] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:23.487 [2024-11-20 20:21:28.479449] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:23.487 [2024-11-20 20:21:28.479468] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:23.487 [2024-11-20 20:21:28.479530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:23.487 [2024-11-20 20:21:28.479596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:23.487 [2024-11-20 20:21:28.479733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:23.487 [2024-11-20 20:21:28.479743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:24.472 20:21:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:24.472 20:21:29 -- common/autotest_common.sh@862 -- # return 0 00:20:24.472 20:21:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:24.472 20:21:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 20:21:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:24.472 20:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 Malloc0 00:20:24.472 20:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:24.472 20:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 Delay0 00:20:24.472 20:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:24.472 20:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 [2024-11-20 20:21:29.365038] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:24.472 20:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:24.472 20:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 20:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:24.472 20:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 20:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:24.472 20:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.472 20:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:24.472 [2024-11-20 20:21:29.393381] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:24.472 20:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.472 20:21:29 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:25.405 20:21:30 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:25.405 20:21:30 -- common/autotest_common.sh@1187 -- # local i=0 00:20:25.405 20:21:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:25.405 20:21:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:25.405 20:21:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:27.311 20:21:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:27.311 20:21:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:27.311 20:21:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:27.311 20:21:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:27.311 20:21:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:27.311 20:21:32 -- common/autotest_common.sh@1197 -- # return 0 00:20:27.311 20:21:32 -- target/initiator_timeout.sh@35 -- # fio_pid=3204269 00:20:27.311 20:21:32 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:27.311 20:21:32 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:27.311 [global] 00:20:27.311 thread=1 00:20:27.311 invalidate=1 00:20:27.311 rw=write 00:20:27.311 time_based=1 00:20:27.311 runtime=60 00:20:27.311 ioengine=libaio 00:20:27.311 direct=1 00:20:27.311 bs=4096 00:20:27.311 iodepth=1 00:20:27.311 norandommap=0 00:20:27.311 numjobs=1 00:20:27.311 00:20:27.311 verify_dump=1 00:20:27.311 verify_backlog=512 00:20:27.311 verify_state_save=0 00:20:27.311 do_verify=1 00:20:27.311 verify=crc32c-intel 00:20:27.311 [job0] 00:20:27.311 filename=/dev/nvme0n1 00:20:27.311 Could not set queue depth (nvme0n1) 00:20:27.311 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:27.311 fio-3.35 00:20:27.311 Starting 1 thread 00:20:30.599 20:21:35 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:30.599 20:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.599 20:21:35 -- common/autotest_common.sh@10 -- # set +x 00:20:30.599 true 00:20:30.599 20:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.599 20:21:35 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:30.599 20:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.599 20:21:35 -- common/autotest_common.sh@10 -- # set +x 00:20:30.599 true 00:20:30.599 20:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.599 20:21:35 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:30.599 20:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.599 20:21:35 -- common/autotest_common.sh@10 -- # set +x 00:20:30.599 true 00:20:30.599 20:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.599 20:21:35 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:30.599 20:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.599 20:21:35 -- common/autotest_common.sh@10 -- # set +x 00:20:30.599 true 00:20:30.599 20:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.599 20:21:35 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:33.135 20:21:38 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:33.135 20:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.135 20:21:38 -- common/autotest_common.sh@10 -- # set +x 00:20:33.135 true 00:20:33.135 20:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.135 20:21:38 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:33.135 20:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.135 20:21:38 -- common/autotest_common.sh@10 -- # set +x 00:20:33.135 true 00:20:33.135 20:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.135 20:21:38 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:33.135 20:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.135 20:21:38 -- common/autotest_common.sh@10 -- # set +x 00:20:33.135 true 00:20:33.135 20:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.135 20:21:38 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:33.135 20:21:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.135 20:21:38 -- common/autotest_common.sh@10 -- # set +x 00:20:33.135 true 00:20:33.135 20:21:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.135 20:21:38 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:33.135 20:21:38 -- target/initiator_timeout.sh@54 -- # wait 3204269 00:21:29.380 00:21:29.380 job0: (groupid=0, jobs=1): err= 0: pid=3204338: Wed Nov 20 20:22:32 2024 00:21:29.380 read: IOPS=117, BW=469KiB/s (480kB/s)(27.5MiB/60038msec) 00:21:29.380 slat (usec): min=4, max=10127, avg=15.61, stdev=157.27 00:21:29.380 clat (usec): min=229, max=40988k, avg=8266.19, stdev=488521.86 00:21:29.380 lat (usec): min=236, max=40988k, avg=8281.81, stdev=488521.85 00:21:29.380 clat percentiles (usec): 00:21:29.380 | 1.00th=[ 243], 5.00th=[ 251], 10.00th=[ 255], 00:21:29.380 | 20.00th=[ 262], 30.00th=[ 269], 40.00th=[ 277], 00:21:29.380 | 50.00th=[ 289], 60.00th=[ 297], 70.00th=[ 306], 00:21:29.380 | 80.00th=[ 314], 90.00th=[ 445], 95.00th=[ 41157], 00:21:29.380 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41157], 00:21:29.380 | 99.95th=[ 41157], 99.99th=[17112761] 00:21:29.380 write: IOPS=119, BW=478KiB/s (489kB/s)(28.0MiB/60038msec); 0 zone resets 00:21:29.380 slat (nsec): min=5859, max=76841, avg=13994.34, stdev=7479.62 00:21:29.380 clat (usec): min=172, max=649, avg=219.12, stdev=33.02 00:21:29.380 lat (usec): min=180, max=665, avg=233.11, stdev=38.85 00:21:29.380 clat percentiles (usec): 00:21:29.380 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 194], 00:21:29.380 | 30.00th=[ 200], 40.00th=[ 204], 50.00th=[ 210], 60.00th=[ 221], 00:21:29.380 | 70.00th=[ 229], 80.00th=[ 239], 90.00th=[ 258], 95.00th=[ 281], 00:21:29.380 | 99.00th=[ 359], 99.50th=[ 379], 99.90th=[ 424], 99.95th=[ 433], 00:21:29.380 | 99.99th=[ 652] 00:21:29.380 bw ( KiB/s): min= 1976, max= 8192, per=100.00%, avg=6371.56, stdev=2293.66, samples=9 00:21:29.380 iops : min= 494, max= 2048, avg=1592.89, stdev=573.41, samples=9 00:21:29.380 lat (usec) : 250=46.99%, 500=49.11%, 750=1.27% 00:21:29.380 lat (msec) : 50=2.62%, >=2000=0.01% 00:21:29.380 cpu : usr=0.24%, sys=0.42%, ctx=14211, majf=0, minf=1 00:21:29.380 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:29.380 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:29.380 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:29.380 issued rwts: total=7041,7168,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:29.380 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:29.380 00:21:29.380 Run status group 0 (all jobs): 00:21:29.380 READ: bw=469KiB/s (480kB/s), 469KiB/s-469KiB/s (480kB/s-480kB/s), io=27.5MiB (28.8MB), run=60038-60038msec 00:21:29.380 WRITE: bw=478KiB/s (489kB/s), 478KiB/s-478KiB/s (489kB/s-489kB/s), io=28.0MiB (29.4MB), run=60038-60038msec 00:21:29.380 00:21:29.380 Disk stats (read/write): 00:21:29.380 nvme0n1: ios=7136/7168, merge=0/0, ticks=18394/1514, in_queue=19908, util=99.94% 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:29.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:29.380 20:22:32 -- common/autotest_common.sh@1208 -- # local i=0 00:21:29.380 20:22:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:29.380 20:22:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:29.380 20:22:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:29.380 20:22:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:29.380 20:22:32 -- common/autotest_common.sh@1220 -- # return 0 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:29.380 nvmf hotplug test: fio successful as expected 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:29.380 20:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:29.380 20:22:32 -- common/autotest_common.sh@10 -- # set +x 00:21:29.380 20:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:29.380 20:22:32 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:29.380 20:22:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:29.380 20:22:32 -- nvmf/common.sh@116 -- # sync 00:21:29.380 20:22:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:29.380 20:22:32 -- nvmf/common.sh@119 -- # set +e 00:21:29.380 20:22:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:29.380 20:22:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:29.380 rmmod nvme_tcp 00:21:29.380 rmmod nvme_fabrics 00:21:29.380 rmmod nvme_keyring 00:21:29.380 20:22:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:29.380 20:22:32 -- nvmf/common.sh@123 -- # set -e 00:21:29.380 20:22:32 -- nvmf/common.sh@124 -- # return 0 00:21:29.380 20:22:32 -- nvmf/common.sh@477 -- # '[' -n 3203814 ']' 00:21:29.380 20:22:32 -- nvmf/common.sh@478 -- # killprocess 3203814 00:21:29.380 20:22:32 -- common/autotest_common.sh@936 -- # '[' -z 3203814 ']' 00:21:29.380 20:22:32 -- common/autotest_common.sh@940 -- # kill -0 3203814 00:21:29.380 20:22:32 -- common/autotest_common.sh@941 -- # uname 00:21:29.380 20:22:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:29.380 20:22:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3203814 00:21:29.380 20:22:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:29.380 20:22:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:29.380 20:22:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3203814' 00:21:29.380 killing process with pid 3203814 00:21:29.380 20:22:32 -- common/autotest_common.sh@955 -- # kill 3203814 00:21:29.380 20:22:32 -- common/autotest_common.sh@960 -- # wait 3203814 00:21:29.380 20:22:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:29.380 20:22:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:29.380 20:22:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:29.381 20:22:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:29.381 20:22:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:29.381 20:22:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:29.381 20:22:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:29.381 20:22:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.321 20:22:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:30.321 00:21:30.321 real 1m9.197s 00:21:30.321 user 4m14.250s 00:21:30.321 sys 0m6.704s 00:21:30.321 20:22:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:30.321 20:22:34 -- common/autotest_common.sh@10 -- # set +x 00:21:30.321 ************************************ 00:21:30.321 END TEST nvmf_initiator_timeout 00:21:30.321 ************************************ 00:21:30.321 20:22:35 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:30.321 20:22:35 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:30.321 20:22:35 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:30.321 20:22:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:30.321 20:22:35 -- common/autotest_common.sh@10 -- # set +x 00:21:32.223 20:22:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:32.223 20:22:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:32.223 20:22:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:32.223 20:22:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:32.223 20:22:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:32.223 20:22:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:32.223 20:22:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:32.223 20:22:37 -- nvmf/common.sh@294 -- # net_devs=() 00:21:32.223 20:22:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:32.223 20:22:37 -- nvmf/common.sh@295 -- # e810=() 00:21:32.223 20:22:37 -- nvmf/common.sh@295 -- # local -ga e810 00:21:32.223 20:22:37 -- nvmf/common.sh@296 -- # x722=() 00:21:32.223 20:22:37 -- nvmf/common.sh@296 -- # local -ga x722 00:21:32.223 20:22:37 -- nvmf/common.sh@297 -- # mlx=() 00:21:32.223 20:22:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:32.223 20:22:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:32.223 20:22:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:32.223 20:22:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:32.223 20:22:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:32.223 20:22:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:32.223 20:22:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:32.223 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:32.223 20:22:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:32.223 20:22:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:32.223 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:32.223 20:22:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:32.223 20:22:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:32.223 20:22:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:32.223 20:22:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:32.223 20:22:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:32.223 20:22:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:32.223 20:22:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:32.224 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:32.224 20:22:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:32.224 20:22:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:32.224 20:22:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:32.224 20:22:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:32.224 20:22:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:32.224 20:22:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:32.224 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:32.224 20:22:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:32.224 20:22:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:32.224 20:22:37 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:32.224 20:22:37 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:32.224 20:22:37 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:32.224 20:22:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:32.224 20:22:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:32.224 20:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:32.224 ************************************ 00:21:32.224 START TEST nvmf_perf_adq 00:21:32.224 ************************************ 00:21:32.224 20:22:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:32.224 * Looking for test storage... 00:21:32.224 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:32.224 20:22:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:32.224 20:22:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:32.224 20:22:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:32.482 20:22:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:32.482 20:22:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:32.482 20:22:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:32.482 20:22:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:32.482 20:22:37 -- scripts/common.sh@335 -- # IFS=.-: 00:21:32.482 20:22:37 -- scripts/common.sh@335 -- # read -ra ver1 00:21:32.482 20:22:37 -- scripts/common.sh@336 -- # IFS=.-: 00:21:32.482 20:22:37 -- scripts/common.sh@336 -- # read -ra ver2 00:21:32.482 20:22:37 -- scripts/common.sh@337 -- # local 'op=<' 00:21:32.482 20:22:37 -- scripts/common.sh@339 -- # ver1_l=2 00:21:32.482 20:22:37 -- scripts/common.sh@340 -- # ver2_l=1 00:21:32.482 20:22:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:32.482 20:22:37 -- scripts/common.sh@343 -- # case "$op" in 00:21:32.482 20:22:37 -- scripts/common.sh@344 -- # : 1 00:21:32.482 20:22:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:32.482 20:22:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:32.482 20:22:37 -- scripts/common.sh@364 -- # decimal 1 00:21:32.482 20:22:37 -- scripts/common.sh@352 -- # local d=1 00:21:32.482 20:22:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:32.482 20:22:37 -- scripts/common.sh@354 -- # echo 1 00:21:32.482 20:22:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:32.482 20:22:37 -- scripts/common.sh@365 -- # decimal 2 00:21:32.482 20:22:37 -- scripts/common.sh@352 -- # local d=2 00:21:32.482 20:22:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:32.482 20:22:37 -- scripts/common.sh@354 -- # echo 2 00:21:32.482 20:22:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:32.482 20:22:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:32.482 20:22:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:32.482 20:22:37 -- scripts/common.sh@367 -- # return 0 00:21:32.482 20:22:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:32.482 20:22:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:32.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.483 --rc genhtml_branch_coverage=1 00:21:32.483 --rc genhtml_function_coverage=1 00:21:32.483 --rc genhtml_legend=1 00:21:32.483 --rc geninfo_all_blocks=1 00:21:32.483 --rc geninfo_unexecuted_blocks=1 00:21:32.483 00:21:32.483 ' 00:21:32.483 20:22:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:32.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.483 --rc genhtml_branch_coverage=1 00:21:32.483 --rc genhtml_function_coverage=1 00:21:32.483 --rc genhtml_legend=1 00:21:32.483 --rc geninfo_all_blocks=1 00:21:32.483 --rc geninfo_unexecuted_blocks=1 00:21:32.483 00:21:32.483 ' 00:21:32.483 20:22:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:32.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.483 --rc genhtml_branch_coverage=1 00:21:32.483 --rc genhtml_function_coverage=1 00:21:32.483 --rc genhtml_legend=1 00:21:32.483 --rc geninfo_all_blocks=1 00:21:32.483 --rc geninfo_unexecuted_blocks=1 00:21:32.483 00:21:32.483 ' 00:21:32.483 20:22:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:32.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.483 --rc genhtml_branch_coverage=1 00:21:32.483 --rc genhtml_function_coverage=1 00:21:32.483 --rc genhtml_legend=1 00:21:32.483 --rc geninfo_all_blocks=1 00:21:32.483 --rc geninfo_unexecuted_blocks=1 00:21:32.483 00:21:32.483 ' 00:21:32.483 20:22:37 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:32.483 20:22:37 -- nvmf/common.sh@7 -- # uname -s 00:21:32.483 20:22:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:32.483 20:22:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:32.483 20:22:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:32.483 20:22:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:32.483 20:22:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:32.483 20:22:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:32.483 20:22:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:32.483 20:22:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:32.483 20:22:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:32.483 20:22:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:32.483 20:22:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.483 20:22:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.483 20:22:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:32.483 20:22:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:32.483 20:22:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:32.483 20:22:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:32.483 20:22:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:32.483 20:22:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:32.483 20:22:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:32.483 20:22:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.483 20:22:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.483 20:22:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.483 20:22:37 -- paths/export.sh@5 -- # export PATH 00:21:32.483 20:22:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.483 20:22:37 -- nvmf/common.sh@46 -- # : 0 00:21:32.483 20:22:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:32.483 20:22:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:32.483 20:22:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:32.483 20:22:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:32.483 20:22:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:32.483 20:22:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:32.483 20:22:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:32.483 20:22:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:32.483 20:22:37 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:32.483 20:22:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:32.483 20:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:34.385 20:22:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:34.385 20:22:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:34.385 20:22:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:34.385 20:22:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:34.385 20:22:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:34.385 20:22:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:34.385 20:22:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:34.385 20:22:39 -- nvmf/common.sh@294 -- # net_devs=() 00:21:34.385 20:22:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:34.385 20:22:39 -- nvmf/common.sh@295 -- # e810=() 00:21:34.385 20:22:39 -- nvmf/common.sh@295 -- # local -ga e810 00:21:34.385 20:22:39 -- nvmf/common.sh@296 -- # x722=() 00:21:34.385 20:22:39 -- nvmf/common.sh@296 -- # local -ga x722 00:21:34.385 20:22:39 -- nvmf/common.sh@297 -- # mlx=() 00:21:34.385 20:22:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:34.385 20:22:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:34.385 20:22:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:34.385 20:22:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:34.385 20:22:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:34.385 20:22:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.385 20:22:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:34.385 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:34.385 20:22:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.385 20:22:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:34.385 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:34.385 20:22:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:34.385 20:22:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:34.385 20:22:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.385 20:22:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.385 20:22:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.385 20:22:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.385 20:22:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:34.385 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:34.385 20:22:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.385 20:22:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.385 20:22:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.385 20:22:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.385 20:22:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.385 20:22:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:34.385 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:34.385 20:22:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.385 20:22:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:34.385 20:22:39 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:34.385 20:22:39 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:34.385 20:22:39 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:34.385 20:22:39 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:34.385 20:22:39 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:35.322 20:22:40 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:37.856 20:22:42 -- target/perf_adq.sh@54 -- # sleep 5 00:21:43.137 20:22:47 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:43.137 20:22:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:43.137 20:22:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:43.137 20:22:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:43.137 20:22:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:43.137 20:22:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:43.137 20:22:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:43.137 20:22:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:43.137 20:22:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:43.137 20:22:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:43.137 20:22:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:43.137 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.137 20:22:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.137 20:22:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.137 20:22:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.137 20:22:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.137 20:22:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.137 20:22:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.137 20:22:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.137 20:22:47 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.137 20:22:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.137 20:22:47 -- nvmf/common.sh@295 -- # e810=() 00:21:43.137 20:22:47 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.137 20:22:47 -- nvmf/common.sh@296 -- # x722=() 00:21:43.137 20:22:47 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.137 20:22:47 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.137 20:22:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.137 20:22:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.137 20:22:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.137 20:22:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.137 20:22:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.137 20:22:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.137 20:22:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.137 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.137 20:22:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.137 20:22:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.137 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.137 20:22:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.137 20:22:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.137 20:22:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.137 20:22:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.137 20:22:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.137 20:22:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.137 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.137 20:22:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.137 20:22:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.137 20:22:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.137 20:22:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.137 20:22:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.137 20:22:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.137 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.137 20:22:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.137 20:22:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.137 20:22:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:43.137 20:22:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:43.137 20:22:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:43.137 20:22:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:43.137 20:22:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:43.137 20:22:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.137 20:22:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:43.137 20:22:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:43.137 20:22:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:43.137 20:22:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:43.137 20:22:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:43.137 20:22:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:43.137 20:22:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:43.137 20:22:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:43.137 20:22:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:43.137 20:22:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:43.137 20:22:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:43.137 20:22:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:43.137 20:22:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:43.137 20:22:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:43.138 20:22:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:43.138 20:22:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:43.138 20:22:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:43.138 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:43.138 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:21:43.138 00:21:43.138 --- 10.0.0.2 ping statistics --- 00:21:43.138 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.138 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:21:43.138 20:22:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:43.138 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:43.138 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:21:43.138 00:21:43.138 --- 10.0.0.1 ping statistics --- 00:21:43.138 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.138 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:21:43.138 20:22:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:43.138 20:22:47 -- nvmf/common.sh@410 -- # return 0 00:21:43.138 20:22:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:43.138 20:22:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:43.138 20:22:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:43.138 20:22:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:43.138 20:22:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:43.138 20:22:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:43.138 20:22:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:43.138 20:22:47 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:43.138 20:22:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:43.138 20:22:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 20:22:47 -- nvmf/common.sh@469 -- # nvmfpid=3216269 00:21:43.138 20:22:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:43.138 20:22:47 -- nvmf/common.sh@470 -- # waitforlisten 3216269 00:21:43.138 20:22:47 -- common/autotest_common.sh@829 -- # '[' -z 3216269 ']' 00:21:43.138 20:22:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:43.138 20:22:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:43.138 20:22:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:43.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:43.138 20:22:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 [2024-11-20 20:22:47.483206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:43.138 [2024-11-20 20:22:47.483280] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:43.138 EAL: No free 2048 kB hugepages reported on node 1 00:21:43.138 [2024-11-20 20:22:47.547011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:43.138 [2024-11-20 20:22:47.651844] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:43.138 [2024-11-20 20:22:47.652014] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:43.138 [2024-11-20 20:22:47.652040] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:43.138 [2024-11-20 20:22:47.652060] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:43.138 [2024-11-20 20:22:47.652194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:43.138 [2024-11-20 20:22:47.652257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:43.138 [2024-11-20 20:22:47.652325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:43.138 [2024-11-20 20:22:47.652333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:43.138 20:22:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:43.138 20:22:47 -- common/autotest_common.sh@862 -- # return 0 00:21:43.138 20:22:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:43.138 20:22:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 20:22:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:43.138 20:22:47 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:43.138 20:22:47 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 [2024-11-20 20:22:47.837654] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 Malloc1 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:43.138 20:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.138 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:21:43.138 [2024-11-20 20:22:47.888444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:43.138 20:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.138 20:22:47 -- target/perf_adq.sh@73 -- # perfpid=3216299 00:21:43.138 20:22:47 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:43.138 20:22:47 -- target/perf_adq.sh@74 -- # sleep 2 00:21:43.138 EAL: No free 2048 kB hugepages reported on node 1 00:21:45.046 20:22:49 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:45.046 20:22:49 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:45.046 20:22:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.046 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:21:45.046 20:22:49 -- target/perf_adq.sh@76 -- # wc -l 00:21:45.046 20:22:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.046 20:22:49 -- target/perf_adq.sh@76 -- # count=4 00:21:45.046 20:22:49 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:45.046 20:22:49 -- target/perf_adq.sh@81 -- # wait 3216299 00:21:53.220 Initializing NVMe Controllers 00:21:53.220 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:53.220 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:53.220 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:53.220 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:53.220 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:53.220 Initialization complete. Launching workers. 00:21:53.220 ======================================================== 00:21:53.220 Latency(us) 00:21:53.220 Device Information : IOPS MiB/s Average min max 00:21:53.220 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11024.10 43.06 5806.86 1610.60 9522.00 00:21:53.220 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10688.00 41.75 5988.02 1446.59 9767.04 00:21:53.220 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11478.80 44.84 5577.94 1513.44 9384.20 00:21:53.220 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10970.80 42.85 5835.25 1846.87 9795.52 00:21:53.220 ======================================================== 00:21:53.220 Total : 44161.70 172.51 5798.25 1446.59 9795.52 00:21:53.220 00:21:53.220 20:22:58 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:53.220 20:22:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:53.220 20:22:58 -- nvmf/common.sh@116 -- # sync 00:21:53.220 20:22:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:53.220 20:22:58 -- nvmf/common.sh@119 -- # set +e 00:21:53.220 20:22:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:53.220 20:22:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:53.220 rmmod nvme_tcp 00:21:53.220 rmmod nvme_fabrics 00:21:53.220 rmmod nvme_keyring 00:21:53.220 20:22:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:53.220 20:22:58 -- nvmf/common.sh@123 -- # set -e 00:21:53.220 20:22:58 -- nvmf/common.sh@124 -- # return 0 00:21:53.220 20:22:58 -- nvmf/common.sh@477 -- # '[' -n 3216269 ']' 00:21:53.220 20:22:58 -- nvmf/common.sh@478 -- # killprocess 3216269 00:21:53.220 20:22:58 -- common/autotest_common.sh@936 -- # '[' -z 3216269 ']' 00:21:53.220 20:22:58 -- common/autotest_common.sh@940 -- # kill -0 3216269 00:21:53.220 20:22:58 -- common/autotest_common.sh@941 -- # uname 00:21:53.220 20:22:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:53.220 20:22:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3216269 00:21:53.220 20:22:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:53.220 20:22:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:53.220 20:22:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3216269' 00:21:53.220 killing process with pid 3216269 00:21:53.220 20:22:58 -- common/autotest_common.sh@955 -- # kill 3216269 00:21:53.220 20:22:58 -- common/autotest_common.sh@960 -- # wait 3216269 00:21:53.479 20:22:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:53.479 20:22:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:53.479 20:22:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:53.479 20:22:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:53.479 20:22:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:53.479 20:22:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.479 20:22:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.479 20:22:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:56.016 20:23:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:56.016 20:23:00 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:56.016 20:23:00 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:56.274 20:23:01 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:58.810 20:23:03 -- target/perf_adq.sh@54 -- # sleep 5 00:22:04.087 20:23:08 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:04.087 20:23:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:04.087 20:23:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:04.087 20:23:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:04.087 20:23:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:04.087 20:23:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:04.087 20:23:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:04.087 20:23:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:04.087 20:23:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:04.087 20:23:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:04.087 20:23:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:04.087 20:23:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:04.087 20:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:04.087 20:23:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:04.087 20:23:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:04.087 20:23:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:04.087 20:23:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:04.087 20:23:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:04.087 20:23:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:04.087 20:23:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:04.087 20:23:08 -- nvmf/common.sh@294 -- # net_devs=() 00:22:04.088 20:23:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:04.088 20:23:08 -- nvmf/common.sh@295 -- # e810=() 00:22:04.088 20:23:08 -- nvmf/common.sh@295 -- # local -ga e810 00:22:04.088 20:23:08 -- nvmf/common.sh@296 -- # x722=() 00:22:04.088 20:23:08 -- nvmf/common.sh@296 -- # local -ga x722 00:22:04.088 20:23:08 -- nvmf/common.sh@297 -- # mlx=() 00:22:04.088 20:23:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:04.088 20:23:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:04.088 20:23:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:04.088 20:23:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:04.088 20:23:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:04.088 20:23:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:04.088 20:23:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:04.088 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:04.088 20:23:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:04.088 20:23:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:04.088 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:04.088 20:23:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:04.088 20:23:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:04.088 20:23:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:04.088 20:23:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:04.088 20:23:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:04.088 20:23:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:04.088 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:04.088 20:23:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:04.088 20:23:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:04.088 20:23:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:04.088 20:23:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:04.088 20:23:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:04.088 20:23:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:04.088 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:04.088 20:23:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:04.088 20:23:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:04.088 20:23:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:04.088 20:23:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:04.088 20:23:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:04.088 20:23:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:04.088 20:23:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:04.088 20:23:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:04.088 20:23:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:04.088 20:23:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:04.088 20:23:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:04.088 20:23:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:04.088 20:23:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:04.088 20:23:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:04.088 20:23:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:04.088 20:23:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:04.088 20:23:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:04.088 20:23:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:04.088 20:23:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:04.088 20:23:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:04.088 20:23:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:04.088 20:23:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:04.088 20:23:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:04.088 20:23:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:04.088 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:04.088 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:22:04.088 00:22:04.088 --- 10.0.0.2 ping statistics --- 00:22:04.088 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:04.088 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:22:04.088 20:23:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:04.088 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:04.088 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.219 ms 00:22:04.088 00:22:04.088 --- 10.0.0.1 ping statistics --- 00:22:04.088 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:04.088 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:22:04.088 20:23:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:04.088 20:23:08 -- nvmf/common.sh@410 -- # return 0 00:22:04.088 20:23:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:04.088 20:23:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:04.088 20:23:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:04.088 20:23:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:04.088 20:23:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:04.088 20:23:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:04.088 20:23:08 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:04.088 20:23:08 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:04.088 20:23:08 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:04.088 20:23:08 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:04.088 net.core.busy_poll = 1 00:22:04.088 20:23:08 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:04.088 net.core.busy_read = 1 00:22:04.088 20:23:08 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:04.088 20:23:08 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:04.088 20:23:08 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:04.088 20:23:08 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:04.088 20:23:08 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:04.088 20:23:08 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:04.088 20:23:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:04.088 20:23:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:04.088 20:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:04.088 20:23:08 -- nvmf/common.sh@469 -- # nvmfpid=3219118 00:22:04.088 20:23:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:04.088 20:23:08 -- nvmf/common.sh@470 -- # waitforlisten 3219118 00:22:04.088 20:23:08 -- common/autotest_common.sh@829 -- # '[' -z 3219118 ']' 00:22:04.088 20:23:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:04.088 20:23:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:04.088 20:23:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:04.088 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:04.088 20:23:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:04.088 20:23:08 -- common/autotest_common.sh@10 -- # set +x 00:22:04.088 [2024-11-20 20:23:08.837253] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:04.088 [2024-11-20 20:23:08.837339] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:04.088 EAL: No free 2048 kB hugepages reported on node 1 00:22:04.088 [2024-11-20 20:23:08.906104] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:04.088 [2024-11-20 20:23:09.020747] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:04.088 [2024-11-20 20:23:09.020913] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:04.088 [2024-11-20 20:23:09.020932] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:04.088 [2024-11-20 20:23:09.020946] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:04.088 [2024-11-20 20:23:09.021031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:04.088 [2024-11-20 20:23:09.021098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:04.088 [2024-11-20 20:23:09.021144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:04.088 [2024-11-20 20:23:09.021147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:04.088 20:23:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:04.088 20:23:09 -- common/autotest_common.sh@862 -- # return 0 00:22:04.088 20:23:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:04.088 20:23:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:04.088 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.088 20:23:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:04.088 20:23:09 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:04.088 20:23:09 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:04.088 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.088 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.088 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.088 20:23:09 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:04.088 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.088 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.347 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.347 20:23:09 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:04.347 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.347 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.347 [2024-11-20 20:23:09.198097] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:04.347 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.347 20:23:09 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:04.347 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.347 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.347 Malloc1 00:22:04.347 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.347 20:23:09 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:04.347 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.347 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.347 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.347 20:23:09 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:04.347 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.347 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.347 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.347 20:23:09 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:04.347 20:23:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.347 20:23:09 -- common/autotest_common.sh@10 -- # set +x 00:22:04.347 [2024-11-20 20:23:09.251666] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:04.347 20:23:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.347 20:23:09 -- target/perf_adq.sh@94 -- # perfpid=3219143 00:22:04.347 20:23:09 -- target/perf_adq.sh@95 -- # sleep 2 00:22:04.347 20:23:09 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:04.347 EAL: No free 2048 kB hugepages reported on node 1 00:22:06.248 20:23:11 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:06.248 20:23:11 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:06.248 20:23:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:06.248 20:23:11 -- target/perf_adq.sh@97 -- # wc -l 00:22:06.248 20:23:11 -- common/autotest_common.sh@10 -- # set +x 00:22:06.248 20:23:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:06.506 20:23:11 -- target/perf_adq.sh@97 -- # count=2 00:22:06.506 20:23:11 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:06.506 20:23:11 -- target/perf_adq.sh@103 -- # wait 3219143 00:22:14.625 Initializing NVMe Controllers 00:22:14.625 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:14.625 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:14.625 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:14.625 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:14.625 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:14.625 Initialization complete. Launching workers. 00:22:14.625 ======================================================== 00:22:14.625 Latency(us) 00:22:14.625 Device Information : IOPS MiB/s Average min max 00:22:14.625 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5228.48 20.42 12243.10 1393.28 60085.19 00:22:14.625 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5025.68 19.63 12774.74 1789.84 58434.12 00:22:14.625 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 14720.73 57.50 4361.04 1118.86 45592.71 00:22:14.625 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5121.18 20.00 12501.35 1213.45 60023.42 00:22:14.625 ======================================================== 00:22:14.625 Total : 30096.06 117.56 8520.51 1118.86 60085.19 00:22:14.625 00:22:14.625 20:23:19 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:14.625 20:23:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.625 20:23:19 -- nvmf/common.sh@116 -- # sync 00:22:14.625 20:23:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.625 20:23:19 -- nvmf/common.sh@119 -- # set +e 00:22:14.625 20:23:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.625 20:23:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.625 rmmod nvme_tcp 00:22:14.625 rmmod nvme_fabrics 00:22:14.625 rmmod nvme_keyring 00:22:14.625 20:23:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.625 20:23:19 -- nvmf/common.sh@123 -- # set -e 00:22:14.625 20:23:19 -- nvmf/common.sh@124 -- # return 0 00:22:14.625 20:23:19 -- nvmf/common.sh@477 -- # '[' -n 3219118 ']' 00:22:14.625 20:23:19 -- nvmf/common.sh@478 -- # killprocess 3219118 00:22:14.625 20:23:19 -- common/autotest_common.sh@936 -- # '[' -z 3219118 ']' 00:22:14.625 20:23:19 -- common/autotest_common.sh@940 -- # kill -0 3219118 00:22:14.625 20:23:19 -- common/autotest_common.sh@941 -- # uname 00:22:14.625 20:23:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.625 20:23:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3219118 00:22:14.625 20:23:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.625 20:23:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.625 20:23:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3219118' 00:22:14.625 killing process with pid 3219118 00:22:14.625 20:23:19 -- common/autotest_common.sh@955 -- # kill 3219118 00:22:14.625 20:23:19 -- common/autotest_common.sh@960 -- # wait 3219118 00:22:14.883 20:23:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:14.883 20:23:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:14.883 20:23:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:14.883 20:23:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:14.883 20:23:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:14.883 20:23:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:14.883 20:23:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:14.883 20:23:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.420 20:23:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.420 20:23:21 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:17.420 00:22:17.420 real 0m44.704s 00:22:17.420 user 2m36.382s 00:22:17.420 sys 0m10.784s 00:22:17.420 20:23:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:17.420 20:23:21 -- common/autotest_common.sh@10 -- # set +x 00:22:17.420 ************************************ 00:22:17.420 END TEST nvmf_perf_adq 00:22:17.420 ************************************ 00:22:17.420 20:23:21 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:17.420 20:23:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:17.420 20:23:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.420 20:23:21 -- common/autotest_common.sh@10 -- # set +x 00:22:17.420 ************************************ 00:22:17.420 START TEST nvmf_shutdown 00:22:17.420 ************************************ 00:22:17.420 20:23:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:17.420 * Looking for test storage... 00:22:17.420 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:17.420 20:23:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:17.420 20:23:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:17.420 20:23:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:17.420 20:23:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:17.420 20:23:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:17.420 20:23:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:17.420 20:23:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:17.420 20:23:22 -- scripts/common.sh@335 -- # IFS=.-: 00:22:17.420 20:23:22 -- scripts/common.sh@335 -- # read -ra ver1 00:22:17.420 20:23:22 -- scripts/common.sh@336 -- # IFS=.-: 00:22:17.420 20:23:22 -- scripts/common.sh@336 -- # read -ra ver2 00:22:17.420 20:23:22 -- scripts/common.sh@337 -- # local 'op=<' 00:22:17.420 20:23:22 -- scripts/common.sh@339 -- # ver1_l=2 00:22:17.420 20:23:22 -- scripts/common.sh@340 -- # ver2_l=1 00:22:17.420 20:23:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:17.420 20:23:22 -- scripts/common.sh@343 -- # case "$op" in 00:22:17.420 20:23:22 -- scripts/common.sh@344 -- # : 1 00:22:17.420 20:23:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:17.420 20:23:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:17.420 20:23:22 -- scripts/common.sh@364 -- # decimal 1 00:22:17.420 20:23:22 -- scripts/common.sh@352 -- # local d=1 00:22:17.420 20:23:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:17.420 20:23:22 -- scripts/common.sh@354 -- # echo 1 00:22:17.420 20:23:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:17.420 20:23:22 -- scripts/common.sh@365 -- # decimal 2 00:22:17.421 20:23:22 -- scripts/common.sh@352 -- # local d=2 00:22:17.421 20:23:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:17.421 20:23:22 -- scripts/common.sh@354 -- # echo 2 00:22:17.421 20:23:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:17.421 20:23:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:17.421 20:23:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:17.421 20:23:22 -- scripts/common.sh@367 -- # return 0 00:22:17.421 20:23:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:17.421 20:23:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:17.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.421 --rc genhtml_branch_coverage=1 00:22:17.421 --rc genhtml_function_coverage=1 00:22:17.421 --rc genhtml_legend=1 00:22:17.421 --rc geninfo_all_blocks=1 00:22:17.421 --rc geninfo_unexecuted_blocks=1 00:22:17.421 00:22:17.421 ' 00:22:17.421 20:23:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:17.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.421 --rc genhtml_branch_coverage=1 00:22:17.421 --rc genhtml_function_coverage=1 00:22:17.421 --rc genhtml_legend=1 00:22:17.421 --rc geninfo_all_blocks=1 00:22:17.421 --rc geninfo_unexecuted_blocks=1 00:22:17.421 00:22:17.421 ' 00:22:17.421 20:23:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:17.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.421 --rc genhtml_branch_coverage=1 00:22:17.421 --rc genhtml_function_coverage=1 00:22:17.421 --rc genhtml_legend=1 00:22:17.421 --rc geninfo_all_blocks=1 00:22:17.421 --rc geninfo_unexecuted_blocks=1 00:22:17.421 00:22:17.421 ' 00:22:17.421 20:23:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:17.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.421 --rc genhtml_branch_coverage=1 00:22:17.421 --rc genhtml_function_coverage=1 00:22:17.421 --rc genhtml_legend=1 00:22:17.421 --rc geninfo_all_blocks=1 00:22:17.421 --rc geninfo_unexecuted_blocks=1 00:22:17.421 00:22:17.421 ' 00:22:17.421 20:23:22 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:17.421 20:23:22 -- nvmf/common.sh@7 -- # uname -s 00:22:17.421 20:23:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:17.421 20:23:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:17.421 20:23:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:17.421 20:23:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:17.421 20:23:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:17.421 20:23:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:17.421 20:23:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:17.421 20:23:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:17.421 20:23:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:17.421 20:23:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:17.421 20:23:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.421 20:23:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.421 20:23:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:17.421 20:23:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:17.421 20:23:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:17.421 20:23:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:17.421 20:23:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:17.421 20:23:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:17.421 20:23:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:17.421 20:23:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.421 20:23:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.421 20:23:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.421 20:23:22 -- paths/export.sh@5 -- # export PATH 00:22:17.421 20:23:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.421 20:23:22 -- nvmf/common.sh@46 -- # : 0 00:22:17.421 20:23:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:17.421 20:23:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:17.421 20:23:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:17.421 20:23:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:17.421 20:23:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:17.421 20:23:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:17.421 20:23:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:17.421 20:23:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:17.421 20:23:22 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:17.421 20:23:22 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:17.421 20:23:22 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:17.421 20:23:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:17.421 20:23:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.421 20:23:22 -- common/autotest_common.sh@10 -- # set +x 00:22:17.421 ************************************ 00:22:17.421 START TEST nvmf_shutdown_tc1 00:22:17.421 ************************************ 00:22:17.421 20:23:22 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:17.421 20:23:22 -- target/shutdown.sh@74 -- # starttarget 00:22:17.421 20:23:22 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:17.421 20:23:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.421 20:23:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.421 20:23:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.421 20:23:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.421 20:23:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.421 20:23:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.421 20:23:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.421 20:23:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.421 20:23:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.421 20:23:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.421 20:23:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.421 20:23:22 -- common/autotest_common.sh@10 -- # set +x 00:22:19.327 20:23:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:19.327 20:23:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:19.327 20:23:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:19.327 20:23:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:19.327 20:23:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:19.327 20:23:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:19.327 20:23:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:19.327 20:23:23 -- nvmf/common.sh@294 -- # net_devs=() 00:22:19.327 20:23:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:19.327 20:23:23 -- nvmf/common.sh@295 -- # e810=() 00:22:19.327 20:23:23 -- nvmf/common.sh@295 -- # local -ga e810 00:22:19.327 20:23:23 -- nvmf/common.sh@296 -- # x722=() 00:22:19.327 20:23:23 -- nvmf/common.sh@296 -- # local -ga x722 00:22:19.327 20:23:23 -- nvmf/common.sh@297 -- # mlx=() 00:22:19.327 20:23:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:19.327 20:23:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:19.327 20:23:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:19.327 20:23:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:19.327 20:23:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:19.327 20:23:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.327 20:23:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:19.327 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:19.327 20:23:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.327 20:23:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:19.327 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:19.327 20:23:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:19.327 20:23:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.327 20:23:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.327 20:23:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.327 20:23:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.327 20:23:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:19.327 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:19.327 20:23:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.327 20:23:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.327 20:23:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.327 20:23:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.327 20:23:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.327 20:23:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:19.327 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:19.327 20:23:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.327 20:23:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:19.327 20:23:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:19.327 20:23:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:19.327 20:23:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:19.327 20:23:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:19.327 20:23:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:19.327 20:23:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:19.327 20:23:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:19.327 20:23:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:19.327 20:23:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:19.327 20:23:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:19.327 20:23:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:19.327 20:23:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:19.327 20:23:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:19.327 20:23:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:19.327 20:23:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:19.327 20:23:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:19.327 20:23:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:19.327 20:23:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:19.327 20:23:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:19.327 20:23:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:19.327 20:23:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:19.327 20:23:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:19.327 20:23:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:19.327 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:19.327 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:22:19.327 00:22:19.327 --- 10.0.0.2 ping statistics --- 00:22:19.327 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.327 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:22:19.327 20:23:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:19.327 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:19.327 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:22:19.327 00:22:19.327 --- 10.0.0.1 ping statistics --- 00:22:19.327 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.327 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:22:19.327 20:23:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:19.327 20:23:24 -- nvmf/common.sh@410 -- # return 0 00:22:19.327 20:23:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:19.327 20:23:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:19.327 20:23:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:19.327 20:23:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:19.327 20:23:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:19.327 20:23:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:19.327 20:23:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:19.327 20:23:24 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:19.327 20:23:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:19.327 20:23:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:19.327 20:23:24 -- common/autotest_common.sh@10 -- # set +x 00:22:19.327 20:23:24 -- nvmf/common.sh@469 -- # nvmfpid=3222359 00:22:19.327 20:23:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:19.327 20:23:24 -- nvmf/common.sh@470 -- # waitforlisten 3222359 00:22:19.327 20:23:24 -- common/autotest_common.sh@829 -- # '[' -z 3222359 ']' 00:22:19.327 20:23:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:19.328 20:23:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:19.328 20:23:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:19.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:19.328 20:23:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:19.328 20:23:24 -- common/autotest_common.sh@10 -- # set +x 00:22:19.328 [2024-11-20 20:23:24.168676] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:19.328 [2024-11-20 20:23:24.168753] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:19.328 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.328 [2024-11-20 20:23:24.237297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:19.328 [2024-11-20 20:23:24.355105] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:19.328 [2024-11-20 20:23:24.355251] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:19.328 [2024-11-20 20:23:24.355269] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:19.328 [2024-11-20 20:23:24.355281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:19.328 [2024-11-20 20:23:24.355748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:19.328 [2024-11-20 20:23:24.355803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:19.328 [2024-11-20 20:23:24.355869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:19.328 [2024-11-20 20:23:24.355872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:20.263 20:23:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:20.263 20:23:25 -- common/autotest_common.sh@862 -- # return 0 00:22:20.263 20:23:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:20.263 20:23:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.263 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:22:20.263 20:23:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:20.263 20:23:25 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:20.263 20:23:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.263 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:22:20.263 [2024-11-20 20:23:25.170598] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:20.263 20:23:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.263 20:23:25 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:20.263 20:23:25 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:20.263 20:23:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:20.263 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:22:20.263 20:23:25 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.263 20:23:25 -- target/shutdown.sh@28 -- # cat 00:22:20.263 20:23:25 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:20.263 20:23:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.263 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:22:20.263 Malloc1 00:22:20.263 [2024-11-20 20:23:25.259948] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:20.263 Malloc2 00:22:20.523 Malloc3 00:22:20.523 Malloc4 00:22:20.523 Malloc5 00:22:20.523 Malloc6 00:22:20.523 Malloc7 00:22:20.783 Malloc8 00:22:20.783 Malloc9 00:22:20.783 Malloc10 00:22:20.783 20:23:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.783 20:23:25 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:20.783 20:23:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.783 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:22:20.783 20:23:25 -- target/shutdown.sh@78 -- # perfpid=3222670 00:22:20.783 20:23:25 -- target/shutdown.sh@79 -- # waitforlisten 3222670 /var/tmp/bdevperf.sock 00:22:20.783 20:23:25 -- common/autotest_common.sh@829 -- # '[' -z 3222670 ']' 00:22:20.783 20:23:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:20.783 20:23:25 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:20.783 20:23:25 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:20.783 20:23:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:20.783 20:23:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:20.783 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:20.783 20:23:25 -- nvmf/common.sh@520 -- # config=() 00:22:20.783 20:23:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:20.783 20:23:25 -- nvmf/common.sh@520 -- # local subsystem config 00:22:20.783 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.783 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.783 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.783 { 00:22:20.783 "params": { 00:22:20.783 "name": "Nvme$subsystem", 00:22:20.783 "trtype": "$TEST_TRANSPORT", 00:22:20.783 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.783 "adrfam": "ipv4", 00:22:20.783 "trsvcid": "$NVMF_PORT", 00:22:20.783 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.783 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.783 "hdgst": ${hdgst:-false}, 00:22:20.783 "ddgst": ${ddgst:-false} 00:22:20.783 }, 00:22:20.783 "method": "bdev_nvme_attach_controller" 00:22:20.783 } 00:22:20.783 EOF 00:22:20.783 )") 00:22:20.784 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.784 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.784 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.784 { 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme$subsystem", 00:22:20.784 "trtype": "$TEST_TRANSPORT", 00:22:20.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "$NVMF_PORT", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.784 "hdgst": ${hdgst:-false}, 00:22:20.784 "ddgst": ${ddgst:-false} 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 } 00:22:20.784 EOF 00:22:20.784 )") 00:22:20.784 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.784 20:23:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.784 20:23:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.784 { 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme$subsystem", 00:22:20.784 "trtype": "$TEST_TRANSPORT", 00:22:20.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "$NVMF_PORT", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.784 "hdgst": ${hdgst:-false}, 00:22:20.784 "ddgst": ${ddgst:-false} 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 } 00:22:20.784 EOF 00:22:20.784 )") 00:22:20.784 20:23:25 -- nvmf/common.sh@542 -- # cat 00:22:20.784 20:23:25 -- nvmf/common.sh@544 -- # jq . 00:22:20.784 20:23:25 -- nvmf/common.sh@545 -- # IFS=, 00:22:20.784 20:23:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme1", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme2", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme3", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme4", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme5", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme6", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme7", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme8", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme9", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 },{ 00:22:20.784 "params": { 00:22:20.784 "name": "Nvme10", 00:22:20.784 "trtype": "tcp", 00:22:20.784 "traddr": "10.0.0.2", 00:22:20.784 "adrfam": "ipv4", 00:22:20.784 "trsvcid": "4420", 00:22:20.784 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:20.784 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:20.784 "hdgst": false, 00:22:20.784 "ddgst": false 00:22:20.784 }, 00:22:20.784 "method": "bdev_nvme_attach_controller" 00:22:20.784 }' 00:22:20.784 [2024-11-20 20:23:25.773260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:20.784 [2024-11-20 20:23:25.773340] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:20.784 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.043 [2024-11-20 20:23:25.835760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:21.043 [2024-11-20 20:23:25.944913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:22.942 20:23:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:22.942 20:23:27 -- common/autotest_common.sh@862 -- # return 0 00:22:22.942 20:23:27 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:22.942 20:23:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:22.942 20:23:27 -- common/autotest_common.sh@10 -- # set +x 00:22:22.942 20:23:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:22.942 20:23:27 -- target/shutdown.sh@83 -- # kill -9 3222670 00:22:22.942 20:23:27 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:22.942 20:23:27 -- target/shutdown.sh@87 -- # sleep 1 00:22:23.879 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3222670 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:23.879 20:23:28 -- target/shutdown.sh@88 -- # kill -0 3222359 00:22:23.879 20:23:28 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:23.879 20:23:28 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:23.879 20:23:28 -- nvmf/common.sh@520 -- # config=() 00:22:23.879 20:23:28 -- nvmf/common.sh@520 -- # local subsystem config 00:22:23.879 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.879 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.879 { 00:22:23.879 "params": { 00:22:23.879 "name": "Nvme$subsystem", 00:22:23.879 "trtype": "$TEST_TRANSPORT", 00:22:23.879 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.879 "adrfam": "ipv4", 00:22:23.879 "trsvcid": "$NVMF_PORT", 00:22:23.879 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.879 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.879 "hdgst": ${hdgst:-false}, 00:22:23.879 "ddgst": ${ddgst:-false} 00:22:23.879 }, 00:22:23.879 "method": "bdev_nvme_attach_controller" 00:22:23.879 } 00:22:23.879 EOF 00:22:23.879 )") 00:22:23.879 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.879 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.879 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.879 { 00:22:23.879 "params": { 00:22:23.879 "name": "Nvme$subsystem", 00:22:23.879 "trtype": "$TEST_TRANSPORT", 00:22:23.879 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.879 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.880 { 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme$subsystem", 00:22:23.880 "trtype": "$TEST_TRANSPORT", 00:22:23.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "$NVMF_PORT", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.880 "hdgst": ${hdgst:-false}, 00:22:23.880 "ddgst": ${ddgst:-false} 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 } 00:22:23.880 EOF 00:22:23.880 )") 00:22:23.880 20:23:28 -- nvmf/common.sh@542 -- # cat 00:22:23.880 20:23:28 -- nvmf/common.sh@544 -- # jq . 00:22:23.880 20:23:28 -- nvmf/common.sh@545 -- # IFS=, 00:22:23.880 20:23:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme1", 00:22:23.880 "trtype": "tcp", 00:22:23.880 "traddr": "10.0.0.2", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "4420", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:23.880 "hdgst": false, 00:22:23.880 "ddgst": false 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 },{ 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme2", 00:22:23.880 "trtype": "tcp", 00:22:23.880 "traddr": "10.0.0.2", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "4420", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:23.880 "hdgst": false, 00:22:23.880 "ddgst": false 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 },{ 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme3", 00:22:23.880 "trtype": "tcp", 00:22:23.880 "traddr": "10.0.0.2", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "4420", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:23.880 "hdgst": false, 00:22:23.880 "ddgst": false 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 },{ 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme4", 00:22:23.880 "trtype": "tcp", 00:22:23.880 "traddr": "10.0.0.2", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "4420", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:23.880 "hdgst": false, 00:22:23.880 "ddgst": false 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 },{ 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme5", 00:22:23.880 "trtype": "tcp", 00:22:23.880 "traddr": "10.0.0.2", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "4420", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:23.880 "hdgst": false, 00:22:23.880 "ddgst": false 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.880 },{ 00:22:23.880 "params": { 00:22:23.880 "name": "Nvme6", 00:22:23.880 "trtype": "tcp", 00:22:23.880 "traddr": "10.0.0.2", 00:22:23.880 "adrfam": "ipv4", 00:22:23.880 "trsvcid": "4420", 00:22:23.880 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:23.880 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:23.880 "hdgst": false, 00:22:23.880 "ddgst": false 00:22:23.880 }, 00:22:23.880 "method": "bdev_nvme_attach_controller" 00:22:23.881 },{ 00:22:23.881 "params": { 00:22:23.881 "name": "Nvme7", 00:22:23.881 "trtype": "tcp", 00:22:23.881 "traddr": "10.0.0.2", 00:22:23.881 "adrfam": "ipv4", 00:22:23.881 "trsvcid": "4420", 00:22:23.881 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:23.881 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:23.881 "hdgst": false, 00:22:23.881 "ddgst": false 00:22:23.881 }, 00:22:23.881 "method": "bdev_nvme_attach_controller" 00:22:23.881 },{ 00:22:23.881 "params": { 00:22:23.881 "name": "Nvme8", 00:22:23.881 "trtype": "tcp", 00:22:23.881 "traddr": "10.0.0.2", 00:22:23.881 "adrfam": "ipv4", 00:22:23.881 "trsvcid": "4420", 00:22:23.881 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:23.881 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:23.881 "hdgst": false, 00:22:23.881 "ddgst": false 00:22:23.881 }, 00:22:23.881 "method": "bdev_nvme_attach_controller" 00:22:23.881 },{ 00:22:23.881 "params": { 00:22:23.881 "name": "Nvme9", 00:22:23.881 "trtype": "tcp", 00:22:23.881 "traddr": "10.0.0.2", 00:22:23.881 "adrfam": "ipv4", 00:22:23.881 "trsvcid": "4420", 00:22:23.881 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:23.881 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:23.881 "hdgst": false, 00:22:23.881 "ddgst": false 00:22:23.881 }, 00:22:23.881 "method": "bdev_nvme_attach_controller" 00:22:23.881 },{ 00:22:23.881 "params": { 00:22:23.881 "name": "Nvme10", 00:22:23.881 "trtype": "tcp", 00:22:23.881 "traddr": "10.0.0.2", 00:22:23.881 "adrfam": "ipv4", 00:22:23.881 "trsvcid": "4420", 00:22:23.881 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:23.881 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:23.881 "hdgst": false, 00:22:23.881 "ddgst": false 00:22:23.881 }, 00:22:23.881 "method": "bdev_nvme_attach_controller" 00:22:23.881 }' 00:22:23.881 [2024-11-20 20:23:28.619172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:23.881 [2024-11-20 20:23:28.619258] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3222985 ] 00:22:23.881 EAL: No free 2048 kB hugepages reported on node 1 00:22:23.881 [2024-11-20 20:23:28.684654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:23.881 [2024-11-20 20:23:28.796729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:25.258 Running I/O for 1 seconds... 00:22:26.668 00:22:26.668 Latency(us) 00:22:26.668 [2024-11-20T19:23:31.707Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:26.668 [2024-11-20T19:23:31.707Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.668 Verification LBA range: start 0x0 length 0x400 00:22:26.668 Nvme1n1 : 1.07 373.64 23.35 0.00 0.00 167946.91 11505.21 170879.05 00:22:26.668 [2024-11-20T19:23:31.707Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.668 Verification LBA range: start 0x0 length 0x400 00:22:26.668 Nvme2n1 : 1.09 398.70 24.92 0.00 0.00 156722.54 17282.09 126605.84 00:22:26.668 [2024-11-20T19:23:31.707Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.668 Verification LBA range: start 0x0 length 0x400 00:22:26.668 Nvme3n1 : 1.09 396.57 24.79 0.00 0.00 156286.08 19126.80 120392.06 00:22:26.668 [2024-11-20T19:23:31.707Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.668 Verification LBA range: start 0x0 length 0x400 00:22:26.668 Nvme4n1 : 1.10 394.86 24.68 0.00 0.00 155690.56 19806.44 124275.67 00:22:26.668 [2024-11-20T19:23:31.707Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.668 Verification LBA range: start 0x0 length 0x400 00:22:26.668 Nvme5n1 : 1.11 390.98 24.44 0.00 0.00 156584.96 17379.18 125052.40 00:22:26.668 [2024-11-20T19:23:31.707Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.669 Verification LBA range: start 0x0 length 0x400 00:22:26.669 Nvme6n1 : 1.10 393.13 24.57 0.00 0.00 154224.81 20680.25 118838.61 00:22:26.669 [2024-11-20T19:23:31.708Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.669 Verification LBA range: start 0x0 length 0x400 00:22:26.669 Nvme7n1 : 1.11 392.40 24.53 0.00 0.00 153633.32 19515.16 123498.95 00:22:26.669 [2024-11-20T19:23:31.708Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.669 Verification LBA range: start 0x0 length 0x400 00:22:26.669 Nvme8n1 : 1.11 391.56 24.47 0.00 0.00 153091.49 17670.45 127382.57 00:22:26.669 [2024-11-20T19:23:31.708Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.669 Verification LBA range: start 0x0 length 0x400 00:22:26.669 Nvme9n1 : 1.11 396.95 24.81 0.00 0.00 150067.88 11553.75 127382.57 00:22:26.669 [2024-11-20T19:23:31.708Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:26.669 Verification LBA range: start 0x0 length 0x400 00:22:26.669 Nvme10n1 : 1.11 390.36 24.40 0.00 0.00 151871.82 14854.83 129712.73 00:22:26.669 [2024-11-20T19:23:31.708Z] =================================================================================================================== 00:22:26.669 [2024-11-20T19:23:31.708Z] Total : 3919.15 244.95 0.00 0.00 155507.42 11505.21 170879.05 00:22:26.669 20:23:31 -- target/shutdown.sh@93 -- # stoptarget 00:22:26.669 20:23:31 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:26.669 20:23:31 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:26.669 20:23:31 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:26.669 20:23:31 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:26.669 20:23:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:26.669 20:23:31 -- nvmf/common.sh@116 -- # sync 00:22:26.669 20:23:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:26.669 20:23:31 -- nvmf/common.sh@119 -- # set +e 00:22:26.669 20:23:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:26.669 20:23:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:26.669 rmmod nvme_tcp 00:22:26.669 rmmod nvme_fabrics 00:22:26.669 rmmod nvme_keyring 00:22:26.929 20:23:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:26.929 20:23:31 -- nvmf/common.sh@123 -- # set -e 00:22:26.929 20:23:31 -- nvmf/common.sh@124 -- # return 0 00:22:26.929 20:23:31 -- nvmf/common.sh@477 -- # '[' -n 3222359 ']' 00:22:26.929 20:23:31 -- nvmf/common.sh@478 -- # killprocess 3222359 00:22:26.929 20:23:31 -- common/autotest_common.sh@936 -- # '[' -z 3222359 ']' 00:22:26.929 20:23:31 -- common/autotest_common.sh@940 -- # kill -0 3222359 00:22:26.929 20:23:31 -- common/autotest_common.sh@941 -- # uname 00:22:26.929 20:23:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:26.929 20:23:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3222359 00:22:26.929 20:23:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:26.929 20:23:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:26.929 20:23:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3222359' 00:22:26.929 killing process with pid 3222359 00:22:26.929 20:23:31 -- common/autotest_common.sh@955 -- # kill 3222359 00:22:26.929 20:23:31 -- common/autotest_common.sh@960 -- # wait 3222359 00:22:27.498 20:23:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:27.498 20:23:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:27.498 20:23:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:27.498 20:23:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:27.498 20:23:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:27.498 20:23:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:27.498 20:23:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:27.498 20:23:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.403 20:23:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:29.403 00:22:29.403 real 0m12.281s 00:22:29.403 user 0m36.450s 00:22:29.403 sys 0m3.207s 00:22:29.403 20:23:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:29.403 20:23:34 -- common/autotest_common.sh@10 -- # set +x 00:22:29.403 ************************************ 00:22:29.403 END TEST nvmf_shutdown_tc1 00:22:29.403 ************************************ 00:22:29.403 20:23:34 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:29.403 20:23:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:29.403 20:23:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:29.403 20:23:34 -- common/autotest_common.sh@10 -- # set +x 00:22:29.403 ************************************ 00:22:29.403 START TEST nvmf_shutdown_tc2 00:22:29.403 ************************************ 00:22:29.403 20:23:34 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:29.403 20:23:34 -- target/shutdown.sh@98 -- # starttarget 00:22:29.403 20:23:34 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:29.403 20:23:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:29.403 20:23:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:29.403 20:23:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:29.403 20:23:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:29.403 20:23:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:29.403 20:23:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.403 20:23:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.403 20:23:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.403 20:23:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:29.403 20:23:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:29.403 20:23:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:29.403 20:23:34 -- common/autotest_common.sh@10 -- # set +x 00:22:29.403 20:23:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:29.403 20:23:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:29.403 20:23:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:29.403 20:23:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:29.403 20:23:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:29.403 20:23:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:29.403 20:23:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:29.403 20:23:34 -- nvmf/common.sh@294 -- # net_devs=() 00:22:29.403 20:23:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:29.403 20:23:34 -- nvmf/common.sh@295 -- # e810=() 00:22:29.403 20:23:34 -- nvmf/common.sh@295 -- # local -ga e810 00:22:29.403 20:23:34 -- nvmf/common.sh@296 -- # x722=() 00:22:29.403 20:23:34 -- nvmf/common.sh@296 -- # local -ga x722 00:22:29.403 20:23:34 -- nvmf/common.sh@297 -- # mlx=() 00:22:29.403 20:23:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:29.403 20:23:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:29.403 20:23:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:29.403 20:23:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:29.403 20:23:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:29.403 20:23:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:29.403 20:23:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:29.403 20:23:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:29.404 20:23:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.404 20:23:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:29.404 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:29.404 20:23:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.404 20:23:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:29.404 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:29.404 20:23:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:29.404 20:23:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.404 20:23:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.404 20:23:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.404 20:23:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.404 20:23:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:29.404 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:29.404 20:23:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.404 20:23:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.404 20:23:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.404 20:23:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.404 20:23:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.404 20:23:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:29.404 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:29.404 20:23:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.404 20:23:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:29.404 20:23:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:29.404 20:23:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:29.404 20:23:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:29.404 20:23:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:29.404 20:23:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:29.404 20:23:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:29.404 20:23:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:29.404 20:23:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:29.404 20:23:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:29.404 20:23:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:29.404 20:23:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:29.404 20:23:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:29.404 20:23:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:29.404 20:23:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:29.404 20:23:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:29.404 20:23:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:29.404 20:23:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:29.404 20:23:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:29.662 20:23:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:29.662 20:23:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:29.662 20:23:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:29.662 20:23:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:29.662 20:23:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:29.662 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:29.662 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:22:29.662 00:22:29.662 --- 10.0.0.2 ping statistics --- 00:22:29.662 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.662 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:22:29.663 20:23:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:29.663 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:29.663 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:22:29.663 00:22:29.663 --- 10.0.0.1 ping statistics --- 00:22:29.663 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.663 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:22:29.663 20:23:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:29.663 20:23:34 -- nvmf/common.sh@410 -- # return 0 00:22:29.663 20:23:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:29.663 20:23:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:29.663 20:23:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:29.663 20:23:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:29.663 20:23:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:29.663 20:23:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:29.663 20:23:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:29.663 20:23:34 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:29.663 20:23:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:29.663 20:23:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:29.663 20:23:34 -- common/autotest_common.sh@10 -- # set +x 00:22:29.663 20:23:34 -- nvmf/common.sh@469 -- # nvmfpid=3223808 00:22:29.663 20:23:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:29.663 20:23:34 -- nvmf/common.sh@470 -- # waitforlisten 3223808 00:22:29.663 20:23:34 -- common/autotest_common.sh@829 -- # '[' -z 3223808 ']' 00:22:29.663 20:23:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:29.663 20:23:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:29.663 20:23:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:29.663 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:29.663 20:23:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:29.663 20:23:34 -- common/autotest_common.sh@10 -- # set +x 00:22:29.663 [2024-11-20 20:23:34.574627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:29.663 [2024-11-20 20:23:34.574701] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:29.663 EAL: No free 2048 kB hugepages reported on node 1 00:22:29.663 [2024-11-20 20:23:34.643299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:29.921 [2024-11-20 20:23:34.758288] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:29.921 [2024-11-20 20:23:34.758432] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:29.921 [2024-11-20 20:23:34.758449] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:29.921 [2024-11-20 20:23:34.758460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:29.921 [2024-11-20 20:23:34.760088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:29.921 [2024-11-20 20:23:34.760161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:29.921 [2024-11-20 20:23:34.760230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:29.921 [2024-11-20 20:23:34.760234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:30.860 20:23:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:30.860 20:23:35 -- common/autotest_common.sh@862 -- # return 0 00:22:30.860 20:23:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:30.860 20:23:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.860 20:23:35 -- common/autotest_common.sh@10 -- # set +x 00:22:30.860 20:23:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:30.860 20:23:35 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:30.860 20:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.860 20:23:35 -- common/autotest_common.sh@10 -- # set +x 00:22:30.860 [2024-11-20 20:23:35.559598] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:30.860 20:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.860 20:23:35 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:30.860 20:23:35 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:30.860 20:23:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:30.860 20:23:35 -- common/autotest_common.sh@10 -- # set +x 00:22:30.860 20:23:35 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.860 20:23:35 -- target/shutdown.sh@28 -- # cat 00:22:30.860 20:23:35 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:30.860 20:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.860 20:23:35 -- common/autotest_common.sh@10 -- # set +x 00:22:30.860 Malloc1 00:22:30.860 [2024-11-20 20:23:35.647728] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:30.860 Malloc2 00:22:30.860 Malloc3 00:22:30.860 Malloc4 00:22:30.860 Malloc5 00:22:30.860 Malloc6 00:22:31.120 Malloc7 00:22:31.120 Malloc8 00:22:31.120 Malloc9 00:22:31.120 Malloc10 00:22:31.120 20:23:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.120 20:23:36 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:31.120 20:23:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:31.120 20:23:36 -- common/autotest_common.sh@10 -- # set +x 00:22:31.120 20:23:36 -- target/shutdown.sh@102 -- # perfpid=3224080 00:22:31.120 20:23:36 -- target/shutdown.sh@103 -- # waitforlisten 3224080 /var/tmp/bdevperf.sock 00:22:31.120 20:23:36 -- common/autotest_common.sh@829 -- # '[' -z 3224080 ']' 00:22:31.120 20:23:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:31.120 20:23:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:31.120 20:23:36 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:31.120 20:23:36 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:31.120 20:23:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:31.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:31.120 20:23:36 -- nvmf/common.sh@520 -- # config=() 00:22:31.120 20:23:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:31.120 20:23:36 -- nvmf/common.sh@520 -- # local subsystem config 00:22:31.120 20:23:36 -- common/autotest_common.sh@10 -- # set +x 00:22:31.120 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.120 { 00:22:31.120 "params": { 00:22:31.120 "name": "Nvme$subsystem", 00:22:31.120 "trtype": "$TEST_TRANSPORT", 00:22:31.120 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.120 "adrfam": "ipv4", 00:22:31.120 "trsvcid": "$NVMF_PORT", 00:22:31.120 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.120 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.120 "hdgst": ${hdgst:-false}, 00:22:31.120 "ddgst": ${ddgst:-false} 00:22:31.120 }, 00:22:31.120 "method": "bdev_nvme_attach_controller" 00:22:31.120 } 00:22:31.120 EOF 00:22:31.120 )") 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.120 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.120 { 00:22:31.120 "params": { 00:22:31.120 "name": "Nvme$subsystem", 00:22:31.120 "trtype": "$TEST_TRANSPORT", 00:22:31.120 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.120 "adrfam": "ipv4", 00:22:31.120 "trsvcid": "$NVMF_PORT", 00:22:31.120 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.120 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.120 "hdgst": ${hdgst:-false}, 00:22:31.120 "ddgst": ${ddgst:-false} 00:22:31.120 }, 00:22:31.120 "method": "bdev_nvme_attach_controller" 00:22:31.120 } 00:22:31.120 EOF 00:22:31.120 )") 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.120 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.120 { 00:22:31.120 "params": { 00:22:31.120 "name": "Nvme$subsystem", 00:22:31.120 "trtype": "$TEST_TRANSPORT", 00:22:31.120 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.120 "adrfam": "ipv4", 00:22:31.120 "trsvcid": "$NVMF_PORT", 00:22:31.120 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.120 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.120 "hdgst": ${hdgst:-false}, 00:22:31.120 "ddgst": ${ddgst:-false} 00:22:31.120 }, 00:22:31.120 "method": "bdev_nvme_attach_controller" 00:22:31.120 } 00:22:31.120 EOF 00:22:31.120 )") 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.120 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.120 { 00:22:31.120 "params": { 00:22:31.120 "name": "Nvme$subsystem", 00:22:31.120 "trtype": "$TEST_TRANSPORT", 00:22:31.120 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.120 "adrfam": "ipv4", 00:22:31.120 "trsvcid": "$NVMF_PORT", 00:22:31.120 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.120 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.120 "hdgst": ${hdgst:-false}, 00:22:31.120 "ddgst": ${ddgst:-false} 00:22:31.120 }, 00:22:31.120 "method": "bdev_nvme_attach_controller" 00:22:31.120 } 00:22:31.120 EOF 00:22:31.120 )") 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.120 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.120 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.120 { 00:22:31.120 "params": { 00:22:31.120 "name": "Nvme$subsystem", 00:22:31.120 "trtype": "$TEST_TRANSPORT", 00:22:31.120 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.121 "adrfam": "ipv4", 00:22:31.121 "trsvcid": "$NVMF_PORT", 00:22:31.121 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.121 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.121 "hdgst": ${hdgst:-false}, 00:22:31.121 "ddgst": ${ddgst:-false} 00:22:31.121 }, 00:22:31.121 "method": "bdev_nvme_attach_controller" 00:22:31.121 } 00:22:31.121 EOF 00:22:31.121 )") 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.121 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.121 { 00:22:31.121 "params": { 00:22:31.121 "name": "Nvme$subsystem", 00:22:31.121 "trtype": "$TEST_TRANSPORT", 00:22:31.121 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.121 "adrfam": "ipv4", 00:22:31.121 "trsvcid": "$NVMF_PORT", 00:22:31.121 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.121 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.121 "hdgst": ${hdgst:-false}, 00:22:31.121 "ddgst": ${ddgst:-false} 00:22:31.121 }, 00:22:31.121 "method": "bdev_nvme_attach_controller" 00:22:31.121 } 00:22:31.121 EOF 00:22:31.121 )") 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.121 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.121 { 00:22:31.121 "params": { 00:22:31.121 "name": "Nvme$subsystem", 00:22:31.121 "trtype": "$TEST_TRANSPORT", 00:22:31.121 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.121 "adrfam": "ipv4", 00:22:31.121 "trsvcid": "$NVMF_PORT", 00:22:31.121 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.121 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.121 "hdgst": ${hdgst:-false}, 00:22:31.121 "ddgst": ${ddgst:-false} 00:22:31.121 }, 00:22:31.121 "method": "bdev_nvme_attach_controller" 00:22:31.121 } 00:22:31.121 EOF 00:22:31.121 )") 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.121 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.121 { 00:22:31.121 "params": { 00:22:31.121 "name": "Nvme$subsystem", 00:22:31.121 "trtype": "$TEST_TRANSPORT", 00:22:31.121 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.121 "adrfam": "ipv4", 00:22:31.121 "trsvcid": "$NVMF_PORT", 00:22:31.121 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.121 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.121 "hdgst": ${hdgst:-false}, 00:22:31.121 "ddgst": ${ddgst:-false} 00:22:31.121 }, 00:22:31.121 "method": "bdev_nvme_attach_controller" 00:22:31.121 } 00:22:31.121 EOF 00:22:31.121 )") 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.121 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.121 { 00:22:31.121 "params": { 00:22:31.121 "name": "Nvme$subsystem", 00:22:31.121 "trtype": "$TEST_TRANSPORT", 00:22:31.121 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.121 "adrfam": "ipv4", 00:22:31.121 "trsvcid": "$NVMF_PORT", 00:22:31.121 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.121 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.121 "hdgst": ${hdgst:-false}, 00:22:31.121 "ddgst": ${ddgst:-false} 00:22:31.121 }, 00:22:31.121 "method": "bdev_nvme_attach_controller" 00:22:31.121 } 00:22:31.121 EOF 00:22:31.121 )") 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.121 20:23:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.121 { 00:22:31.121 "params": { 00:22:31.121 "name": "Nvme$subsystem", 00:22:31.121 "trtype": "$TEST_TRANSPORT", 00:22:31.121 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.121 "adrfam": "ipv4", 00:22:31.121 "trsvcid": "$NVMF_PORT", 00:22:31.121 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.121 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.121 "hdgst": ${hdgst:-false}, 00:22:31.121 "ddgst": ${ddgst:-false} 00:22:31.121 }, 00:22:31.121 "method": "bdev_nvme_attach_controller" 00:22:31.121 } 00:22:31.121 EOF 00:22:31.121 )") 00:22:31.121 20:23:36 -- nvmf/common.sh@542 -- # cat 00:22:31.121 20:23:36 -- nvmf/common.sh@544 -- # jq . 00:22:31.121 20:23:36 -- nvmf/common.sh@545 -- # IFS=, 00:22:31.380 20:23:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme1", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme2", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme3", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme4", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme5", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme6", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.380 "name": "Nvme7", 00:22:31.380 "trtype": "tcp", 00:22:31.380 "traddr": "10.0.0.2", 00:22:31.380 "adrfam": "ipv4", 00:22:31.380 "trsvcid": "4420", 00:22:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:31.380 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:31.380 "hdgst": false, 00:22:31.380 "ddgst": false 00:22:31.380 }, 00:22:31.380 "method": "bdev_nvme_attach_controller" 00:22:31.380 },{ 00:22:31.380 "params": { 00:22:31.381 "name": "Nvme8", 00:22:31.381 "trtype": "tcp", 00:22:31.381 "traddr": "10.0.0.2", 00:22:31.381 "adrfam": "ipv4", 00:22:31.381 "trsvcid": "4420", 00:22:31.381 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:31.381 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:31.381 "hdgst": false, 00:22:31.381 "ddgst": false 00:22:31.381 }, 00:22:31.381 "method": "bdev_nvme_attach_controller" 00:22:31.381 },{ 00:22:31.381 "params": { 00:22:31.381 "name": "Nvme9", 00:22:31.381 "trtype": "tcp", 00:22:31.381 "traddr": "10.0.0.2", 00:22:31.381 "adrfam": "ipv4", 00:22:31.381 "trsvcid": "4420", 00:22:31.381 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:31.381 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:31.381 "hdgst": false, 00:22:31.381 "ddgst": false 00:22:31.381 }, 00:22:31.381 "method": "bdev_nvme_attach_controller" 00:22:31.381 },{ 00:22:31.381 "params": { 00:22:31.381 "name": "Nvme10", 00:22:31.381 "trtype": "tcp", 00:22:31.381 "traddr": "10.0.0.2", 00:22:31.381 "adrfam": "ipv4", 00:22:31.381 "trsvcid": "4420", 00:22:31.381 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:31.381 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:31.381 "hdgst": false, 00:22:31.381 "ddgst": false 00:22:31.381 }, 00:22:31.381 "method": "bdev_nvme_attach_controller" 00:22:31.381 }' 00:22:31.381 [2024-11-20 20:23:36.163534] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.381 [2024-11-20 20:23:36.163609] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3224080 ] 00:22:31.381 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.381 [2024-11-20 20:23:36.227552] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:31.381 [2024-11-20 20:23:36.336259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.282 Running I/O for 10 seconds... 00:22:33.850 20:23:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:33.850 20:23:38 -- common/autotest_common.sh@862 -- # return 0 00:22:33.850 20:23:38 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:33.850 20:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.850 20:23:38 -- common/autotest_common.sh@10 -- # set +x 00:22:33.850 20:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.850 20:23:38 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:33.850 20:23:38 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:33.850 20:23:38 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:33.850 20:23:38 -- target/shutdown.sh@57 -- # local ret=1 00:22:33.850 20:23:38 -- target/shutdown.sh@58 -- # local i 00:22:33.850 20:23:38 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:33.850 20:23:38 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:33.850 20:23:38 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:33.850 20:23:38 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:33.850 20:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.850 20:23:38 -- common/autotest_common.sh@10 -- # set +x 00:22:33.850 20:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.850 20:23:38 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:33.850 20:23:38 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:33.850 20:23:38 -- target/shutdown.sh@64 -- # ret=0 00:22:33.850 20:23:38 -- target/shutdown.sh@65 -- # break 00:22:33.850 20:23:38 -- target/shutdown.sh@69 -- # return 0 00:22:33.850 20:23:38 -- target/shutdown.sh@109 -- # killprocess 3224080 00:22:33.850 20:23:38 -- common/autotest_common.sh@936 -- # '[' -z 3224080 ']' 00:22:33.850 20:23:38 -- common/autotest_common.sh@940 -- # kill -0 3224080 00:22:33.850 20:23:38 -- common/autotest_common.sh@941 -- # uname 00:22:33.850 20:23:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:33.850 20:23:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3224080 00:22:33.850 20:23:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:33.850 20:23:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:33.850 20:23:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3224080' 00:22:33.850 killing process with pid 3224080 00:22:33.850 20:23:38 -- common/autotest_common.sh@955 -- # kill 3224080 00:22:33.850 20:23:38 -- common/autotest_common.sh@960 -- # wait 3224080 00:22:34.109 Received shutdown signal, test time was about 0.901043 seconds 00:22:34.109 00:22:34.110 Latency(us) 00:22:34.110 [2024-11-20T19:23:39.149Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme1n1 : 0.89 400.51 25.03 0.00 0.00 156019.71 22816.24 121168.78 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme2n1 : 0.90 395.34 24.71 0.00 0.00 156863.44 21942.42 153014.42 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme3n1 : 0.89 398.39 24.90 0.00 0.00 154254.58 22233.69 131266.18 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme4n1 : 0.89 397.61 24.85 0.00 0.00 153305.01 21456.97 133596.35 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme5n1 : 0.89 399.50 24.97 0.00 0.00 150978.40 24078.41 117285.17 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme6n1 : 0.90 394.34 24.65 0.00 0.00 152157.70 20971.52 131266.18 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme7n1 : 0.90 396.36 24.77 0.00 0.00 149772.56 22816.24 117285.17 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme8n1 : 0.86 366.53 22.91 0.00 0.00 160098.32 23204.60 124275.67 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme9n1 : 0.87 363.69 22.73 0.00 0.00 159649.24 25631.86 126605.84 00:22:34.110 [2024-11-20T19:23:39.149Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.110 Verification LBA range: start 0x0 length 0x400 00:22:34.110 Nvme10n1 : 0.88 356.11 22.26 0.00 0.00 161639.75 28156.21 128159.29 00:22:34.110 [2024-11-20T19:23:39.149Z] =================================================================================================================== 00:22:34.110 [2024-11-20T19:23:39.149Z] Total : 3868.39 241.77 0.00 0.00 155299.35 20971.52 153014.42 00:22:34.381 20:23:39 -- target/shutdown.sh@112 -- # sleep 1 00:22:35.321 20:23:40 -- target/shutdown.sh@113 -- # kill -0 3223808 00:22:35.321 20:23:40 -- target/shutdown.sh@115 -- # stoptarget 00:22:35.321 20:23:40 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:35.321 20:23:40 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:35.321 20:23:40 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:35.321 20:23:40 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:35.321 20:23:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:35.321 20:23:40 -- nvmf/common.sh@116 -- # sync 00:22:35.321 20:23:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:35.321 20:23:40 -- nvmf/common.sh@119 -- # set +e 00:22:35.321 20:23:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:35.321 20:23:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:35.321 rmmod nvme_tcp 00:22:35.321 rmmod nvme_fabrics 00:22:35.321 rmmod nvme_keyring 00:22:35.321 20:23:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:35.321 20:23:40 -- nvmf/common.sh@123 -- # set -e 00:22:35.321 20:23:40 -- nvmf/common.sh@124 -- # return 0 00:22:35.321 20:23:40 -- nvmf/common.sh@477 -- # '[' -n 3223808 ']' 00:22:35.321 20:23:40 -- nvmf/common.sh@478 -- # killprocess 3223808 00:22:35.321 20:23:40 -- common/autotest_common.sh@936 -- # '[' -z 3223808 ']' 00:22:35.321 20:23:40 -- common/autotest_common.sh@940 -- # kill -0 3223808 00:22:35.321 20:23:40 -- common/autotest_common.sh@941 -- # uname 00:22:35.321 20:23:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:35.321 20:23:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3223808 00:22:35.321 20:23:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:35.321 20:23:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:35.321 20:23:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3223808' 00:22:35.321 killing process with pid 3223808 00:22:35.321 20:23:40 -- common/autotest_common.sh@955 -- # kill 3223808 00:22:35.321 20:23:40 -- common/autotest_common.sh@960 -- # wait 3223808 00:22:35.891 20:23:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:35.891 20:23:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:35.891 20:23:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:35.891 20:23:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:35.891 20:23:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:35.891 20:23:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:35.891 20:23:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:35.891 20:23:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:37.856 20:23:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:37.856 00:22:37.856 real 0m8.513s 00:22:37.856 user 0m27.255s 00:22:37.856 sys 0m1.545s 00:22:37.856 20:23:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:37.856 20:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:37.856 ************************************ 00:22:37.856 END TEST nvmf_shutdown_tc2 00:22:37.856 ************************************ 00:22:37.856 20:23:42 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:37.856 20:23:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:37.856 20:23:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:37.856 20:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:38.115 ************************************ 00:22:38.115 START TEST nvmf_shutdown_tc3 00:22:38.115 ************************************ 00:22:38.115 20:23:42 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:38.115 20:23:42 -- target/shutdown.sh@120 -- # starttarget 00:22:38.115 20:23:42 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:38.115 20:23:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:38.115 20:23:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:38.115 20:23:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:38.115 20:23:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:38.115 20:23:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:38.115 20:23:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.115 20:23:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:38.115 20:23:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.115 20:23:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:38.115 20:23:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:38.115 20:23:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:38.115 20:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:38.115 20:23:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:38.115 20:23:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:38.115 20:23:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:38.115 20:23:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:38.115 20:23:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:38.115 20:23:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:38.115 20:23:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:38.115 20:23:42 -- nvmf/common.sh@294 -- # net_devs=() 00:22:38.115 20:23:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:38.115 20:23:42 -- nvmf/common.sh@295 -- # e810=() 00:22:38.115 20:23:42 -- nvmf/common.sh@295 -- # local -ga e810 00:22:38.115 20:23:42 -- nvmf/common.sh@296 -- # x722=() 00:22:38.115 20:23:42 -- nvmf/common.sh@296 -- # local -ga x722 00:22:38.115 20:23:42 -- nvmf/common.sh@297 -- # mlx=() 00:22:38.115 20:23:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:38.115 20:23:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:38.115 20:23:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:38.115 20:23:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:38.115 20:23:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:38.115 20:23:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:38.116 20:23:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:38.116 20:23:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:38.116 20:23:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:38.116 20:23:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.116 20:23:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:38.116 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:38.116 20:23:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.116 20:23:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:38.116 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:38.116 20:23:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:38.116 20:23:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.116 20:23:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.116 20:23:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.116 20:23:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.116 20:23:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:38.116 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:38.116 20:23:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.116 20:23:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.116 20:23:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.116 20:23:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.116 20:23:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.116 20:23:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:38.116 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:38.116 20:23:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.116 20:23:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:38.116 20:23:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:38.116 20:23:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:38.116 20:23:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:38.116 20:23:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:38.116 20:23:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:38.116 20:23:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:38.116 20:23:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:38.116 20:23:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:38.116 20:23:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:38.116 20:23:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:38.116 20:23:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:38.116 20:23:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:38.116 20:23:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:38.116 20:23:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:38.116 20:23:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:38.116 20:23:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:38.116 20:23:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:38.116 20:23:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:38.116 20:23:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:38.116 20:23:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:38.116 20:23:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:38.116 20:23:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:38.116 20:23:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:38.116 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:38.116 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.285 ms 00:22:38.116 00:22:38.116 --- 10.0.0.2 ping statistics --- 00:22:38.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.116 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:22:38.116 20:23:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:38.116 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:38.116 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:22:38.116 00:22:38.116 --- 10.0.0.1 ping statistics --- 00:22:38.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.116 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:22:38.116 20:23:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:38.116 20:23:43 -- nvmf/common.sh@410 -- # return 0 00:22:38.116 20:23:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:38.116 20:23:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:38.116 20:23:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:38.116 20:23:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:38.116 20:23:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:38.116 20:23:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:38.116 20:23:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:38.116 20:23:43 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:38.116 20:23:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:38.116 20:23:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.116 20:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:38.116 20:23:43 -- nvmf/common.sh@469 -- # nvmfpid=3225012 00:22:38.116 20:23:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:38.116 20:23:43 -- nvmf/common.sh@470 -- # waitforlisten 3225012 00:22:38.116 20:23:43 -- common/autotest_common.sh@829 -- # '[' -z 3225012 ']' 00:22:38.116 20:23:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:38.116 20:23:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.116 20:23:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:38.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:38.116 20:23:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.116 20:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:38.374 [2024-11-20 20:23:43.165097] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.374 [2024-11-20 20:23:43.165169] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:38.374 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.374 [2024-11-20 20:23:43.235910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:38.374 [2024-11-20 20:23:43.349884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:38.374 [2024-11-20 20:23:43.350029] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:38.374 [2024-11-20 20:23:43.350046] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:38.374 [2024-11-20 20:23:43.350058] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:38.374 [2024-11-20 20:23:43.350117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:38.374 [2024-11-20 20:23:43.350183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:38.374 [2024-11-20 20:23:43.350248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:38.374 [2024-11-20 20:23:43.350251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:39.311 20:23:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:39.311 20:23:44 -- common/autotest_common.sh@862 -- # return 0 00:22:39.311 20:23:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:39.311 20:23:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:39.311 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 20:23:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:39.311 20:23:44 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:39.311 20:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 [2024-11-20 20:23:44.159576] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:39.311 20:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.311 20:23:44 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:39.311 20:23:44 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:39.311 20:23:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:39.311 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 20:23:44 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.311 20:23:44 -- target/shutdown.sh@28 -- # cat 00:22:39.311 20:23:44 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:39.311 20:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 Malloc1 00:22:39.311 [2024-11-20 20:23:44.239690] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:39.311 Malloc2 00:22:39.311 Malloc3 00:22:39.572 Malloc4 00:22:39.572 Malloc5 00:22:39.572 Malloc6 00:22:39.572 Malloc7 00:22:39.572 Malloc8 00:22:39.832 Malloc9 00:22:39.832 Malloc10 00:22:39.832 20:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.832 20:23:44 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:39.832 20:23:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:39.832 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:39.832 20:23:44 -- target/shutdown.sh@124 -- # perfpid=3225222 00:22:39.832 20:23:44 -- target/shutdown.sh@125 -- # waitforlisten 3225222 /var/tmp/bdevperf.sock 00:22:39.832 20:23:44 -- common/autotest_common.sh@829 -- # '[' -z 3225222 ']' 00:22:39.832 20:23:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:39.832 20:23:44 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:39.832 20:23:44 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:39.832 20:23:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:39.832 20:23:44 -- nvmf/common.sh@520 -- # config=() 00:22:39.832 20:23:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:39.832 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:39.832 20:23:44 -- nvmf/common.sh@520 -- # local subsystem config 00:22:39.832 20:23:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.832 { 00:22:39.832 "params": { 00:22:39.832 "name": "Nvme$subsystem", 00:22:39.832 "trtype": "$TEST_TRANSPORT", 00:22:39.832 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.832 "adrfam": "ipv4", 00:22:39.832 "trsvcid": "$NVMF_PORT", 00:22:39.832 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.832 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.832 "hdgst": ${hdgst:-false}, 00:22:39.832 "ddgst": ${ddgst:-false} 00:22:39.832 }, 00:22:39.832 "method": "bdev_nvme_attach_controller" 00:22:39.832 } 00:22:39.832 EOF 00:22:39.832 )") 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.832 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.832 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.833 { 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme$subsystem", 00:22:39.833 "trtype": "$TEST_TRANSPORT", 00:22:39.833 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "$NVMF_PORT", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.833 "hdgst": ${hdgst:-false}, 00:22:39.833 "ddgst": ${ddgst:-false} 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 } 00:22:39.833 EOF 00:22:39.833 )") 00:22:39.833 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.833 20:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.833 20:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.833 { 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme$subsystem", 00:22:39.833 "trtype": "$TEST_TRANSPORT", 00:22:39.833 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "$NVMF_PORT", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.833 "hdgst": ${hdgst:-false}, 00:22:39.833 "ddgst": ${ddgst:-false} 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 } 00:22:39.833 EOF 00:22:39.833 )") 00:22:39.833 20:23:44 -- nvmf/common.sh@542 -- # cat 00:22:39.833 20:23:44 -- nvmf/common.sh@544 -- # jq . 00:22:39.833 20:23:44 -- nvmf/common.sh@545 -- # IFS=, 00:22:39.833 20:23:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme1", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme2", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme3", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme4", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme5", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme6", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme7", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme8", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme9", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 },{ 00:22:39.833 "params": { 00:22:39.833 "name": "Nvme10", 00:22:39.833 "trtype": "tcp", 00:22:39.833 "traddr": "10.0.0.2", 00:22:39.833 "adrfam": "ipv4", 00:22:39.833 "trsvcid": "4420", 00:22:39.833 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:39.833 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:39.833 "hdgst": false, 00:22:39.833 "ddgst": false 00:22:39.833 }, 00:22:39.833 "method": "bdev_nvme_attach_controller" 00:22:39.833 }' 00:22:39.833 [2024-11-20 20:23:44.756691] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:39.833 [2024-11-20 20:23:44.756796] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3225222 ] 00:22:39.833 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.833 [2024-11-20 20:23:44.822439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:40.092 [2024-11-20 20:23:44.931180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:41.468 Running I/O for 10 seconds... 00:22:41.742 20:23:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:41.742 20:23:46 -- common/autotest_common.sh@862 -- # return 0 00:22:41.742 20:23:46 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:41.742 20:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.742 20:23:46 -- common/autotest_common.sh@10 -- # set +x 00:22:41.742 20:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.742 20:23:46 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:41.742 20:23:46 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:41.742 20:23:46 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:41.742 20:23:46 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:41.742 20:23:46 -- target/shutdown.sh@57 -- # local ret=1 00:22:41.742 20:23:46 -- target/shutdown.sh@58 -- # local i 00:22:41.742 20:23:46 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:41.742 20:23:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:41.742 20:23:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:41.742 20:23:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:41.742 20:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.742 20:23:46 -- common/autotest_common.sh@10 -- # set +x 00:22:41.742 20:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.742 20:23:46 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:41.742 20:23:46 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:41.742 20:23:46 -- target/shutdown.sh@64 -- # ret=0 00:22:41.742 20:23:46 -- target/shutdown.sh@65 -- # break 00:22:41.742 20:23:46 -- target/shutdown.sh@69 -- # return 0 00:22:41.742 20:23:46 -- target/shutdown.sh@134 -- # killprocess 3225012 00:22:41.742 20:23:46 -- common/autotest_common.sh@936 -- # '[' -z 3225012 ']' 00:22:41.742 20:23:46 -- common/autotest_common.sh@940 -- # kill -0 3225012 00:22:41.742 20:23:46 -- common/autotest_common.sh@941 -- # uname 00:22:41.742 20:23:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:41.742 20:23:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3225012 00:22:41.742 20:23:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:41.742 20:23:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:41.742 20:23:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3225012' 00:22:41.742 killing process with pid 3225012 00:22:41.742 20:23:46 -- common/autotest_common.sh@955 -- # kill 3225012 00:22:41.742 20:23:46 -- common/autotest_common.sh@960 -- # wait 3225012 00:22:41.742 [2024-11-20 20:23:46.624600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.624993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.742 [2024-11-20 20:23:46.625368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24552e0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.626777] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.743 [2024-11-20 20:23:46.626826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.626856] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.743 [2024-11-20 20:23:46.626880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.626906] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.743 [2024-11-20 20:23:46.626928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.626953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.743 [2024-11-20 20:23:46.626975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.626996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1db6f70 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.628836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.628871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.628912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.628939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.628970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.628994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.629956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.629984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.630006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.630034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.630064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.630102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.630101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.630136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23552 len:12[2024-11-20 20:23:46.630163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.630189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.630217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.630240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24960 len:1[2024-11-20 20:23:46.630263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 [2024-11-20 20:23:46.630295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with [2024-11-20 20:23:46.630313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:1the state(5) to be set 00:22:41.743 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.743 [2024-11-20 20:23:46.630334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.743 [2024-11-20 20:23:46.630340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.630345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.743 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with [2024-11-20 20:23:46.630378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:12the state(5) to be set 00:22:41.744 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.630410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.630473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:12[2024-11-20 20:23:46.630556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:12[2024-11-20 20:23:46.630666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.630691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:12[2024-11-20 20:23:46.630780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:1[2024-11-20 20:23:46.630845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.630957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457cd0 is same with the state(5) to be set 00:22:41.744 [2024-11-20 20:23:46.630972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.630998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.631022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.631049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.631090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.631117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.631141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.631166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.631190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.744 [2024-11-20 20:23:46.631215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.744 [2024-11-20 20:23:46.631238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.631951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.631975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.632025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.632095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.632151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.632216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.632268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.745 [2024-11-20 20:23:46.632318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.745 [2024-11-20 20:23:46.632499] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ffb260 was disconnected and freed. reset controller. 00:22:41.745 [2024-11-20 20:23:46.632635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.632997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.745 [2024-11-20 20:23:46.633582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.633989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.634002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.634013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.634024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.634043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455790 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.746 [2024-11-20 20:23:46.636699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.636881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2455c40 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.637164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:41.747 [2024-11-20 20:23:46.637225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1db6f70 (9): Bad file descriptor 00:22:41.747 [2024-11-20 20:23:46.637341] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637430] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637477] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e0f590 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.637688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637839] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.637883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7d600 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.637952] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.637981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.638005] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.638029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.638052] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.638092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.638118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.747 [2024-11-20 20:23:46.638143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.747 [2024-11-20 20:23:46.638165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dd91b0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.638999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.747 [2024-11-20 20:23:46.639705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.639994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.640005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.640016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.640030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24560d0 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641599] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.748 [2024-11-20 20:23:46.641621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641730] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.748 [2024-11-20 20:23:46.641748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.641995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.748 [2024-11-20 20:23:46.642382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.642394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.642406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.642418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.642451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.642448] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.749 [2024-11-20 20:23:46.642469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456580 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.643665] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.749 [2024-11-20 20:23:46.643779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456a30 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.644996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2456ec0 is same with the state(5) to be set 00:22:41.749 [2024-11-20 20:23:46.645614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.749 [2024-11-20 20:23:46.645650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.749 [2024-11-20 20:23:46.645689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.749 [2024-11-20 20:23:46.645717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.749 [2024-11-20 20:23:46.645745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.749 [2024-11-20 20:23:46.645771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.749 [2024-11-20 20:23:46.645797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.749 [2024-11-20 20:23:46.645821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.749 [2024-11-20 20:23:46.645850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.749 [2024-11-20 20:23:46.645875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.749 [2024-11-20 20:23:46.645903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.749 [2024-11-20 20:23:46.645927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.749 [2024-11-20 20:23:46.645955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.645979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with [2024-11-20 20:23:46.646634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:41.750 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21760 len:12[2024-11-20 20:23:46.646673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with [2024-11-20 20:23:46.646719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22272 len:12the state(5) to be set 00:22:41.750 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23040 len:12[2024-11-20 20:23:46.646837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with [2024-11-20 20:23:46.646885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:12the state(5) to be set 00:22:41.750 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.646915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with [2024-11-20 20:23:46.646939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:12the state(5) to be set 00:22:41.750 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.646971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.646977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.646988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.750 [2024-11-20 20:23:46.647012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.750 [2024-11-20 20:23:46.647036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2007e00 is same [2024-11-20 20:23:46.647085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with with the state(5) to be set 00:22:41.750 the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647173] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2007e00 was disconnected and fr[2024-11-20 20:23:46.647184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with eed. reset controller. 00:22:41.750 the state(5) to be set 00:22:41.750 [2024-11-20 20:23:46.647198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457370 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f67a60 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.647816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647875] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647924] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.647972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.647994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.648016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f6cc70 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e0f590 (9): Bad file descriptor 00:22:41.751 [2024-11-20 20:23:46.648154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.648184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.648208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.648230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.648237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648254] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.648264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.648291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648303] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.648314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.648338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f6d150 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.751 [2024-11-20 20:23:46.648454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.751 [2024-11-20 20:23:46.648477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.751 [2024-11-20 20:23:46.648491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648540] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1de2690 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648755] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648802] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648848] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.752 [2024-11-20 20:23:46.648869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.648891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f580a0 is same with the state(5) to be set 00:22:41.752 [2024-11-20 20:23:46.648924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f7d600 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.648971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dd91b0 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.650610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:41.752 [2024-11-20 20:23:46.650656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f580a0 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.651200] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.752 [2024-11-20 20:23:46.652188] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.752 [2024-11-20 20:23:46.652561] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.752 [2024-11-20 20:23:46.657566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f67a60 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.657620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f6cc70 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.657676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f6d150 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.657721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1de2690 (9): Bad file descriptor 00:22:41.752 [2024-11-20 20:23:46.657935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.657966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.657997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.658971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.658996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.659019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.659043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.659091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.659119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.659144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.659169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.752 [2024-11-20 20:23:46.659194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.752 [2024-11-20 20:23:46.659220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.659970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.659991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.660970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.660992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.661017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.661038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.661091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.661131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.661159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.661185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.661210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.661236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.661261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.753 [2024-11-20 20:23:46.661286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.753 [2024-11-20 20:23:46.661311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1da7550 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:12[2024-11-20 20:23:46.662753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.662779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:12[2024-11-20 20:23:46.662817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.662841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.662877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.662900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:12[2024-11-20 20:23:46.662923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.662955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.662979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.662992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.663009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 20:23:46.663086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2457820 is same with the state(5) to be set 00:22:41.754 [2024-11-20 20:23:46.663112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.754 [2024-11-20 20:23:46.663888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.754 [2024-11-20 20:23:46.663912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.663941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.663970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.663999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.664955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.664981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.665003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.665030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.665053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.665105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.665132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.665157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.665181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.665215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.665241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.665267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.675862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.675964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.755 [2024-11-20 20:23:46.676491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.755 [2024-11-20 20:23:46.676520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.676868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.676895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f431a0 is same with the state(5) to be set 00:22:41.756 [2024-11-20 20:23:46.678599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.678673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.678737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.678790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.678844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.678898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.678952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.678977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.679959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.679990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.756 [2024-11-20 20:23:46.680352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.756 [2024-11-20 20:23:46.680380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.680959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.680984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.681963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.681994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x200bfa0 is same with the state(5) to be set 00:22:41.757 [2024-11-20 20:23:46.682228] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200bfa0 was disconnected and freed. reset controller. 00:22:41.757 [2024-11-20 20:23:46.682325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.757 [2024-11-20 20:23:46.682666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.757 [2024-11-20 20:23:46.682691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.682718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.682744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.682770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.682795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.682821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.682846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.682873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.682903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.682932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.682956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.682984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.683971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.683999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.758 [2024-11-20 20:23:46.684764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.758 [2024-11-20 20:23:46.684792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.684816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.684845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.684868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.684897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.684921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.684949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.684972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.685736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.685760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x200d580 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.690526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:41.759 [2024-11-20 20:23:46.690588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:41.759 [2024-11-20 20:23:46.690638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:41.759 [2024-11-20 20:23:46.690795] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:41.759 [2024-11-20 20:23:46.690826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.690855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f580a0 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.690914] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:41.759 [2024-11-20 20:23:46.690943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.690976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1db6f70 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.691047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1db6f70 (9): Bad file descriptor 00:22:41.759 [2024-11-20 20:23:46.691100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f580a0 (9): Bad file descriptor 00:22:41.759 [2024-11-20 20:23:46.691171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.759 [2024-11-20 20:23:46.691201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.691228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.759 [2024-11-20 20:23:46.691252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.691277] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.759 [2024-11-20 20:23:46.691301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.691326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.759 [2024-11-20 20:23:46.691349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.691372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e04490 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.692941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:41.759 [2024-11-20 20:23:46.692986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e04490 (9): Bad file descriptor 00:22:41.759 [2024-11-20 20:23:46.693218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.759 [2024-11-20 20:23:46.693356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.759 [2024-11-20 20:23:46.693398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f7d600 with addr=10.0.0.2, port=4420 00:22:41.759 [2024-11-20 20:23:46.693423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7d600 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.693584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.759 [2024-11-20 20:23:46.693714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.759 [2024-11-20 20:23:46.693750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1dd91b0 with addr=10.0.0.2, port=4420 00:22:41.759 [2024-11-20 20:23:46.693775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dd91b0 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.693895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.759 [2024-11-20 20:23:46.694012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.759 [2024-11-20 20:23:46.694046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e0f590 with addr=10.0.0.2, port=4420 00:22:41.759 [2024-11-20 20:23:46.694082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e0f590 is same with the state(5) to be set 00:22:41.759 [2024-11-20 20:23:46.694841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.694873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.694909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.694944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.694972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.694999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.759 [2024-11-20 20:23:46.695028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.759 [2024-11-20 20:23:46.695053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.695967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.695996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.696953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.696978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.697007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.760 [2024-11-20 20:23:46.697030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.760 [2024-11-20 20:23:46.697066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.697949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.697976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.698000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.698029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.698052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.698101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.698127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.698155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.698179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.698206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.698231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.698257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.698283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.698313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f446f0 is same with the state(5) to be set 00:22:41.761 [2024-11-20 20:23:46.699819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.699853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.699888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.699916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.699944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.699969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.699998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.761 [2024-11-20 20:23:46.700667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.761 [2024-11-20 20:23:46.700695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.700721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.700759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.700782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.700812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.700835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.700864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.700888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.700916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.700941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.700968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.700993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.701958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.701983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.762 [2024-11-20 20:23:46.702832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.762 [2024-11-20 20:23:46.702856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.702882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.702916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.702943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.702968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.702993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.703017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.703045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.703067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.703107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.703130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.703165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.703191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.703224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.703248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.703275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.703301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.703326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2006950 is same with the state(5) to be set 00:22:41.763 [2024-11-20 20:23:46.704844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.704878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.704913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.704940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.704968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.704992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.705958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.705983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.763 [2024-11-20 20:23:46.706473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.763 [2024-11-20 20:23:46.706496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.706960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.706983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.707956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.707984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.708007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.708036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.708080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.708117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.708142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.708169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.708194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.708222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.708247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.708274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.708299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.764 [2024-11-20 20:23:46.708325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20093e0 is same with the state(5) to be set 00:22:41.764 [2024-11-20 20:23:46.709838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.764 [2024-11-20 20:23:46.709878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.709915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.709942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.709970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.709993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.710964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.710992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.711955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.765 [2024-11-20 20:23:46.711992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.765 [2024-11-20 20:23:46.712017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.712954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.712981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.713011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.713041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.713083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.713112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.713136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.713161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.713186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.713214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.713238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.713266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.766 [2024-11-20 20:23:46.713290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.766 [2024-11-20 20:23:46.713316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x200a9c0 is same with the state(5) to be set 00:22:41.766 [2024-11-20 20:23:46.716800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:41.766 [2024-11-20 20:23:46.716853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:41.766 [2024-11-20 20:23:46.716889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:41.766 task offset: 24320 on job bdev=Nvme1n1 fails 00:22:41.766 00:22:41.766 Latency(us) 00:22:41.766 [2024-11-20T19:23:46.805Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme1n1 ended in about 0.49 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme1n1 : 0.49 335.26 20.95 130.83 0.00 135992.10 55147.33 121168.78 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme2n1 ended in about 0.52 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme2n1 : 0.52 244.09 15.26 123.98 0.00 169799.82 100197.26 151460.98 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme3n1 ended in about 0.53 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme3n1 : 0.53 308.36 19.27 120.34 0.00 143753.37 86216.25 119615.34 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme4n1 ended in about 0.55 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme4n1 : 0.55 296.49 18.53 115.70 0.00 147642.94 88158.06 118061.89 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme5n1 ended in about 0.56 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme5n1 : 0.56 293.83 18.36 114.67 0.00 146922.43 89711.50 118838.61 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme6n1 ended in about 0.50 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme6n1 : 0.50 325.48 20.34 51.60 0.00 154591.76 4417.61 132042.90 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme7n1 ended in about 0.56 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme7n1 : 0.56 291.23 18.20 113.65 0.00 144194.53 83497.72 118061.89 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme8n1 ended in about 0.57 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme8n1 : 0.57 288.67 18.04 112.65 0.00 143555.78 84662.80 118838.61 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme9n1 ended in about 0.55 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme9n1 : 0.55 300.16 18.76 117.13 0.00 135366.97 65244.73 118061.89 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.766 [2024-11-20T19:23:46.805Z] Job: Nvme10n1 ended in about 0.54 seconds with error 00:22:41.766 Verification LBA range: start 0x0 length 0x400 00:22:41.766 Nvme10n1 : 0.54 236.76 14.80 118.38 0.00 156451.02 36700.16 165441.99 00:22:41.766 [2024-11-20T19:23:46.805Z] =================================================================================================================== 00:22:41.766 [2024-11-20T19:23:46.806Z] Total : 2920.32 182.52 1118.93 0.00 147180.17 4417.61 165441.99 00:22:41.767 [2024-11-20 20:23:46.745229] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:41.767 [2024-11-20 20:23:46.745311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:41.767 [2024-11-20 20:23:46.745468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f7d600 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.745512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dd91b0 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.745543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e0f590 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.745573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.745596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.745625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:41.767 [2024-11-20 20:23:46.745666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.745691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.745723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:41.767 [2024-11-20 20:23:46.745802] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.745845] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.745886] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.745920] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.745952] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.746546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.746586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.746845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.747010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.747041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e04490 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.747087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e04490 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.747245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.747389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.747420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1de2690 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.747448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1de2690 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.747618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.747733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.747763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f6d150 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.747791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f6d150 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.747905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.748018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.748048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f67a60 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.748091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f67a60 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.748213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.748327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.748358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f6cc70 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.748386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f6cc70 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.748409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.748431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.748458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:41.767 [2024-11-20 20:23:46.748488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.748513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.748535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:41.767 [2024-11-20 20:23:46.748563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.748589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.748610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:41.767 [2024-11-20 20:23:46.748677] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.748713] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.748751] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.767 [2024-11-20 20:23:46.750046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.750094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.750119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.750163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e04490 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.750200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1de2690 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.750231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f6d150 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.750264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f67a60 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.750295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f6cc70 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.750419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:41.767 [2024-11-20 20:23:46.750456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:41.767 [2024-11-20 20:23:46.750505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.750531] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.750551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:41.767 [2024-11-20 20:23:46.750580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.750605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.750627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:41.767 [2024-11-20 20:23:46.750655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.750677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.750700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:41.767 [2024-11-20 20:23:46.750727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.750750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.750773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:41.767 [2024-11-20 20:23:46.750798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.750821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.750844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:41.767 [2024-11-20 20:23:46.750936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.750964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.750984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.751004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.751031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.767 [2024-11-20 20:23:46.751177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.751305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.751339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1db6f70 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.751375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1db6f70 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.751531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.751652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.767 [2024-11-20 20:23:46.751684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f580a0 with addr=10.0.0.2, port=4420 00:22:41.767 [2024-11-20 20:23:46.751711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f580a0 is same with the state(5) to be set 00:22:41.767 [2024-11-20 20:23:46.751795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1db6f70 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.751831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f580a0 (9): Bad file descriptor 00:22:41.767 [2024-11-20 20:23:46.751895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:41.767 [2024-11-20 20:23:46.751921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:41.767 [2024-11-20 20:23:46.751942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:41.768 [2024-11-20 20:23:46.751971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:41.768 [2024-11-20 20:23:46.751993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:41.768 [2024-11-20 20:23:46.752016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:41.768 [2024-11-20 20:23:46.752090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.768 [2024-11-20 20:23:46.752127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.336 20:23:47 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:42.336 20:23:47 -- target/shutdown.sh@138 -- # sleep 1 00:22:43.275 20:23:48 -- target/shutdown.sh@141 -- # kill -9 3225222 00:22:43.275 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3225222) - No such process 00:22:43.275 20:23:48 -- target/shutdown.sh@141 -- # true 00:22:43.275 20:23:48 -- target/shutdown.sh@143 -- # stoptarget 00:22:43.275 20:23:48 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:43.275 20:23:48 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:43.275 20:23:48 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:43.275 20:23:48 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:43.275 20:23:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:43.275 20:23:48 -- nvmf/common.sh@116 -- # sync 00:22:43.275 20:23:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:43.275 20:23:48 -- nvmf/common.sh@119 -- # set +e 00:22:43.275 20:23:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:43.275 20:23:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:43.275 rmmod nvme_tcp 00:22:43.275 rmmod nvme_fabrics 00:22:43.275 rmmod nvme_keyring 00:22:43.275 20:23:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:43.275 20:23:48 -- nvmf/common.sh@123 -- # set -e 00:22:43.275 20:23:48 -- nvmf/common.sh@124 -- # return 0 00:22:43.275 20:23:48 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:43.275 20:23:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:43.275 20:23:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:43.275 20:23:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:43.275 20:23:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:43.275 20:23:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:43.275 20:23:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.275 20:23:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.275 20:23:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.817 20:23:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:45.817 00:22:45.817 real 0m7.435s 00:22:45.817 user 0m17.435s 00:22:45.817 sys 0m1.377s 00:22:45.817 20:23:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.817 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.817 ************************************ 00:22:45.817 END TEST nvmf_shutdown_tc3 00:22:45.817 ************************************ 00:22:45.817 20:23:50 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:45.817 00:22:45.817 real 0m28.474s 00:22:45.817 user 1m21.264s 00:22:45.817 sys 0m6.271s 00:22:45.817 20:23:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.817 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.817 ************************************ 00:22:45.817 END TEST nvmf_shutdown 00:22:45.817 ************************************ 00:22:45.817 20:23:50 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:45.817 20:23:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.817 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.817 20:23:50 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:45.817 20:23:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:45.817 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.817 20:23:50 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:45.817 20:23:50 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:45.817 20:23:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.817 20:23:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.817 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.817 ************************************ 00:22:45.817 START TEST nvmf_multicontroller 00:22:45.817 ************************************ 00:22:45.817 20:23:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:45.817 * Looking for test storage... 00:22:45.817 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:45.817 20:23:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:45.817 20:23:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:45.817 20:23:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:45.817 20:23:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:45.817 20:23:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:45.817 20:23:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:45.817 20:23:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:45.817 20:23:50 -- scripts/common.sh@335 -- # IFS=.-: 00:22:45.817 20:23:50 -- scripts/common.sh@335 -- # read -ra ver1 00:22:45.817 20:23:50 -- scripts/common.sh@336 -- # IFS=.-: 00:22:45.817 20:23:50 -- scripts/common.sh@336 -- # read -ra ver2 00:22:45.817 20:23:50 -- scripts/common.sh@337 -- # local 'op=<' 00:22:45.817 20:23:50 -- scripts/common.sh@339 -- # ver1_l=2 00:22:45.817 20:23:50 -- scripts/common.sh@340 -- # ver2_l=1 00:22:45.817 20:23:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:45.817 20:23:50 -- scripts/common.sh@343 -- # case "$op" in 00:22:45.817 20:23:50 -- scripts/common.sh@344 -- # : 1 00:22:45.817 20:23:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:45.817 20:23:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:45.817 20:23:50 -- scripts/common.sh@364 -- # decimal 1 00:22:45.817 20:23:50 -- scripts/common.sh@352 -- # local d=1 00:22:45.817 20:23:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:45.817 20:23:50 -- scripts/common.sh@354 -- # echo 1 00:22:45.817 20:23:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:45.817 20:23:50 -- scripts/common.sh@365 -- # decimal 2 00:22:45.817 20:23:50 -- scripts/common.sh@352 -- # local d=2 00:22:45.817 20:23:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:45.817 20:23:50 -- scripts/common.sh@354 -- # echo 2 00:22:45.817 20:23:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:45.817 20:23:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:45.817 20:23:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:45.817 20:23:50 -- scripts/common.sh@367 -- # return 0 00:22:45.817 20:23:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:45.817 20:23:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:45.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.817 --rc genhtml_branch_coverage=1 00:22:45.818 --rc genhtml_function_coverage=1 00:22:45.818 --rc genhtml_legend=1 00:22:45.818 --rc geninfo_all_blocks=1 00:22:45.818 --rc geninfo_unexecuted_blocks=1 00:22:45.818 00:22:45.818 ' 00:22:45.818 20:23:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:45.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.818 --rc genhtml_branch_coverage=1 00:22:45.818 --rc genhtml_function_coverage=1 00:22:45.818 --rc genhtml_legend=1 00:22:45.818 --rc geninfo_all_blocks=1 00:22:45.818 --rc geninfo_unexecuted_blocks=1 00:22:45.818 00:22:45.818 ' 00:22:45.818 20:23:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:45.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.818 --rc genhtml_branch_coverage=1 00:22:45.818 --rc genhtml_function_coverage=1 00:22:45.818 --rc genhtml_legend=1 00:22:45.818 --rc geninfo_all_blocks=1 00:22:45.818 --rc geninfo_unexecuted_blocks=1 00:22:45.818 00:22:45.818 ' 00:22:45.818 20:23:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:45.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.818 --rc genhtml_branch_coverage=1 00:22:45.818 --rc genhtml_function_coverage=1 00:22:45.818 --rc genhtml_legend=1 00:22:45.818 --rc geninfo_all_blocks=1 00:22:45.818 --rc geninfo_unexecuted_blocks=1 00:22:45.818 00:22:45.818 ' 00:22:45.818 20:23:50 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.818 20:23:50 -- nvmf/common.sh@7 -- # uname -s 00:22:45.818 20:23:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.818 20:23:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.818 20:23:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.818 20:23:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.818 20:23:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.818 20:23:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.818 20:23:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.818 20:23:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.818 20:23:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.818 20:23:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.818 20:23:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.818 20:23:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.818 20:23:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.818 20:23:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.818 20:23:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.818 20:23:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:45.818 20:23:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.818 20:23:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.818 20:23:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.818 20:23:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.818 20:23:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.818 20:23:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.818 20:23:50 -- paths/export.sh@5 -- # export PATH 00:22:45.818 20:23:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.818 20:23:50 -- nvmf/common.sh@46 -- # : 0 00:22:45.818 20:23:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:45.818 20:23:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:45.818 20:23:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:45.818 20:23:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.818 20:23:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.818 20:23:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:45.818 20:23:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:45.818 20:23:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:45.818 20:23:50 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:45.818 20:23:50 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:45.818 20:23:50 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:45.818 20:23:50 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:45.818 20:23:50 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:45.818 20:23:50 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:45.818 20:23:50 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:45.818 20:23:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:45.818 20:23:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.818 20:23:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:45.818 20:23:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:45.818 20:23:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:45.818 20:23:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.818 20:23:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.818 20:23:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.818 20:23:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:45.818 20:23:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:45.818 20:23:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:45.818 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:47.725 20:23:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:47.725 20:23:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:47.725 20:23:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:47.725 20:23:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:47.725 20:23:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:47.725 20:23:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:47.725 20:23:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:47.725 20:23:52 -- nvmf/common.sh@294 -- # net_devs=() 00:22:47.725 20:23:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:47.725 20:23:52 -- nvmf/common.sh@295 -- # e810=() 00:22:47.725 20:23:52 -- nvmf/common.sh@295 -- # local -ga e810 00:22:47.725 20:23:52 -- nvmf/common.sh@296 -- # x722=() 00:22:47.725 20:23:52 -- nvmf/common.sh@296 -- # local -ga x722 00:22:47.725 20:23:52 -- nvmf/common.sh@297 -- # mlx=() 00:22:47.725 20:23:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:47.725 20:23:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:47.725 20:23:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:47.725 20:23:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:47.725 20:23:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:47.725 20:23:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.725 20:23:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:47.725 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:47.725 20:23:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.725 20:23:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:47.725 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:47.725 20:23:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:47.725 20:23:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.725 20:23:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.725 20:23:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.725 20:23:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.725 20:23:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:47.725 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:47.725 20:23:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.725 20:23:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.725 20:23:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.725 20:23:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.725 20:23:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.725 20:23:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:47.725 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:47.725 20:23:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.725 20:23:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:47.725 20:23:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:47.725 20:23:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:47.725 20:23:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:47.725 20:23:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:47.725 20:23:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:47.725 20:23:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:47.725 20:23:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:47.725 20:23:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:47.725 20:23:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:47.725 20:23:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:47.725 20:23:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:47.725 20:23:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:47.725 20:23:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:47.725 20:23:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:47.725 20:23:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:47.725 20:23:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:47.725 20:23:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:47.725 20:23:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:47.725 20:23:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:47.725 20:23:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:47.725 20:23:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:47.725 20:23:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:47.725 20:23:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:47.725 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:47.725 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:22:47.725 00:22:47.725 --- 10.0.0.2 ping statistics --- 00:22:47.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:47.725 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:22:47.726 20:23:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:47.726 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:47.726 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:22:47.726 00:22:47.726 --- 10.0.0.1 ping statistics --- 00:22:47.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:47.726 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:22:47.726 20:23:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:47.726 20:23:52 -- nvmf/common.sh@410 -- # return 0 00:22:47.726 20:23:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:47.726 20:23:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:47.726 20:23:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:47.726 20:23:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:47.726 20:23:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:47.726 20:23:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:47.726 20:23:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:47.726 20:23:52 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:47.726 20:23:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:47.726 20:23:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:47.726 20:23:52 -- common/autotest_common.sh@10 -- # set +x 00:22:47.726 20:23:52 -- nvmf/common.sh@469 -- # nvmfpid=3227645 00:22:47.726 20:23:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:47.726 20:23:52 -- nvmf/common.sh@470 -- # waitforlisten 3227645 00:22:47.726 20:23:52 -- common/autotest_common.sh@829 -- # '[' -z 3227645 ']' 00:22:47.726 20:23:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:47.726 20:23:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:47.726 20:23:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:47.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:47.726 20:23:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:47.726 20:23:52 -- common/autotest_common.sh@10 -- # set +x 00:22:47.726 [2024-11-20 20:23:52.699172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.726 [2024-11-20 20:23:52.699242] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:47.726 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.986 [2024-11-20 20:23:52.769256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:47.987 [2024-11-20 20:23:52.884393] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:47.987 [2024-11-20 20:23:52.884559] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:47.987 [2024-11-20 20:23:52.884578] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:47.987 [2024-11-20 20:23:52.884592] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:47.987 [2024-11-20 20:23:52.884701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:47.987 [2024-11-20 20:23:52.884802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:47.987 [2024-11-20 20:23:52.884805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.926 20:23:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:48.926 20:23:53 -- common/autotest_common.sh@862 -- # return 0 00:22:48.926 20:23:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:48.926 20:23:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:48.926 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.926 20:23:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:48.926 20:23:53 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:48.926 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.926 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.926 [2024-11-20 20:23:53.675887] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 Malloc0 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 [2024-11-20 20:23:53.738788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 [2024-11-20 20:23:53.746671] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 Malloc1 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:48.927 20:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:48.927 20:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.927 20:23:53 -- host/multicontroller.sh@44 -- # bdevperf_pid=3227815 00:22:48.927 20:23:53 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:48.927 20:23:53 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:48.927 20:23:53 -- host/multicontroller.sh@47 -- # waitforlisten 3227815 /var/tmp/bdevperf.sock 00:22:48.927 20:23:53 -- common/autotest_common.sh@829 -- # '[' -z 3227815 ']' 00:22:48.927 20:23:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:48.927 20:23:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:48.927 20:23:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:48.927 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:48.927 20:23:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:48.927 20:23:53 -- common/autotest_common.sh@10 -- # set +x 00:22:49.864 20:23:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:49.864 20:23:54 -- common/autotest_common.sh@862 -- # return 0 00:22:49.864 20:23:54 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:49.864 20:23:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.864 20:23:54 -- common/autotest_common.sh@10 -- # set +x 00:22:50.124 NVMe0n1 00:22:50.124 20:23:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.124 20:23:54 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:50.124 20:23:54 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:50.124 20:23:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.124 20:23:54 -- common/autotest_common.sh@10 -- # set +x 00:22:50.124 20:23:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.124 1 00:22:50.124 20:23:54 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:50.124 20:23:54 -- common/autotest_common.sh@650 -- # local es=0 00:22:50.124 20:23:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:50.125 20:23:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:50.125 20:23:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:50.125 20:23:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:50.125 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.125 request: 00:22:50.125 { 00:22:50.125 "name": "NVMe0", 00:22:50.125 "trtype": "tcp", 00:22:50.125 "traddr": "10.0.0.2", 00:22:50.125 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:50.125 "hostaddr": "10.0.0.2", 00:22:50.125 "hostsvcid": "60000", 00:22:50.125 "adrfam": "ipv4", 00:22:50.125 "trsvcid": "4420", 00:22:50.125 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.125 "method": "bdev_nvme_attach_controller", 00:22:50.125 "req_id": 1 00:22:50.125 } 00:22:50.125 Got JSON-RPC error response 00:22:50.125 response: 00:22:50.125 { 00:22:50.125 "code": -114, 00:22:50.125 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:50.125 } 00:22:50.125 20:23:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # es=1 00:22:50.125 20:23:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.125 20:23:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.125 20:23:55 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:50.125 20:23:55 -- common/autotest_common.sh@650 -- # local es=0 00:22:50.125 20:23:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:50.125 20:23:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:50.125 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.125 request: 00:22:50.125 { 00:22:50.125 "name": "NVMe0", 00:22:50.125 "trtype": "tcp", 00:22:50.125 "traddr": "10.0.0.2", 00:22:50.125 "hostaddr": "10.0.0.2", 00:22:50.125 "hostsvcid": "60000", 00:22:50.125 "adrfam": "ipv4", 00:22:50.125 "trsvcid": "4420", 00:22:50.125 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:50.125 "method": "bdev_nvme_attach_controller", 00:22:50.125 "req_id": 1 00:22:50.125 } 00:22:50.125 Got JSON-RPC error response 00:22:50.125 response: 00:22:50.125 { 00:22:50.125 "code": -114, 00:22:50.125 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:50.125 } 00:22:50.125 20:23:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # es=1 00:22:50.125 20:23:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.125 20:23:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.125 20:23:55 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@650 -- # local es=0 00:22:50.125 20:23:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.125 request: 00:22:50.125 { 00:22:50.125 "name": "NVMe0", 00:22:50.125 "trtype": "tcp", 00:22:50.125 "traddr": "10.0.0.2", 00:22:50.125 "hostaddr": "10.0.0.2", 00:22:50.125 "hostsvcid": "60000", 00:22:50.125 "adrfam": "ipv4", 00:22:50.125 "trsvcid": "4420", 00:22:50.125 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.125 "multipath": "disable", 00:22:50.125 "method": "bdev_nvme_attach_controller", 00:22:50.125 "req_id": 1 00:22:50.125 } 00:22:50.125 Got JSON-RPC error response 00:22:50.125 response: 00:22:50.125 { 00:22:50.125 "code": -114, 00:22:50.125 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:50.125 } 00:22:50.125 20:23:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # es=1 00:22:50.125 20:23:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.125 20:23:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.125 20:23:55 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:50.125 20:23:55 -- common/autotest_common.sh@650 -- # local es=0 00:22:50.125 20:23:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:50.125 20:23:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:50.125 20:23:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:50.125 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.125 request: 00:22:50.125 { 00:22:50.125 "name": "NVMe0", 00:22:50.125 "trtype": "tcp", 00:22:50.125 "traddr": "10.0.0.2", 00:22:50.125 "hostaddr": "10.0.0.2", 00:22:50.125 "hostsvcid": "60000", 00:22:50.125 "adrfam": "ipv4", 00:22:50.125 "trsvcid": "4420", 00:22:50.125 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.125 "multipath": "failover", 00:22:50.125 "method": "bdev_nvme_attach_controller", 00:22:50.125 "req_id": 1 00:22:50.125 } 00:22:50.125 Got JSON-RPC error response 00:22:50.125 response: 00:22:50.125 { 00:22:50.125 "code": -114, 00:22:50.125 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:50.125 } 00:22:50.125 20:23:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@653 -- # es=1 00:22:50.125 20:23:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.125 20:23:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.125 20:23:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.125 20:23:55 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:50.125 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.125 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.384 00:22:50.384 20:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.384 20:23:55 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:50.384 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.384 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.384 20:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.384 20:23:55 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:50.384 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.384 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.384 00:22:50.384 20:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.384 20:23:55 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:50.384 20:23:55 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:50.384 20:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.384 20:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:50.384 20:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.384 20:23:55 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:50.384 20:23:55 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:51.763 0 00:22:51.763 20:23:56 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:51.763 20:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.763 20:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:51.763 20:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.763 20:23:56 -- host/multicontroller.sh@100 -- # killprocess 3227815 00:22:51.763 20:23:56 -- common/autotest_common.sh@936 -- # '[' -z 3227815 ']' 00:22:51.763 20:23:56 -- common/autotest_common.sh@940 -- # kill -0 3227815 00:22:51.763 20:23:56 -- common/autotest_common.sh@941 -- # uname 00:22:51.763 20:23:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:51.763 20:23:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3227815 00:22:51.763 20:23:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:51.763 20:23:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:51.763 20:23:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3227815' 00:22:51.763 killing process with pid 3227815 00:22:51.763 20:23:56 -- common/autotest_common.sh@955 -- # kill 3227815 00:22:51.763 20:23:56 -- common/autotest_common.sh@960 -- # wait 3227815 00:22:52.021 20:23:56 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:52.021 20:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.021 20:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:52.021 20:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.021 20:23:56 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:52.021 20:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.021 20:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:52.021 20:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.021 20:23:56 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:52.021 20:23:56 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:52.021 20:23:56 -- common/autotest_common.sh@1607 -- # read -r file 00:22:52.021 20:23:56 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:52.021 20:23:56 -- common/autotest_common.sh@1606 -- # sort -u 00:22:52.021 20:23:56 -- common/autotest_common.sh@1608 -- # cat 00:22:52.021 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:52.021 [2024-11-20 20:23:53.843552] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.021 [2024-11-20 20:23:53.843638] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3227815 ] 00:22:52.022 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.022 [2024-11-20 20:23:53.908555] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:52.022 [2024-11-20 20:23:54.019428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:52.022 [2024-11-20 20:23:55.347327] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 1fa843a7-b1cd-48c8-b447-d2db34b014a6 already exists 00:22:52.022 [2024-11-20 20:23:55.347380] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:1fa843a7-b1cd-48c8-b447-d2db34b014a6 alias for bdev NVMe1n1 00:22:52.022 [2024-11-20 20:23:55.347406] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:52.022 Running I/O for 1 seconds... 00:22:52.022 00:22:52.022 Latency(us) 00:22:52.022 [2024-11-20T19:23:57.061Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:52.022 [2024-11-20T19:23:57.061Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:52.022 NVMe0n1 : 1.01 19698.08 76.95 0.00 0.00 6488.58 3276.80 11796.48 00:22:52.022 [2024-11-20T19:23:57.061Z] =================================================================================================================== 00:22:52.022 [2024-11-20T19:23:57.061Z] Total : 19698.08 76.95 0.00 0.00 6488.58 3276.80 11796.48 00:22:52.022 Received shutdown signal, test time was about 1.000000 seconds 00:22:52.022 00:22:52.022 Latency(us) 00:22:52.022 [2024-11-20T19:23:57.061Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:52.022 [2024-11-20T19:23:57.061Z] =================================================================================================================== 00:22:52.022 [2024-11-20T19:23:57.061Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:52.022 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:52.022 20:23:56 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:52.022 20:23:56 -- common/autotest_common.sh@1607 -- # read -r file 00:22:52.022 20:23:56 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:52.022 20:23:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:52.022 20:23:56 -- nvmf/common.sh@116 -- # sync 00:22:52.022 20:23:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:52.022 20:23:56 -- nvmf/common.sh@119 -- # set +e 00:22:52.022 20:23:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:52.022 20:23:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:52.022 rmmod nvme_tcp 00:22:52.022 rmmod nvme_fabrics 00:22:52.022 rmmod nvme_keyring 00:22:52.022 20:23:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:52.022 20:23:56 -- nvmf/common.sh@123 -- # set -e 00:22:52.022 20:23:56 -- nvmf/common.sh@124 -- # return 0 00:22:52.022 20:23:56 -- nvmf/common.sh@477 -- # '[' -n 3227645 ']' 00:22:52.022 20:23:56 -- nvmf/common.sh@478 -- # killprocess 3227645 00:22:52.022 20:23:56 -- common/autotest_common.sh@936 -- # '[' -z 3227645 ']' 00:22:52.022 20:23:56 -- common/autotest_common.sh@940 -- # kill -0 3227645 00:22:52.022 20:23:56 -- common/autotest_common.sh@941 -- # uname 00:22:52.022 20:23:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:52.022 20:23:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3227645 00:22:52.022 20:23:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:52.022 20:23:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:52.022 20:23:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3227645' 00:22:52.022 killing process with pid 3227645 00:22:52.022 20:23:56 -- common/autotest_common.sh@955 -- # kill 3227645 00:22:52.022 20:23:56 -- common/autotest_common.sh@960 -- # wait 3227645 00:22:52.280 20:23:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:52.280 20:23:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:52.280 20:23:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:52.280 20:23:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:52.280 20:23:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:52.280 20:23:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.280 20:23:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.280 20:23:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:54.819 20:23:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:54.819 00:22:54.819 real 0m8.898s 00:22:54.819 user 0m17.358s 00:22:54.819 sys 0m2.261s 00:22:54.819 20:23:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:54.819 20:23:59 -- common/autotest_common.sh@10 -- # set +x 00:22:54.819 ************************************ 00:22:54.819 END TEST nvmf_multicontroller 00:22:54.819 ************************************ 00:22:54.819 20:23:59 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:54.819 20:23:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:54.819 20:23:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:54.819 20:23:59 -- common/autotest_common.sh@10 -- # set +x 00:22:54.819 ************************************ 00:22:54.819 START TEST nvmf_aer 00:22:54.819 ************************************ 00:22:54.819 20:23:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:54.819 * Looking for test storage... 00:22:54.819 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:54.819 20:23:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:54.819 20:23:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:54.819 20:23:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:54.819 20:23:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:54.819 20:23:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:54.819 20:23:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:54.819 20:23:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:54.819 20:23:59 -- scripts/common.sh@335 -- # IFS=.-: 00:22:54.819 20:23:59 -- scripts/common.sh@335 -- # read -ra ver1 00:22:54.819 20:23:59 -- scripts/common.sh@336 -- # IFS=.-: 00:22:54.819 20:23:59 -- scripts/common.sh@336 -- # read -ra ver2 00:22:54.819 20:23:59 -- scripts/common.sh@337 -- # local 'op=<' 00:22:54.819 20:23:59 -- scripts/common.sh@339 -- # ver1_l=2 00:22:54.819 20:23:59 -- scripts/common.sh@340 -- # ver2_l=1 00:22:54.819 20:23:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:54.819 20:23:59 -- scripts/common.sh@343 -- # case "$op" in 00:22:54.819 20:23:59 -- scripts/common.sh@344 -- # : 1 00:22:54.819 20:23:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:54.819 20:23:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:54.819 20:23:59 -- scripts/common.sh@364 -- # decimal 1 00:22:54.819 20:23:59 -- scripts/common.sh@352 -- # local d=1 00:22:54.819 20:23:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:54.819 20:23:59 -- scripts/common.sh@354 -- # echo 1 00:22:54.819 20:23:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:54.819 20:23:59 -- scripts/common.sh@365 -- # decimal 2 00:22:54.819 20:23:59 -- scripts/common.sh@352 -- # local d=2 00:22:54.819 20:23:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:54.819 20:23:59 -- scripts/common.sh@354 -- # echo 2 00:22:54.819 20:23:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:54.819 20:23:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:54.819 20:23:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:54.819 20:23:59 -- scripts/common.sh@367 -- # return 0 00:22:54.819 20:23:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:54.819 20:23:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:54.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.819 --rc genhtml_branch_coverage=1 00:22:54.819 --rc genhtml_function_coverage=1 00:22:54.819 --rc genhtml_legend=1 00:22:54.819 --rc geninfo_all_blocks=1 00:22:54.819 --rc geninfo_unexecuted_blocks=1 00:22:54.819 00:22:54.819 ' 00:22:54.819 20:23:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:54.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.819 --rc genhtml_branch_coverage=1 00:22:54.819 --rc genhtml_function_coverage=1 00:22:54.819 --rc genhtml_legend=1 00:22:54.819 --rc geninfo_all_blocks=1 00:22:54.819 --rc geninfo_unexecuted_blocks=1 00:22:54.819 00:22:54.819 ' 00:22:54.819 20:23:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:54.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.819 --rc genhtml_branch_coverage=1 00:22:54.819 --rc genhtml_function_coverage=1 00:22:54.819 --rc genhtml_legend=1 00:22:54.819 --rc geninfo_all_blocks=1 00:22:54.819 --rc geninfo_unexecuted_blocks=1 00:22:54.819 00:22:54.819 ' 00:22:54.819 20:23:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:54.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.819 --rc genhtml_branch_coverage=1 00:22:54.819 --rc genhtml_function_coverage=1 00:22:54.819 --rc genhtml_legend=1 00:22:54.819 --rc geninfo_all_blocks=1 00:22:54.819 --rc geninfo_unexecuted_blocks=1 00:22:54.819 00:22:54.819 ' 00:22:54.819 20:23:59 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:54.819 20:23:59 -- nvmf/common.sh@7 -- # uname -s 00:22:54.819 20:23:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:54.819 20:23:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:54.819 20:23:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:54.819 20:23:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:54.819 20:23:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:54.819 20:23:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:54.819 20:23:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:54.819 20:23:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:54.819 20:23:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:54.819 20:23:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:54.819 20:23:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:54.819 20:23:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:54.819 20:23:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:54.819 20:23:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:54.819 20:23:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:54.819 20:23:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:54.819 20:23:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:54.819 20:23:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:54.819 20:23:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:54.819 20:23:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.819 20:23:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.819 20:23:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.819 20:23:59 -- paths/export.sh@5 -- # export PATH 00:22:54.819 20:23:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.819 20:23:59 -- nvmf/common.sh@46 -- # : 0 00:22:54.819 20:23:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:54.819 20:23:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:54.819 20:23:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:54.819 20:23:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:54.819 20:23:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:54.819 20:23:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:54.819 20:23:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:54.819 20:23:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:54.819 20:23:59 -- host/aer.sh@11 -- # nvmftestinit 00:22:54.819 20:23:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:54.819 20:23:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:54.820 20:23:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:54.820 20:23:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:54.820 20:23:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:54.820 20:23:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:54.820 20:23:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:54.820 20:23:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:54.820 20:23:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:54.820 20:23:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:54.820 20:23:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:54.820 20:23:59 -- common/autotest_common.sh@10 -- # set +x 00:22:56.727 20:24:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:56.727 20:24:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:56.727 20:24:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:56.727 20:24:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:56.727 20:24:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:56.727 20:24:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:56.727 20:24:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:56.727 20:24:01 -- nvmf/common.sh@294 -- # net_devs=() 00:22:56.727 20:24:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:56.727 20:24:01 -- nvmf/common.sh@295 -- # e810=() 00:22:56.727 20:24:01 -- nvmf/common.sh@295 -- # local -ga e810 00:22:56.727 20:24:01 -- nvmf/common.sh@296 -- # x722=() 00:22:56.727 20:24:01 -- nvmf/common.sh@296 -- # local -ga x722 00:22:56.727 20:24:01 -- nvmf/common.sh@297 -- # mlx=() 00:22:56.727 20:24:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:56.727 20:24:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:56.727 20:24:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:56.727 20:24:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:56.727 20:24:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:56.727 20:24:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.727 20:24:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:56.727 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:56.727 20:24:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.727 20:24:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:56.727 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:56.727 20:24:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:56.727 20:24:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.727 20:24:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.727 20:24:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.727 20:24:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.727 20:24:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:56.727 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:56.727 20:24:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.727 20:24:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.727 20:24:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.727 20:24:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.727 20:24:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.727 20:24:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:56.727 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:56.727 20:24:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.727 20:24:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:56.727 20:24:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:56.727 20:24:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:56.727 20:24:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:56.727 20:24:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:56.727 20:24:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:56.727 20:24:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:56.727 20:24:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:56.727 20:24:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:56.727 20:24:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:56.727 20:24:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:56.727 20:24:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:56.727 20:24:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:56.727 20:24:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:56.727 20:24:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:56.727 20:24:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:56.727 20:24:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:56.727 20:24:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:56.727 20:24:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:56.727 20:24:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:56.727 20:24:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:56.727 20:24:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:56.727 20:24:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:56.727 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:56.727 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:22:56.727 00:22:56.727 --- 10.0.0.2 ping statistics --- 00:22:56.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.727 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:22:56.727 20:24:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:56.727 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:56.727 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:22:56.727 00:22:56.727 --- 10.0.0.1 ping statistics --- 00:22:56.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.727 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:22:56.727 20:24:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:56.727 20:24:01 -- nvmf/common.sh@410 -- # return 0 00:22:56.727 20:24:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:56.727 20:24:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:56.727 20:24:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:56.727 20:24:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:56.727 20:24:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:56.727 20:24:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:56.727 20:24:01 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:56.727 20:24:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:56.727 20:24:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:56.727 20:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:56.727 20:24:01 -- nvmf/common.sh@469 -- # nvmfpid=3230274 00:22:56.727 20:24:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:56.727 20:24:01 -- nvmf/common.sh@470 -- # waitforlisten 3230274 00:22:56.727 20:24:01 -- common/autotest_common.sh@829 -- # '[' -z 3230274 ']' 00:22:56.727 20:24:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:56.728 20:24:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:56.728 20:24:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:56.728 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:56.728 20:24:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:56.728 20:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:56.728 [2024-11-20 20:24:01.751172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:56.728 [2024-11-20 20:24:01.751256] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:56.987 EAL: No free 2048 kB hugepages reported on node 1 00:22:56.987 [2024-11-20 20:24:01.823408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:56.987 [2024-11-20 20:24:01.942637] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:56.987 [2024-11-20 20:24:01.942800] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:56.987 [2024-11-20 20:24:01.942824] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:56.987 [2024-11-20 20:24:01.942844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:56.987 [2024-11-20 20:24:01.942928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:56.987 [2024-11-20 20:24:01.942963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:56.987 [2024-11-20 20:24:01.943020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:56.987 [2024-11-20 20:24:01.943027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:57.922 20:24:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:57.922 20:24:02 -- common/autotest_common.sh@862 -- # return 0 00:22:57.922 20:24:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:57.922 20:24:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:57.922 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.922 20:24:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:57.922 20:24:02 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:57.922 20:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.922 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.922 [2024-11-20 20:24:02.747622] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:57.922 20:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.922 20:24:02 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:57.922 20:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.922 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.922 Malloc0 00:22:57.923 20:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.923 20:24:02 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:57.923 20:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.923 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.923 20:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.923 20:24:02 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:57.923 20:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.923 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.923 20:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.923 20:24:02 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:57.923 20:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.923 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.923 [2024-11-20 20:24:02.798942] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:57.923 20:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.923 20:24:02 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:57.923 20:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.923 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:57.923 [2024-11-20 20:24:02.806695] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:57.923 [ 00:22:57.923 { 00:22:57.923 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:57.923 "subtype": "Discovery", 00:22:57.923 "listen_addresses": [], 00:22:57.923 "allow_any_host": true, 00:22:57.923 "hosts": [] 00:22:57.923 }, 00:22:57.923 { 00:22:57.923 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:57.923 "subtype": "NVMe", 00:22:57.923 "listen_addresses": [ 00:22:57.923 { 00:22:57.923 "transport": "TCP", 00:22:57.923 "trtype": "TCP", 00:22:57.923 "adrfam": "IPv4", 00:22:57.923 "traddr": "10.0.0.2", 00:22:57.923 "trsvcid": "4420" 00:22:57.923 } 00:22:57.923 ], 00:22:57.923 "allow_any_host": true, 00:22:57.923 "hosts": [], 00:22:57.923 "serial_number": "SPDK00000000000001", 00:22:57.923 "model_number": "SPDK bdev Controller", 00:22:57.923 "max_namespaces": 2, 00:22:57.923 "min_cntlid": 1, 00:22:57.923 "max_cntlid": 65519, 00:22:57.923 "namespaces": [ 00:22:57.923 { 00:22:57.923 "nsid": 1, 00:22:57.923 "bdev_name": "Malloc0", 00:22:57.923 "name": "Malloc0", 00:22:57.923 "nguid": "B138CF90A5424402A937C4413B7AB889", 00:22:57.923 "uuid": "b138cf90-a542-4402-a937-c4413b7ab889" 00:22:57.923 } 00:22:57.923 ] 00:22:57.923 } 00:22:57.923 ] 00:22:57.923 20:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.923 20:24:02 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:57.923 20:24:02 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:57.923 20:24:02 -- host/aer.sh@33 -- # aerpid=3230444 00:22:57.923 20:24:02 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:57.923 20:24:02 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:57.923 20:24:02 -- common/autotest_common.sh@1254 -- # local i=0 00:22:57.923 20:24:02 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.923 20:24:02 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:57.923 20:24:02 -- common/autotest_common.sh@1257 -- # i=1 00:22:57.923 20:24:02 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:57.923 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.923 20:24:02 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.923 20:24:02 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:57.923 20:24:02 -- common/autotest_common.sh@1257 -- # i=2 00:22:57.923 20:24:02 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:58.182 20:24:03 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.182 20:24:03 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.182 20:24:03 -- common/autotest_common.sh@1265 -- # return 0 00:22:58.182 20:24:03 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:58.182 20:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.182 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:58.182 Malloc1 00:22:58.182 20:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.182 20:24:03 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:58.182 20:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.182 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:58.182 20:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.182 20:24:03 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:58.182 20:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.182 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:58.182 Asynchronous Event Request test 00:22:58.182 Attaching to 10.0.0.2 00:22:58.182 Attached to 10.0.0.2 00:22:58.182 Registering asynchronous event callbacks... 00:22:58.182 Starting namespace attribute notice tests for all controllers... 00:22:58.182 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:58.182 aer_cb - Changed Namespace 00:22:58.182 Cleaning up... 00:22:58.182 [ 00:22:58.182 { 00:22:58.182 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:58.182 "subtype": "Discovery", 00:22:58.182 "listen_addresses": [], 00:22:58.182 "allow_any_host": true, 00:22:58.182 "hosts": [] 00:22:58.182 }, 00:22:58.182 { 00:22:58.182 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.182 "subtype": "NVMe", 00:22:58.182 "listen_addresses": [ 00:22:58.182 { 00:22:58.182 "transport": "TCP", 00:22:58.182 "trtype": "TCP", 00:22:58.182 "adrfam": "IPv4", 00:22:58.182 "traddr": "10.0.0.2", 00:22:58.182 "trsvcid": "4420" 00:22:58.182 } 00:22:58.182 ], 00:22:58.182 "allow_any_host": true, 00:22:58.182 "hosts": [], 00:22:58.182 "serial_number": "SPDK00000000000001", 00:22:58.182 "model_number": "SPDK bdev Controller", 00:22:58.182 "max_namespaces": 2, 00:22:58.182 "min_cntlid": 1, 00:22:58.182 "max_cntlid": 65519, 00:22:58.182 "namespaces": [ 00:22:58.182 { 00:22:58.182 "nsid": 1, 00:22:58.182 "bdev_name": "Malloc0", 00:22:58.182 "name": "Malloc0", 00:22:58.182 "nguid": "B138CF90A5424402A937C4413B7AB889", 00:22:58.182 "uuid": "b138cf90-a542-4402-a937-c4413b7ab889" 00:22:58.182 }, 00:22:58.182 { 00:22:58.182 "nsid": 2, 00:22:58.182 "bdev_name": "Malloc1", 00:22:58.182 "name": "Malloc1", 00:22:58.182 "nguid": "DA610D35DE8844879F969C7CA6A0E309", 00:22:58.182 "uuid": "da610d35-de88-4487-9f96-9c7ca6a0e309" 00:22:58.182 } 00:22:58.182 ] 00:22:58.182 } 00:22:58.182 ] 00:22:58.182 20:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.182 20:24:03 -- host/aer.sh@43 -- # wait 3230444 00:22:58.182 20:24:03 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:58.182 20:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.182 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:58.182 20:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.182 20:24:03 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:58.182 20:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.182 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:58.182 20:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.182 20:24:03 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:58.182 20:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.182 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:58.182 20:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.182 20:24:03 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:58.182 20:24:03 -- host/aer.sh@51 -- # nvmftestfini 00:22:58.182 20:24:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:58.182 20:24:03 -- nvmf/common.sh@116 -- # sync 00:22:58.182 20:24:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:58.182 20:24:03 -- nvmf/common.sh@119 -- # set +e 00:22:58.182 20:24:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:58.182 20:24:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:58.182 rmmod nvme_tcp 00:22:58.182 rmmod nvme_fabrics 00:22:58.182 rmmod nvme_keyring 00:22:58.441 20:24:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:58.441 20:24:03 -- nvmf/common.sh@123 -- # set -e 00:22:58.441 20:24:03 -- nvmf/common.sh@124 -- # return 0 00:22:58.441 20:24:03 -- nvmf/common.sh@477 -- # '[' -n 3230274 ']' 00:22:58.441 20:24:03 -- nvmf/common.sh@478 -- # killprocess 3230274 00:22:58.441 20:24:03 -- common/autotest_common.sh@936 -- # '[' -z 3230274 ']' 00:22:58.441 20:24:03 -- common/autotest_common.sh@940 -- # kill -0 3230274 00:22:58.441 20:24:03 -- common/autotest_common.sh@941 -- # uname 00:22:58.441 20:24:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:58.441 20:24:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3230274 00:22:58.441 20:24:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:58.441 20:24:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:58.441 20:24:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3230274' 00:22:58.441 killing process with pid 3230274 00:22:58.441 20:24:03 -- common/autotest_common.sh@955 -- # kill 3230274 00:22:58.441 [2024-11-20 20:24:03.278171] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:58.441 20:24:03 -- common/autotest_common.sh@960 -- # wait 3230274 00:22:58.701 20:24:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:58.701 20:24:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:58.701 20:24:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:58.701 20:24:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:58.701 20:24:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:58.701 20:24:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.701 20:24:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.701 20:24:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.606 20:24:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:00.606 00:23:00.606 real 0m6.275s 00:23:00.606 user 0m7.276s 00:23:00.606 sys 0m2.013s 00:23:00.606 20:24:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.606 20:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:00.606 ************************************ 00:23:00.606 END TEST nvmf_aer 00:23:00.606 ************************************ 00:23:00.606 20:24:05 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:00.606 20:24:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.607 20:24:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.607 20:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:00.607 ************************************ 00:23:00.607 START TEST nvmf_async_init 00:23:00.607 ************************************ 00:23:00.607 20:24:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:00.865 * Looking for test storage... 00:23:00.865 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:00.865 20:24:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:00.865 20:24:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:00.865 20:24:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:00.865 20:24:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:00.865 20:24:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:00.865 20:24:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:00.865 20:24:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:00.865 20:24:05 -- scripts/common.sh@335 -- # IFS=.-: 00:23:00.865 20:24:05 -- scripts/common.sh@335 -- # read -ra ver1 00:23:00.865 20:24:05 -- scripts/common.sh@336 -- # IFS=.-: 00:23:00.865 20:24:05 -- scripts/common.sh@336 -- # read -ra ver2 00:23:00.865 20:24:05 -- scripts/common.sh@337 -- # local 'op=<' 00:23:00.865 20:24:05 -- scripts/common.sh@339 -- # ver1_l=2 00:23:00.865 20:24:05 -- scripts/common.sh@340 -- # ver2_l=1 00:23:00.865 20:24:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:00.865 20:24:05 -- scripts/common.sh@343 -- # case "$op" in 00:23:00.865 20:24:05 -- scripts/common.sh@344 -- # : 1 00:23:00.865 20:24:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:00.865 20:24:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:00.865 20:24:05 -- scripts/common.sh@364 -- # decimal 1 00:23:00.865 20:24:05 -- scripts/common.sh@352 -- # local d=1 00:23:00.865 20:24:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:00.865 20:24:05 -- scripts/common.sh@354 -- # echo 1 00:23:00.865 20:24:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:00.865 20:24:05 -- scripts/common.sh@365 -- # decimal 2 00:23:00.865 20:24:05 -- scripts/common.sh@352 -- # local d=2 00:23:00.865 20:24:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:00.865 20:24:05 -- scripts/common.sh@354 -- # echo 2 00:23:00.865 20:24:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:00.865 20:24:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:00.865 20:24:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:00.865 20:24:05 -- scripts/common.sh@367 -- # return 0 00:23:00.865 20:24:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:00.865 20:24:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:00.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.865 --rc genhtml_branch_coverage=1 00:23:00.865 --rc genhtml_function_coverage=1 00:23:00.865 --rc genhtml_legend=1 00:23:00.865 --rc geninfo_all_blocks=1 00:23:00.865 --rc geninfo_unexecuted_blocks=1 00:23:00.865 00:23:00.865 ' 00:23:00.865 20:24:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:00.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.865 --rc genhtml_branch_coverage=1 00:23:00.865 --rc genhtml_function_coverage=1 00:23:00.865 --rc genhtml_legend=1 00:23:00.865 --rc geninfo_all_blocks=1 00:23:00.865 --rc geninfo_unexecuted_blocks=1 00:23:00.865 00:23:00.865 ' 00:23:00.865 20:24:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:00.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.865 --rc genhtml_branch_coverage=1 00:23:00.865 --rc genhtml_function_coverage=1 00:23:00.865 --rc genhtml_legend=1 00:23:00.865 --rc geninfo_all_blocks=1 00:23:00.865 --rc geninfo_unexecuted_blocks=1 00:23:00.865 00:23:00.865 ' 00:23:00.865 20:24:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:00.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.865 --rc genhtml_branch_coverage=1 00:23:00.865 --rc genhtml_function_coverage=1 00:23:00.865 --rc genhtml_legend=1 00:23:00.865 --rc geninfo_all_blocks=1 00:23:00.865 --rc geninfo_unexecuted_blocks=1 00:23:00.865 00:23:00.865 ' 00:23:00.865 20:24:05 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.865 20:24:05 -- nvmf/common.sh@7 -- # uname -s 00:23:00.865 20:24:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.865 20:24:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.865 20:24:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.865 20:24:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.865 20:24:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.865 20:24:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.865 20:24:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.865 20:24:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.865 20:24:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.865 20:24:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.865 20:24:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.865 20:24:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.865 20:24:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.865 20:24:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.865 20:24:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.865 20:24:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:00.865 20:24:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.865 20:24:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.865 20:24:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.865 20:24:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.865 20:24:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.865 20:24:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.865 20:24:05 -- paths/export.sh@5 -- # export PATH 00:23:00.865 20:24:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.865 20:24:05 -- nvmf/common.sh@46 -- # : 0 00:23:00.865 20:24:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:00.865 20:24:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:00.865 20:24:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:00.865 20:24:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.865 20:24:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.865 20:24:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:00.865 20:24:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:00.865 20:24:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:00.865 20:24:05 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:00.865 20:24:05 -- host/async_init.sh@14 -- # null_block_size=512 00:23:00.865 20:24:05 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:00.865 20:24:05 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:00.865 20:24:05 -- host/async_init.sh@20 -- # uuidgen 00:23:00.865 20:24:05 -- host/async_init.sh@20 -- # tr -d - 00:23:00.865 20:24:05 -- host/async_init.sh@20 -- # nguid=7565753802bc4c7596b7aa14e22df0f1 00:23:00.865 20:24:05 -- host/async_init.sh@22 -- # nvmftestinit 00:23:00.865 20:24:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.865 20:24:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.865 20:24:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.865 20:24:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.865 20:24:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.865 20:24:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.865 20:24:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.865 20:24:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.865 20:24:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.865 20:24:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.865 20:24:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.865 20:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:03.398 20:24:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:03.398 20:24:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:03.399 20:24:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:03.399 20:24:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:03.399 20:24:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:03.399 20:24:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:03.399 20:24:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:03.399 20:24:07 -- nvmf/common.sh@294 -- # net_devs=() 00:23:03.399 20:24:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:03.399 20:24:07 -- nvmf/common.sh@295 -- # e810=() 00:23:03.399 20:24:07 -- nvmf/common.sh@295 -- # local -ga e810 00:23:03.399 20:24:07 -- nvmf/common.sh@296 -- # x722=() 00:23:03.399 20:24:07 -- nvmf/common.sh@296 -- # local -ga x722 00:23:03.399 20:24:07 -- nvmf/common.sh@297 -- # mlx=() 00:23:03.399 20:24:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:03.399 20:24:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:03.399 20:24:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:03.399 20:24:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:03.399 20:24:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:03.399 20:24:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.399 20:24:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:03.399 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:03.399 20:24:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.399 20:24:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:03.399 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:03.399 20:24:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:03.399 20:24:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.399 20:24:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.399 20:24:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.399 20:24:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.399 20:24:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:03.399 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:03.399 20:24:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.399 20:24:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.399 20:24:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.399 20:24:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.399 20:24:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.399 20:24:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:03.399 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:03.399 20:24:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.399 20:24:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:03.399 20:24:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:03.399 20:24:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:03.399 20:24:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:03.399 20:24:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:03.399 20:24:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:03.399 20:24:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:03.399 20:24:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:03.399 20:24:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:03.399 20:24:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:03.399 20:24:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:03.399 20:24:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:03.399 20:24:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:03.399 20:24:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:03.399 20:24:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:03.399 20:24:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:03.399 20:24:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:03.399 20:24:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:03.399 20:24:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:03.399 20:24:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:03.399 20:24:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:03.399 20:24:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:03.399 20:24:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:03.399 20:24:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:03.399 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:03.399 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:23:03.399 00:23:03.399 --- 10.0.0.2 ping statistics --- 00:23:03.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.399 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:23:03.399 20:24:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:03.399 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:03.399 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:23:03.399 00:23:03.399 --- 10.0.0.1 ping statistics --- 00:23:03.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.399 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:23:03.399 20:24:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:03.399 20:24:08 -- nvmf/common.sh@410 -- # return 0 00:23:03.399 20:24:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:03.399 20:24:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:03.399 20:24:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:03.399 20:24:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:03.399 20:24:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:03.399 20:24:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:03.399 20:24:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:03.399 20:24:08 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:03.399 20:24:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:03.399 20:24:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:03.399 20:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:03.399 20:24:08 -- nvmf/common.sh@469 -- # nvmfpid=3232860 00:23:03.399 20:24:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:03.399 20:24:08 -- nvmf/common.sh@470 -- # waitforlisten 3232860 00:23:03.399 20:24:08 -- common/autotest_common.sh@829 -- # '[' -z 3232860 ']' 00:23:03.399 20:24:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:03.399 20:24:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:03.399 20:24:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:03.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:03.399 20:24:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:03.399 20:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:03.399 [2024-11-20 20:24:08.069983] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:03.399 [2024-11-20 20:24:08.070089] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:03.399 EAL: No free 2048 kB hugepages reported on node 1 00:23:03.400 [2024-11-20 20:24:08.139826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:03.400 [2024-11-20 20:24:08.253276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:03.400 [2024-11-20 20:24:08.253453] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:03.400 [2024-11-20 20:24:08.253482] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:03.400 [2024-11-20 20:24:08.253504] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:03.400 [2024-11-20 20:24:08.253557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:04.337 20:24:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:04.337 20:24:09 -- common/autotest_common.sh@862 -- # return 0 00:23:04.337 20:24:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:04.337 20:24:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 20:24:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:04.337 20:24:09 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 [2024-11-20 20:24:09.047686] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 null0 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 7565753802bc4c7596b7aa14e22df0f1 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 [2024-11-20 20:24:09.087939] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 nvme0n1 00:23:04.337 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.337 20:24:09 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.337 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.337 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.337 [ 00:23:04.337 { 00:23:04.337 "name": "nvme0n1", 00:23:04.337 "aliases": [ 00:23:04.337 "75657538-02bc-4c75-96b7-aa14e22df0f1" 00:23:04.337 ], 00:23:04.337 "product_name": "NVMe disk", 00:23:04.337 "block_size": 512, 00:23:04.337 "num_blocks": 2097152, 00:23:04.337 "uuid": "75657538-02bc-4c75-96b7-aa14e22df0f1", 00:23:04.337 "assigned_rate_limits": { 00:23:04.337 "rw_ios_per_sec": 0, 00:23:04.337 "rw_mbytes_per_sec": 0, 00:23:04.337 "r_mbytes_per_sec": 0, 00:23:04.337 "w_mbytes_per_sec": 0 00:23:04.337 }, 00:23:04.337 "claimed": false, 00:23:04.337 "zoned": false, 00:23:04.337 "supported_io_types": { 00:23:04.337 "read": true, 00:23:04.337 "write": true, 00:23:04.337 "unmap": false, 00:23:04.337 "write_zeroes": true, 00:23:04.337 "flush": true, 00:23:04.337 "reset": true, 00:23:04.337 "compare": true, 00:23:04.337 "compare_and_write": true, 00:23:04.337 "abort": true, 00:23:04.337 "nvme_admin": true, 00:23:04.337 "nvme_io": true 00:23:04.337 }, 00:23:04.337 "driver_specific": { 00:23:04.337 "nvme": [ 00:23:04.337 { 00:23:04.337 "trid": { 00:23:04.337 "trtype": "TCP", 00:23:04.337 "adrfam": "IPv4", 00:23:04.337 "traddr": "10.0.0.2", 00:23:04.337 "trsvcid": "4420", 00:23:04.337 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.337 }, 00:23:04.337 "ctrlr_data": { 00:23:04.337 "cntlid": 1, 00:23:04.337 "vendor_id": "0x8086", 00:23:04.337 "model_number": "SPDK bdev Controller", 00:23:04.338 "serial_number": "00000000000000000000", 00:23:04.338 "firmware_revision": "24.01.1", 00:23:04.338 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.338 "oacs": { 00:23:04.338 "security": 0, 00:23:04.338 "format": 0, 00:23:04.338 "firmware": 0, 00:23:04.338 "ns_manage": 0 00:23:04.338 }, 00:23:04.338 "multi_ctrlr": true, 00:23:04.338 "ana_reporting": false 00:23:04.338 }, 00:23:04.338 "vs": { 00:23:04.338 "nvme_version": "1.3" 00:23:04.338 }, 00:23:04.338 "ns_data": { 00:23:04.338 "id": 1, 00:23:04.338 "can_share": true 00:23:04.338 } 00:23:04.338 } 00:23:04.338 ], 00:23:04.338 "mp_policy": "active_passive" 00:23:04.338 } 00:23:04.338 } 00:23:04.338 ] 00:23:04.338 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.338 20:24:09 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:04.338 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.338 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.338 [2024-11-20 20:24:09.336465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:04.338 [2024-11-20 20:24:09.336572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b08ba0 (9): Bad file descriptor 00:23:04.595 [2024-11-20 20:24:09.469404] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:04.595 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.595 20:24:09 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 [ 00:23:04.596 { 00:23:04.596 "name": "nvme0n1", 00:23:04.596 "aliases": [ 00:23:04.596 "75657538-02bc-4c75-96b7-aa14e22df0f1" 00:23:04.596 ], 00:23:04.596 "product_name": "NVMe disk", 00:23:04.596 "block_size": 512, 00:23:04.596 "num_blocks": 2097152, 00:23:04.596 "uuid": "75657538-02bc-4c75-96b7-aa14e22df0f1", 00:23:04.596 "assigned_rate_limits": { 00:23:04.596 "rw_ios_per_sec": 0, 00:23:04.596 "rw_mbytes_per_sec": 0, 00:23:04.596 "r_mbytes_per_sec": 0, 00:23:04.596 "w_mbytes_per_sec": 0 00:23:04.596 }, 00:23:04.596 "claimed": false, 00:23:04.596 "zoned": false, 00:23:04.596 "supported_io_types": { 00:23:04.596 "read": true, 00:23:04.596 "write": true, 00:23:04.596 "unmap": false, 00:23:04.596 "write_zeroes": true, 00:23:04.596 "flush": true, 00:23:04.596 "reset": true, 00:23:04.596 "compare": true, 00:23:04.596 "compare_and_write": true, 00:23:04.596 "abort": true, 00:23:04.596 "nvme_admin": true, 00:23:04.596 "nvme_io": true 00:23:04.596 }, 00:23:04.596 "driver_specific": { 00:23:04.596 "nvme": [ 00:23:04.596 { 00:23:04.596 "trid": { 00:23:04.596 "trtype": "TCP", 00:23:04.596 "adrfam": "IPv4", 00:23:04.596 "traddr": "10.0.0.2", 00:23:04.596 "trsvcid": "4420", 00:23:04.596 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.596 }, 00:23:04.596 "ctrlr_data": { 00:23:04.596 "cntlid": 2, 00:23:04.596 "vendor_id": "0x8086", 00:23:04.596 "model_number": "SPDK bdev Controller", 00:23:04.596 "serial_number": "00000000000000000000", 00:23:04.596 "firmware_revision": "24.01.1", 00:23:04.596 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.596 "oacs": { 00:23:04.596 "security": 0, 00:23:04.596 "format": 0, 00:23:04.596 "firmware": 0, 00:23:04.596 "ns_manage": 0 00:23:04.596 }, 00:23:04.596 "multi_ctrlr": true, 00:23:04.596 "ana_reporting": false 00:23:04.596 }, 00:23:04.596 "vs": { 00:23:04.596 "nvme_version": "1.3" 00:23:04.596 }, 00:23:04.596 "ns_data": { 00:23:04.596 "id": 1, 00:23:04.596 "can_share": true 00:23:04.596 } 00:23:04.596 } 00:23:04.596 ], 00:23:04.596 "mp_policy": "active_passive" 00:23:04.596 } 00:23:04.596 } 00:23:04.596 ] 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@53 -- # mktemp 00:23:04.596 20:24:09 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.yziw7u0F9n 00:23:04.596 20:24:09 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:04.596 20:24:09 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.yziw7u0F9n 00:23:04.596 20:24:09 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 [2024-11-20 20:24:09.517061] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:04.596 [2024-11-20 20:24:09.517229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.yziw7u0F9n 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.yziw7u0F9n 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 [2024-11-20 20:24:09.533116] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:04.596 nvme0n1 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.596 [ 00:23:04.596 { 00:23:04.596 "name": "nvme0n1", 00:23:04.596 "aliases": [ 00:23:04.596 "75657538-02bc-4c75-96b7-aa14e22df0f1" 00:23:04.596 ], 00:23:04.596 "product_name": "NVMe disk", 00:23:04.596 "block_size": 512, 00:23:04.596 "num_blocks": 2097152, 00:23:04.596 "uuid": "75657538-02bc-4c75-96b7-aa14e22df0f1", 00:23:04.596 "assigned_rate_limits": { 00:23:04.596 "rw_ios_per_sec": 0, 00:23:04.596 "rw_mbytes_per_sec": 0, 00:23:04.596 "r_mbytes_per_sec": 0, 00:23:04.596 "w_mbytes_per_sec": 0 00:23:04.596 }, 00:23:04.596 "claimed": false, 00:23:04.596 "zoned": false, 00:23:04.596 "supported_io_types": { 00:23:04.596 "read": true, 00:23:04.596 "write": true, 00:23:04.596 "unmap": false, 00:23:04.596 "write_zeroes": true, 00:23:04.596 "flush": true, 00:23:04.596 "reset": true, 00:23:04.596 "compare": true, 00:23:04.596 "compare_and_write": true, 00:23:04.596 "abort": true, 00:23:04.596 "nvme_admin": true, 00:23:04.596 "nvme_io": true 00:23:04.596 }, 00:23:04.596 "driver_specific": { 00:23:04.596 "nvme": [ 00:23:04.596 { 00:23:04.596 "trid": { 00:23:04.596 "trtype": "TCP", 00:23:04.596 "adrfam": "IPv4", 00:23:04.596 "traddr": "10.0.0.2", 00:23:04.596 "trsvcid": "4421", 00:23:04.596 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.596 }, 00:23:04.596 "ctrlr_data": { 00:23:04.596 "cntlid": 3, 00:23:04.596 "vendor_id": "0x8086", 00:23:04.596 "model_number": "SPDK bdev Controller", 00:23:04.596 "serial_number": "00000000000000000000", 00:23:04.596 "firmware_revision": "24.01.1", 00:23:04.596 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.596 "oacs": { 00:23:04.596 "security": 0, 00:23:04.596 "format": 0, 00:23:04.596 "firmware": 0, 00:23:04.596 "ns_manage": 0 00:23:04.596 }, 00:23:04.596 "multi_ctrlr": true, 00:23:04.596 "ana_reporting": false 00:23:04.596 }, 00:23:04.596 "vs": { 00:23:04.596 "nvme_version": "1.3" 00:23:04.596 }, 00:23:04.596 "ns_data": { 00:23:04.596 "id": 1, 00:23:04.596 "can_share": true 00:23:04.596 } 00:23:04.596 } 00:23:04.596 ], 00:23:04.596 "mp_policy": "active_passive" 00:23:04.596 } 00:23:04.596 } 00:23:04.596 ] 00:23:04.596 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.596 20:24:09 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:04.596 20:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.596 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:04.857 20:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.857 20:24:09 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.yziw7u0F9n 00:23:04.857 20:24:09 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:04.857 20:24:09 -- host/async_init.sh@78 -- # nvmftestfini 00:23:04.857 20:24:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:04.857 20:24:09 -- nvmf/common.sh@116 -- # sync 00:23:04.857 20:24:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:04.857 20:24:09 -- nvmf/common.sh@119 -- # set +e 00:23:04.857 20:24:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:04.857 20:24:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:04.857 rmmod nvme_tcp 00:23:04.857 rmmod nvme_fabrics 00:23:04.857 rmmod nvme_keyring 00:23:04.857 20:24:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:04.857 20:24:09 -- nvmf/common.sh@123 -- # set -e 00:23:04.857 20:24:09 -- nvmf/common.sh@124 -- # return 0 00:23:04.857 20:24:09 -- nvmf/common.sh@477 -- # '[' -n 3232860 ']' 00:23:04.857 20:24:09 -- nvmf/common.sh@478 -- # killprocess 3232860 00:23:04.857 20:24:09 -- common/autotest_common.sh@936 -- # '[' -z 3232860 ']' 00:23:04.857 20:24:09 -- common/autotest_common.sh@940 -- # kill -0 3232860 00:23:04.857 20:24:09 -- common/autotest_common.sh@941 -- # uname 00:23:04.857 20:24:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:04.857 20:24:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3232860 00:23:04.857 20:24:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:04.857 20:24:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:04.857 20:24:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3232860' 00:23:04.857 killing process with pid 3232860 00:23:04.857 20:24:09 -- common/autotest_common.sh@955 -- # kill 3232860 00:23:04.857 20:24:09 -- common/autotest_common.sh@960 -- # wait 3232860 00:23:05.118 20:24:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:05.118 20:24:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:05.118 20:24:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:05.118 20:24:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:05.118 20:24:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:05.118 20:24:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:05.118 20:24:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:05.118 20:24:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.027 20:24:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:07.027 00:23:07.027 real 0m6.397s 00:23:07.027 user 0m3.010s 00:23:07.027 sys 0m1.955s 00:23:07.027 20:24:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:07.027 20:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:07.027 ************************************ 00:23:07.027 END TEST nvmf_async_init 00:23:07.027 ************************************ 00:23:07.287 20:24:12 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:07.287 20:24:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:07.287 20:24:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:07.287 20:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:07.287 ************************************ 00:23:07.287 START TEST dma 00:23:07.287 ************************************ 00:23:07.287 20:24:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:07.287 * Looking for test storage... 00:23:07.287 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:07.287 20:24:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:07.287 20:24:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:07.287 20:24:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:07.287 20:24:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:07.287 20:24:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:07.287 20:24:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:07.287 20:24:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:07.287 20:24:12 -- scripts/common.sh@335 -- # IFS=.-: 00:23:07.287 20:24:12 -- scripts/common.sh@335 -- # read -ra ver1 00:23:07.287 20:24:12 -- scripts/common.sh@336 -- # IFS=.-: 00:23:07.287 20:24:12 -- scripts/common.sh@336 -- # read -ra ver2 00:23:07.287 20:24:12 -- scripts/common.sh@337 -- # local 'op=<' 00:23:07.287 20:24:12 -- scripts/common.sh@339 -- # ver1_l=2 00:23:07.287 20:24:12 -- scripts/common.sh@340 -- # ver2_l=1 00:23:07.287 20:24:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:07.287 20:24:12 -- scripts/common.sh@343 -- # case "$op" in 00:23:07.287 20:24:12 -- scripts/common.sh@344 -- # : 1 00:23:07.287 20:24:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:07.287 20:24:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:07.287 20:24:12 -- scripts/common.sh@364 -- # decimal 1 00:23:07.287 20:24:12 -- scripts/common.sh@352 -- # local d=1 00:23:07.287 20:24:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:07.287 20:24:12 -- scripts/common.sh@354 -- # echo 1 00:23:07.287 20:24:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:07.287 20:24:12 -- scripts/common.sh@365 -- # decimal 2 00:23:07.287 20:24:12 -- scripts/common.sh@352 -- # local d=2 00:23:07.287 20:24:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:07.287 20:24:12 -- scripts/common.sh@354 -- # echo 2 00:23:07.287 20:24:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:07.287 20:24:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:07.287 20:24:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:07.287 20:24:12 -- scripts/common.sh@367 -- # return 0 00:23:07.287 20:24:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:07.287 20:24:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:07.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.287 --rc genhtml_branch_coverage=1 00:23:07.287 --rc genhtml_function_coverage=1 00:23:07.287 --rc genhtml_legend=1 00:23:07.287 --rc geninfo_all_blocks=1 00:23:07.287 --rc geninfo_unexecuted_blocks=1 00:23:07.287 00:23:07.287 ' 00:23:07.287 20:24:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:07.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.287 --rc genhtml_branch_coverage=1 00:23:07.287 --rc genhtml_function_coverage=1 00:23:07.287 --rc genhtml_legend=1 00:23:07.287 --rc geninfo_all_blocks=1 00:23:07.287 --rc geninfo_unexecuted_blocks=1 00:23:07.287 00:23:07.287 ' 00:23:07.287 20:24:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:07.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.287 --rc genhtml_branch_coverage=1 00:23:07.287 --rc genhtml_function_coverage=1 00:23:07.287 --rc genhtml_legend=1 00:23:07.287 --rc geninfo_all_blocks=1 00:23:07.287 --rc geninfo_unexecuted_blocks=1 00:23:07.287 00:23:07.287 ' 00:23:07.287 20:24:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:07.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.287 --rc genhtml_branch_coverage=1 00:23:07.287 --rc genhtml_function_coverage=1 00:23:07.287 --rc genhtml_legend=1 00:23:07.287 --rc geninfo_all_blocks=1 00:23:07.287 --rc geninfo_unexecuted_blocks=1 00:23:07.287 00:23:07.287 ' 00:23:07.287 20:24:12 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:07.287 20:24:12 -- nvmf/common.sh@7 -- # uname -s 00:23:07.287 20:24:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:07.287 20:24:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:07.287 20:24:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:07.287 20:24:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:07.287 20:24:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:07.287 20:24:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:07.287 20:24:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:07.287 20:24:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:07.287 20:24:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:07.287 20:24:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:07.287 20:24:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.287 20:24:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.287 20:24:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:07.287 20:24:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:07.287 20:24:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:07.287 20:24:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:07.287 20:24:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:07.287 20:24:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:07.287 20:24:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:07.287 20:24:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.287 20:24:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.287 20:24:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.287 20:24:12 -- paths/export.sh@5 -- # export PATH 00:23:07.287 20:24:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.287 20:24:12 -- nvmf/common.sh@46 -- # : 0 00:23:07.287 20:24:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:07.287 20:24:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:07.287 20:24:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:07.287 20:24:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:07.287 20:24:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:07.287 20:24:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:07.287 20:24:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:07.287 20:24:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:07.287 20:24:12 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:07.287 20:24:12 -- host/dma.sh@13 -- # exit 0 00:23:07.287 00:23:07.287 real 0m0.180s 00:23:07.287 user 0m0.119s 00:23:07.287 sys 0m0.069s 00:23:07.287 20:24:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:07.287 20:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:07.287 ************************************ 00:23:07.287 END TEST dma 00:23:07.287 ************************************ 00:23:07.288 20:24:12 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:07.288 20:24:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:07.288 20:24:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:07.288 20:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:07.288 ************************************ 00:23:07.288 START TEST nvmf_identify 00:23:07.288 ************************************ 00:23:07.288 20:24:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:07.288 * Looking for test storage... 00:23:07.547 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:07.547 20:24:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:07.547 20:24:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:07.547 20:24:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:07.547 20:24:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:07.547 20:24:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:07.547 20:24:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:07.547 20:24:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:07.547 20:24:12 -- scripts/common.sh@335 -- # IFS=.-: 00:23:07.547 20:24:12 -- scripts/common.sh@335 -- # read -ra ver1 00:23:07.547 20:24:12 -- scripts/common.sh@336 -- # IFS=.-: 00:23:07.547 20:24:12 -- scripts/common.sh@336 -- # read -ra ver2 00:23:07.547 20:24:12 -- scripts/common.sh@337 -- # local 'op=<' 00:23:07.547 20:24:12 -- scripts/common.sh@339 -- # ver1_l=2 00:23:07.547 20:24:12 -- scripts/common.sh@340 -- # ver2_l=1 00:23:07.547 20:24:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:07.547 20:24:12 -- scripts/common.sh@343 -- # case "$op" in 00:23:07.547 20:24:12 -- scripts/common.sh@344 -- # : 1 00:23:07.547 20:24:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:07.547 20:24:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:07.547 20:24:12 -- scripts/common.sh@364 -- # decimal 1 00:23:07.547 20:24:12 -- scripts/common.sh@352 -- # local d=1 00:23:07.547 20:24:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:07.547 20:24:12 -- scripts/common.sh@354 -- # echo 1 00:23:07.547 20:24:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:07.548 20:24:12 -- scripts/common.sh@365 -- # decimal 2 00:23:07.548 20:24:12 -- scripts/common.sh@352 -- # local d=2 00:23:07.548 20:24:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:07.548 20:24:12 -- scripts/common.sh@354 -- # echo 2 00:23:07.548 20:24:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:07.548 20:24:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:07.548 20:24:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:07.548 20:24:12 -- scripts/common.sh@367 -- # return 0 00:23:07.548 20:24:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:07.548 20:24:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:07.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.548 --rc genhtml_branch_coverage=1 00:23:07.548 --rc genhtml_function_coverage=1 00:23:07.548 --rc genhtml_legend=1 00:23:07.548 --rc geninfo_all_blocks=1 00:23:07.548 --rc geninfo_unexecuted_blocks=1 00:23:07.548 00:23:07.548 ' 00:23:07.548 20:24:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:07.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.548 --rc genhtml_branch_coverage=1 00:23:07.548 --rc genhtml_function_coverage=1 00:23:07.548 --rc genhtml_legend=1 00:23:07.548 --rc geninfo_all_blocks=1 00:23:07.548 --rc geninfo_unexecuted_blocks=1 00:23:07.548 00:23:07.548 ' 00:23:07.548 20:24:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:07.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.548 --rc genhtml_branch_coverage=1 00:23:07.548 --rc genhtml_function_coverage=1 00:23:07.548 --rc genhtml_legend=1 00:23:07.548 --rc geninfo_all_blocks=1 00:23:07.548 --rc geninfo_unexecuted_blocks=1 00:23:07.548 00:23:07.548 ' 00:23:07.548 20:24:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:07.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.548 --rc genhtml_branch_coverage=1 00:23:07.548 --rc genhtml_function_coverage=1 00:23:07.548 --rc genhtml_legend=1 00:23:07.548 --rc geninfo_all_blocks=1 00:23:07.548 --rc geninfo_unexecuted_blocks=1 00:23:07.548 00:23:07.548 ' 00:23:07.548 20:24:12 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:07.548 20:24:12 -- nvmf/common.sh@7 -- # uname -s 00:23:07.548 20:24:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:07.548 20:24:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:07.548 20:24:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:07.548 20:24:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:07.548 20:24:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:07.548 20:24:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:07.548 20:24:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:07.548 20:24:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:07.548 20:24:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:07.548 20:24:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:07.548 20:24:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.548 20:24:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.548 20:24:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:07.548 20:24:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:07.548 20:24:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:07.548 20:24:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:07.548 20:24:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:07.548 20:24:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:07.548 20:24:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:07.548 20:24:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.548 20:24:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.548 20:24:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.548 20:24:12 -- paths/export.sh@5 -- # export PATH 00:23:07.548 20:24:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.548 20:24:12 -- nvmf/common.sh@46 -- # : 0 00:23:07.548 20:24:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:07.548 20:24:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:07.548 20:24:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:07.548 20:24:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:07.548 20:24:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:07.548 20:24:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:07.548 20:24:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:07.548 20:24:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:07.548 20:24:12 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:07.548 20:24:12 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:07.548 20:24:12 -- host/identify.sh@14 -- # nvmftestinit 00:23:07.548 20:24:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:07.548 20:24:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:07.548 20:24:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:07.548 20:24:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:07.548 20:24:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:07.548 20:24:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.548 20:24:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:07.548 20:24:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.548 20:24:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:07.548 20:24:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:07.548 20:24:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:07.548 20:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:09.454 20:24:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:09.454 20:24:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:09.454 20:24:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:09.454 20:24:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:09.454 20:24:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:09.454 20:24:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:09.454 20:24:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:09.454 20:24:14 -- nvmf/common.sh@294 -- # net_devs=() 00:23:09.454 20:24:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:09.454 20:24:14 -- nvmf/common.sh@295 -- # e810=() 00:23:09.454 20:24:14 -- nvmf/common.sh@295 -- # local -ga e810 00:23:09.454 20:24:14 -- nvmf/common.sh@296 -- # x722=() 00:23:09.454 20:24:14 -- nvmf/common.sh@296 -- # local -ga x722 00:23:09.454 20:24:14 -- nvmf/common.sh@297 -- # mlx=() 00:23:09.454 20:24:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:09.454 20:24:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:09.454 20:24:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:09.455 20:24:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:09.455 20:24:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:09.455 20:24:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.455 20:24:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:09.455 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:09.455 20:24:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.455 20:24:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:09.455 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:09.455 20:24:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:09.455 20:24:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.455 20:24:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.455 20:24:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.455 20:24:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.455 20:24:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:09.455 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:09.455 20:24:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.455 20:24:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.455 20:24:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.455 20:24:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.455 20:24:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.455 20:24:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:09.455 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:09.455 20:24:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.455 20:24:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:09.455 20:24:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:09.455 20:24:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:09.455 20:24:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:09.455 20:24:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:09.455 20:24:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:09.455 20:24:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:09.455 20:24:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:09.455 20:24:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:09.455 20:24:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:09.455 20:24:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:09.455 20:24:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:09.455 20:24:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:09.455 20:24:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:09.455 20:24:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:09.455 20:24:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:09.455 20:24:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:09.455 20:24:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:09.455 20:24:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:09.455 20:24:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:09.455 20:24:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:09.455 20:24:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:09.455 20:24:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:09.455 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:09.455 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:23:09.455 00:23:09.455 --- 10.0.0.2 ping statistics --- 00:23:09.455 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.455 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:23:09.455 20:24:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:09.455 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:09.455 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:23:09.455 00:23:09.455 --- 10.0.0.1 ping statistics --- 00:23:09.455 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.455 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:23:09.455 20:24:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:09.455 20:24:14 -- nvmf/common.sh@410 -- # return 0 00:23:09.455 20:24:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:09.455 20:24:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:09.455 20:24:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:09.455 20:24:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:09.455 20:24:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:09.455 20:24:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:09.455 20:24:14 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:09.455 20:24:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:09.455 20:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:09.455 20:24:14 -- host/identify.sh@19 -- # nvmfpid=3235308 00:23:09.455 20:24:14 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:09.455 20:24:14 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:09.455 20:24:14 -- host/identify.sh@23 -- # waitforlisten 3235308 00:23:09.455 20:24:14 -- common/autotest_common.sh@829 -- # '[' -z 3235308 ']' 00:23:09.455 20:24:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:09.455 20:24:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:09.455 20:24:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:09.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:09.455 20:24:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:09.455 20:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:09.744 [2024-11-20 20:24:14.504409] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:09.745 [2024-11-20 20:24:14.504498] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:09.745 EAL: No free 2048 kB hugepages reported on node 1 00:23:09.745 [2024-11-20 20:24:14.566906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:09.745 [2024-11-20 20:24:14.676053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:09.745 [2024-11-20 20:24:14.676223] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:09.745 [2024-11-20 20:24:14.676241] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:09.745 [2024-11-20 20:24:14.676265] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:09.745 [2024-11-20 20:24:14.676330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:09.745 [2024-11-20 20:24:14.676447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:09.745 [2024-11-20 20:24:14.676640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:09.745 [2024-11-20 20:24:14.676643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:10.707 20:24:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:10.707 20:24:15 -- common/autotest_common.sh@862 -- # return 0 00:23:10.707 20:24:15 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 [2024-11-20 20:24:15.496669] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:10.707 20:24:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 20:24:15 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 Malloc0 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 [2024-11-20 20:24:15.573836] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:10.707 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.707 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.707 [2024-11-20 20:24:15.589577] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:10.707 [ 00:23:10.707 { 00:23:10.707 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:10.707 "subtype": "Discovery", 00:23:10.707 "listen_addresses": [ 00:23:10.707 { 00:23:10.707 "transport": "TCP", 00:23:10.707 "trtype": "TCP", 00:23:10.707 "adrfam": "IPv4", 00:23:10.707 "traddr": "10.0.0.2", 00:23:10.707 "trsvcid": "4420" 00:23:10.707 } 00:23:10.707 ], 00:23:10.707 "allow_any_host": true, 00:23:10.707 "hosts": [] 00:23:10.707 }, 00:23:10.707 { 00:23:10.707 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:10.707 "subtype": "NVMe", 00:23:10.707 "listen_addresses": [ 00:23:10.707 { 00:23:10.707 "transport": "TCP", 00:23:10.707 "trtype": "TCP", 00:23:10.707 "adrfam": "IPv4", 00:23:10.707 "traddr": "10.0.0.2", 00:23:10.707 "trsvcid": "4420" 00:23:10.707 } 00:23:10.707 ], 00:23:10.707 "allow_any_host": true, 00:23:10.707 "hosts": [], 00:23:10.707 "serial_number": "SPDK00000000000001", 00:23:10.707 "model_number": "SPDK bdev Controller", 00:23:10.707 "max_namespaces": 32, 00:23:10.707 "min_cntlid": 1, 00:23:10.707 "max_cntlid": 65519, 00:23:10.707 "namespaces": [ 00:23:10.707 { 00:23:10.707 "nsid": 1, 00:23:10.707 "bdev_name": "Malloc0", 00:23:10.707 "name": "Malloc0", 00:23:10.707 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:10.707 "eui64": "ABCDEF0123456789", 00:23:10.707 "uuid": "a575b24a-2ec3-4393-b9d9-9aa3dbcaea4b" 00:23:10.707 } 00:23:10.707 ] 00:23:10.707 } 00:23:10.707 ] 00:23:10.707 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.707 20:24:15 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:10.707 [2024-11-20 20:24:15.615378] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.707 [2024-11-20 20:24:15.615418] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3235469 ] 00:23:10.707 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.707 [2024-11-20 20:24:15.651356] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:10.707 [2024-11-20 20:24:15.651447] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:10.707 [2024-11-20 20:24:15.651458] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:10.707 [2024-11-20 20:24:15.651474] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:10.707 [2024-11-20 20:24:15.651488] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:10.707 [2024-11-20 20:24:15.651720] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:10.707 [2024-11-20 20:24:15.651780] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x60ce10 0 00:23:10.707 [2024-11-20 20:24:15.658086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:10.707 [2024-11-20 20:24:15.658108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:10.707 [2024-11-20 20:24:15.658116] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:10.707 [2024-11-20 20:24:15.658122] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:10.707 [2024-11-20 20:24:15.658192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.658206] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.658214] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.707 [2024-11-20 20:24:15.658235] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:10.707 [2024-11-20 20:24:15.658262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.707 [2024-11-20 20:24:15.665095] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.707 [2024-11-20 20:24:15.665114] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.707 [2024-11-20 20:24:15.665121] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665128] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.707 [2024-11-20 20:24:15.665145] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:10.707 [2024-11-20 20:24:15.665171] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:10.707 [2024-11-20 20:24:15.665182] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:10.707 [2024-11-20 20:24:15.665204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665212] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665219] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.707 [2024-11-20 20:24:15.665235] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.707 [2024-11-20 20:24:15.665260] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.707 [2024-11-20 20:24:15.665367] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.707 [2024-11-20 20:24:15.665395] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.707 [2024-11-20 20:24:15.665401] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665408] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.707 [2024-11-20 20:24:15.665418] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:10.707 [2024-11-20 20:24:15.665430] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:10.707 [2024-11-20 20:24:15.665442] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665449] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665455] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.707 [2024-11-20 20:24:15.665465] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.707 [2024-11-20 20:24:15.665485] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.707 [2024-11-20 20:24:15.665572] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.707 [2024-11-20 20:24:15.665584] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.707 [2024-11-20 20:24:15.665590] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.707 [2024-11-20 20:24:15.665596] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.665605] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:10.708 [2024-11-20 20:24:15.665619] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:10.708 [2024-11-20 20:24:15.665630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.665637] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.665643] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.665653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.708 [2024-11-20 20:24:15.665672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.708 [2024-11-20 20:24:15.665753] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.708 [2024-11-20 20:24:15.665764] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.708 [2024-11-20 20:24:15.665770] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.665777] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.665786] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:10.708 [2024-11-20 20:24:15.665802] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.665810] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.665816] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.665826] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.708 [2024-11-20 20:24:15.665845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.708 [2024-11-20 20:24:15.665933] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.708 [2024-11-20 20:24:15.665948] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.708 [2024-11-20 20:24:15.665954] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.665960] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.665969] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:10.708 [2024-11-20 20:24:15.665977] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:10.708 [2024-11-20 20:24:15.665990] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:10.708 [2024-11-20 20:24:15.666102] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:10.708 [2024-11-20 20:24:15.666113] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:10.708 [2024-11-20 20:24:15.666131] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666138] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666145] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.666155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.708 [2024-11-20 20:24:15.666177] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.708 [2024-11-20 20:24:15.666276] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.708 [2024-11-20 20:24:15.666291] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.708 [2024-11-20 20:24:15.666298] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666304] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.666313] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:10.708 [2024-11-20 20:24:15.666329] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666338] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666344] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.666370] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.708 [2024-11-20 20:24:15.666391] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.708 [2024-11-20 20:24:15.666474] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.708 [2024-11-20 20:24:15.666485] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.708 [2024-11-20 20:24:15.666492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666498] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.666506] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:10.708 [2024-11-20 20:24:15.666514] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:10.708 [2024-11-20 20:24:15.666526] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:10.708 [2024-11-20 20:24:15.666549] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:10.708 [2024-11-20 20:24:15.666569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666577] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666583] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.666594] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.708 [2024-11-20 20:24:15.666615] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.708 [2024-11-20 20:24:15.666750] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.708 [2024-11-20 20:24:15.666765] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.708 [2024-11-20 20:24:15.666772] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666779] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x60ce10): datao=0, datal=4096, cccid=0 00:23:10.708 [2024-11-20 20:24:15.666787] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x68cb30) on tqpair(0x60ce10): expected_datao=0, payload_size=4096 00:23:10.708 [2024-11-20 20:24:15.666807] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.666817] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708179] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.708 [2024-11-20 20:24:15.708200] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.708 [2024-11-20 20:24:15.708208] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708215] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.708229] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:10.708 [2024-11-20 20:24:15.708239] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:10.708 [2024-11-20 20:24:15.708247] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:10.708 [2024-11-20 20:24:15.708256] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:10.708 [2024-11-20 20:24:15.708263] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:10.708 [2024-11-20 20:24:15.708272] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:10.708 [2024-11-20 20:24:15.708293] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:10.708 [2024-11-20 20:24:15.708308] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708315] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708322] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.708333] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.708 [2024-11-20 20:24:15.708357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.708 [2024-11-20 20:24:15.708484] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.708 [2024-11-20 20:24:15.708499] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.708 [2024-11-20 20:24:15.708505] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708512] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cb30) on tqpair=0x60ce10 00:23:10.708 [2024-11-20 20:24:15.708527] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708534] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708545] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.708556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.708 [2024-11-20 20:24:15.708566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.708587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.708 [2024-11-20 20:24:15.708596] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708602] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708608] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.708616] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.708 [2024-11-20 20:24:15.708626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708632] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.708 [2024-11-20 20:24:15.708638] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.708 [2024-11-20 20:24:15.708646] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.709 [2024-11-20 20:24:15.708655] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:10.709 [2024-11-20 20:24:15.708674] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:10.709 [2024-11-20 20:24:15.708687] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.708693] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.708699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x60ce10) 00:23:10.709 [2024-11-20 20:24:15.708710] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.709 [2024-11-20 20:24:15.708732] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cb30, cid 0, qid 0 00:23:10.709 [2024-11-20 20:24:15.708743] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cc90, cid 1, qid 0 00:23:10.709 [2024-11-20 20:24:15.708751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cdf0, cid 2, qid 0 00:23:10.709 [2024-11-20 20:24:15.708758] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.709 [2024-11-20 20:24:15.708765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68d0b0, cid 4, qid 0 00:23:10.709 [2024-11-20 20:24:15.708886] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.709 [2024-11-20 20:24:15.708898] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.709 [2024-11-20 20:24:15.708904] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.708910] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68d0b0) on tqpair=0x60ce10 00:23:10.709 [2024-11-20 20:24:15.708920] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:10.709 [2024-11-20 20:24:15.708929] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:10.709 [2024-11-20 20:24:15.708945] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.708954] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.708964] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x60ce10) 00:23:10.709 [2024-11-20 20:24:15.708975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.709 [2024-11-20 20:24:15.708995] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68d0b0, cid 4, qid 0 00:23:10.709 [2024-11-20 20:24:15.713096] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.709 [2024-11-20 20:24:15.713112] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.709 [2024-11-20 20:24:15.713119] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713125] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x60ce10): datao=0, datal=4096, cccid=4 00:23:10.709 [2024-11-20 20:24:15.713132] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x68d0b0) on tqpair(0x60ce10): expected_datao=0, payload_size=4096 00:23:10.709 [2024-11-20 20:24:15.713143] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713150] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713158] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.709 [2024-11-20 20:24:15.713167] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.709 [2024-11-20 20:24:15.713172] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713179] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68d0b0) on tqpair=0x60ce10 00:23:10.709 [2024-11-20 20:24:15.713199] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:10.709 [2024-11-20 20:24:15.713259] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713270] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713276] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x60ce10) 00:23:10.709 [2024-11-20 20:24:15.713287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.709 [2024-11-20 20:24:15.713299] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713306] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713312] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x60ce10) 00:23:10.709 [2024-11-20 20:24:15.713321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.709 [2024-11-20 20:24:15.713350] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68d0b0, cid 4, qid 0 00:23:10.709 [2024-11-20 20:24:15.713362] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68d210, cid 5, qid 0 00:23:10.709 [2024-11-20 20:24:15.713533] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.709 [2024-11-20 20:24:15.713545] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.709 [2024-11-20 20:24:15.713551] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713557] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x60ce10): datao=0, datal=1024, cccid=4 00:23:10.709 [2024-11-20 20:24:15.713564] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x68d0b0) on tqpair(0x60ce10): expected_datao=0, payload_size=1024 00:23:10.709 [2024-11-20 20:24:15.713574] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713581] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713590] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.709 [2024-11-20 20:24:15.713598] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.709 [2024-11-20 20:24:15.713604] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.709 [2024-11-20 20:24:15.713610] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68d210) on tqpair=0x60ce10 00:23:10.972 [2024-11-20 20:24:15.754155] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.972 [2024-11-20 20:24:15.754176] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.972 [2024-11-20 20:24:15.754184] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754190] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68d0b0) on tqpair=0x60ce10 00:23:10.972 [2024-11-20 20:24:15.754210] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754226] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x60ce10) 00:23:10.972 [2024-11-20 20:24:15.754237] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.972 [2024-11-20 20:24:15.754267] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68d0b0, cid 4, qid 0 00:23:10.972 [2024-11-20 20:24:15.754386] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.972 [2024-11-20 20:24:15.754398] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.972 [2024-11-20 20:24:15.754404] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754425] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x60ce10): datao=0, datal=3072, cccid=4 00:23:10.972 [2024-11-20 20:24:15.754436] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x68d0b0) on tqpair(0x60ce10): expected_datao=0, payload_size=3072 00:23:10.972 [2024-11-20 20:24:15.754448] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754455] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754467] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.972 [2024-11-20 20:24:15.754476] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.972 [2024-11-20 20:24:15.754482] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754488] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68d0b0) on tqpair=0x60ce10 00:23:10.972 [2024-11-20 20:24:15.754504] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754512] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754518] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x60ce10) 00:23:10.972 [2024-11-20 20:24:15.754528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.972 [2024-11-20 20:24:15.754555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68d0b0, cid 4, qid 0 00:23:10.972 [2024-11-20 20:24:15.754660] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.972 [2024-11-20 20:24:15.754672] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.972 [2024-11-20 20:24:15.754678] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754684] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x60ce10): datao=0, datal=8, cccid=4 00:23:10.972 [2024-11-20 20:24:15.754691] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x68d0b0) on tqpair(0x60ce10): expected_datao=0, payload_size=8 00:23:10.972 [2024-11-20 20:24:15.754701] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.972 [2024-11-20 20:24:15.754708] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.973 [2024-11-20 20:24:15.795156] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.973 [2024-11-20 20:24:15.795174] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.973 [2024-11-20 20:24:15.795181] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.973 [2024-11-20 20:24:15.795188] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68d0b0) on tqpair=0x60ce10 00:23:10.973 ===================================================== 00:23:10.973 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:10.973 ===================================================== 00:23:10.973 Controller Capabilities/Features 00:23:10.973 ================================ 00:23:10.973 Vendor ID: 0000 00:23:10.973 Subsystem Vendor ID: 0000 00:23:10.973 Serial Number: .................... 00:23:10.973 Model Number: ........................................ 00:23:10.973 Firmware Version: 24.01.1 00:23:10.973 Recommended Arb Burst: 0 00:23:10.973 IEEE OUI Identifier: 00 00 00 00:23:10.973 Multi-path I/O 00:23:10.973 May have multiple subsystem ports: No 00:23:10.973 May have multiple controllers: No 00:23:10.973 Associated with SR-IOV VF: No 00:23:10.973 Max Data Transfer Size: 131072 00:23:10.973 Max Number of Namespaces: 0 00:23:10.973 Max Number of I/O Queues: 1024 00:23:10.973 NVMe Specification Version (VS): 1.3 00:23:10.973 NVMe Specification Version (Identify): 1.3 00:23:10.973 Maximum Queue Entries: 128 00:23:10.973 Contiguous Queues Required: Yes 00:23:10.973 Arbitration Mechanisms Supported 00:23:10.973 Weighted Round Robin: Not Supported 00:23:10.973 Vendor Specific: Not Supported 00:23:10.973 Reset Timeout: 15000 ms 00:23:10.973 Doorbell Stride: 4 bytes 00:23:10.973 NVM Subsystem Reset: Not Supported 00:23:10.973 Command Sets Supported 00:23:10.973 NVM Command Set: Supported 00:23:10.973 Boot Partition: Not Supported 00:23:10.973 Memory Page Size Minimum: 4096 bytes 00:23:10.973 Memory Page Size Maximum: 4096 bytes 00:23:10.973 Persistent Memory Region: Not Supported 00:23:10.973 Optional Asynchronous Events Supported 00:23:10.973 Namespace Attribute Notices: Not Supported 00:23:10.973 Firmware Activation Notices: Not Supported 00:23:10.973 ANA Change Notices: Not Supported 00:23:10.973 PLE Aggregate Log Change Notices: Not Supported 00:23:10.973 LBA Status Info Alert Notices: Not Supported 00:23:10.973 EGE Aggregate Log Change Notices: Not Supported 00:23:10.973 Normal NVM Subsystem Shutdown event: Not Supported 00:23:10.973 Zone Descriptor Change Notices: Not Supported 00:23:10.973 Discovery Log Change Notices: Supported 00:23:10.973 Controller Attributes 00:23:10.973 128-bit Host Identifier: Not Supported 00:23:10.973 Non-Operational Permissive Mode: Not Supported 00:23:10.973 NVM Sets: Not Supported 00:23:10.973 Read Recovery Levels: Not Supported 00:23:10.973 Endurance Groups: Not Supported 00:23:10.973 Predictable Latency Mode: Not Supported 00:23:10.973 Traffic Based Keep ALive: Not Supported 00:23:10.973 Namespace Granularity: Not Supported 00:23:10.973 SQ Associations: Not Supported 00:23:10.973 UUID List: Not Supported 00:23:10.973 Multi-Domain Subsystem: Not Supported 00:23:10.973 Fixed Capacity Management: Not Supported 00:23:10.973 Variable Capacity Management: Not Supported 00:23:10.973 Delete Endurance Group: Not Supported 00:23:10.973 Delete NVM Set: Not Supported 00:23:10.973 Extended LBA Formats Supported: Not Supported 00:23:10.973 Flexible Data Placement Supported: Not Supported 00:23:10.973 00:23:10.973 Controller Memory Buffer Support 00:23:10.973 ================================ 00:23:10.973 Supported: No 00:23:10.973 00:23:10.973 Persistent Memory Region Support 00:23:10.973 ================================ 00:23:10.973 Supported: No 00:23:10.973 00:23:10.973 Admin Command Set Attributes 00:23:10.973 ============================ 00:23:10.973 Security Send/Receive: Not Supported 00:23:10.973 Format NVM: Not Supported 00:23:10.973 Firmware Activate/Download: Not Supported 00:23:10.973 Namespace Management: Not Supported 00:23:10.973 Device Self-Test: Not Supported 00:23:10.973 Directives: Not Supported 00:23:10.973 NVMe-MI: Not Supported 00:23:10.973 Virtualization Management: Not Supported 00:23:10.973 Doorbell Buffer Config: Not Supported 00:23:10.973 Get LBA Status Capability: Not Supported 00:23:10.973 Command & Feature Lockdown Capability: Not Supported 00:23:10.973 Abort Command Limit: 1 00:23:10.973 Async Event Request Limit: 4 00:23:10.973 Number of Firmware Slots: N/A 00:23:10.973 Firmware Slot 1 Read-Only: N/A 00:23:10.973 Firmware Activation Without Reset: N/A 00:23:10.973 Multiple Update Detection Support: N/A 00:23:10.973 Firmware Update Granularity: No Information Provided 00:23:10.973 Per-Namespace SMART Log: No 00:23:10.973 Asymmetric Namespace Access Log Page: Not Supported 00:23:10.973 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:10.973 Command Effects Log Page: Not Supported 00:23:10.973 Get Log Page Extended Data: Supported 00:23:10.973 Telemetry Log Pages: Not Supported 00:23:10.973 Persistent Event Log Pages: Not Supported 00:23:10.973 Supported Log Pages Log Page: May Support 00:23:10.973 Commands Supported & Effects Log Page: Not Supported 00:23:10.973 Feature Identifiers & Effects Log Page:May Support 00:23:10.973 NVMe-MI Commands & Effects Log Page: May Support 00:23:10.973 Data Area 4 for Telemetry Log: Not Supported 00:23:10.973 Error Log Page Entries Supported: 128 00:23:10.973 Keep Alive: Not Supported 00:23:10.973 00:23:10.973 NVM Command Set Attributes 00:23:10.973 ========================== 00:23:10.973 Submission Queue Entry Size 00:23:10.973 Max: 1 00:23:10.973 Min: 1 00:23:10.973 Completion Queue Entry Size 00:23:10.973 Max: 1 00:23:10.973 Min: 1 00:23:10.973 Number of Namespaces: 0 00:23:10.973 Compare Command: Not Supported 00:23:10.973 Write Uncorrectable Command: Not Supported 00:23:10.973 Dataset Management Command: Not Supported 00:23:10.973 Write Zeroes Command: Not Supported 00:23:10.973 Set Features Save Field: Not Supported 00:23:10.973 Reservations: Not Supported 00:23:10.973 Timestamp: Not Supported 00:23:10.973 Copy: Not Supported 00:23:10.973 Volatile Write Cache: Not Present 00:23:10.973 Atomic Write Unit (Normal): 1 00:23:10.973 Atomic Write Unit (PFail): 1 00:23:10.973 Atomic Compare & Write Unit: 1 00:23:10.973 Fused Compare & Write: Supported 00:23:10.973 Scatter-Gather List 00:23:10.973 SGL Command Set: Supported 00:23:10.973 SGL Keyed: Supported 00:23:10.973 SGL Bit Bucket Descriptor: Not Supported 00:23:10.973 SGL Metadata Pointer: Not Supported 00:23:10.973 Oversized SGL: Not Supported 00:23:10.973 SGL Metadata Address: Not Supported 00:23:10.973 SGL Offset: Supported 00:23:10.973 Transport SGL Data Block: Not Supported 00:23:10.973 Replay Protected Memory Block: Not Supported 00:23:10.973 00:23:10.973 Firmware Slot Information 00:23:10.973 ========================= 00:23:10.973 Active slot: 0 00:23:10.973 00:23:10.973 00:23:10.973 Error Log 00:23:10.973 ========= 00:23:10.973 00:23:10.973 Active Namespaces 00:23:10.973 ================= 00:23:10.973 Discovery Log Page 00:23:10.973 ================== 00:23:10.973 Generation Counter: 2 00:23:10.973 Number of Records: 2 00:23:10.973 Record Format: 0 00:23:10.973 00:23:10.973 Discovery Log Entry 0 00:23:10.973 ---------------------- 00:23:10.973 Transport Type: 3 (TCP) 00:23:10.973 Address Family: 1 (IPv4) 00:23:10.973 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:10.973 Entry Flags: 00:23:10.973 Duplicate Returned Information: 1 00:23:10.973 Explicit Persistent Connection Support for Discovery: 1 00:23:10.973 Transport Requirements: 00:23:10.973 Secure Channel: Not Required 00:23:10.973 Port ID: 0 (0x0000) 00:23:10.973 Controller ID: 65535 (0xffff) 00:23:10.973 Admin Max SQ Size: 128 00:23:10.973 Transport Service Identifier: 4420 00:23:10.973 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:10.973 Transport Address: 10.0.0.2 00:23:10.973 Discovery Log Entry 1 00:23:10.973 ---------------------- 00:23:10.973 Transport Type: 3 (TCP) 00:23:10.973 Address Family: 1 (IPv4) 00:23:10.973 Subsystem Type: 2 (NVM Subsystem) 00:23:10.973 Entry Flags: 00:23:10.973 Duplicate Returned Information: 0 00:23:10.973 Explicit Persistent Connection Support for Discovery: 0 00:23:10.973 Transport Requirements: 00:23:10.973 Secure Channel: Not Required 00:23:10.973 Port ID: 0 (0x0000) 00:23:10.973 Controller ID: 65535 (0xffff) 00:23:10.973 Admin Max SQ Size: 128 00:23:10.974 Transport Service Identifier: 4420 00:23:10.974 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:10.974 Transport Address: 10.0.0.2 [2024-11-20 20:24:15.795315] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:10.974 [2024-11-20 20:24:15.795344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.974 [2024-11-20 20:24:15.795356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.974 [2024-11-20 20:24:15.795365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.974 [2024-11-20 20:24:15.795374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.974 [2024-11-20 20:24:15.795403] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795411] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795417] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.795427] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.795453] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.795534] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.795546] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.795552] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795559] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.795570] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795578] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.795594] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.795619] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.795737] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.795749] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.795755] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795761] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.795770] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:10.974 [2024-11-20 20:24:15.795779] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:10.974 [2024-11-20 20:24:15.795794] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795802] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795808] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.795818] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.795838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.795934] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.795949] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.795955] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795961] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.795983] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795993] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.795999] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.796009] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.796029] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.796142] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.796156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.796162] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796169] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.796185] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.796211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.796232] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.796320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.796334] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.796341] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796347] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.796363] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796394] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.796404] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.796424] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.796512] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.796523] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.796530] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796536] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.796551] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796560] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796566] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.796576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.796596] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.796678] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.796690] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.796696] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796702] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.796717] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796730] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796737] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.796747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.796767] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.796855] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.796869] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.796875] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796882] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.796897] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796906] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.796912] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.796922] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.796942] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.797026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.797040] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.797046] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.801076] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.801101] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.801111] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.801132] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x60ce10) 00:23:10.974 [2024-11-20 20:24:15.801143] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.974 [2024-11-20 20:24:15.801165] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x68cf50, cid 3, qid 0 00:23:10.974 [2024-11-20 20:24:15.801265] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.974 [2024-11-20 20:24:15.801280] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.974 [2024-11-20 20:24:15.801286] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.974 [2024-11-20 20:24:15.801293] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x68cf50) on tqpair=0x60ce10 00:23:10.974 [2024-11-20 20:24:15.801307] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:23:10.974 00:23:10.974 20:24:15 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:10.975 [2024-11-20 20:24:15.834597] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.975 [2024-11-20 20:24:15.834639] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3235477 ] 00:23:10.975 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.975 [2024-11-20 20:24:15.865762] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:10.975 [2024-11-20 20:24:15.865818] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:10.975 [2024-11-20 20:24:15.865828] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:10.975 [2024-11-20 20:24:15.865843] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:10.975 [2024-11-20 20:24:15.865854] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:10.975 [2024-11-20 20:24:15.869126] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:10.975 [2024-11-20 20:24:15.869186] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x10fce10 0 00:23:10.975 [2024-11-20 20:24:15.877086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:10.975 [2024-11-20 20:24:15.877104] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:10.975 [2024-11-20 20:24:15.877127] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:10.975 [2024-11-20 20:24:15.877134] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:10.975 [2024-11-20 20:24:15.877173] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.877185] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.877192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.877206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:10.975 [2024-11-20 20:24:15.877232] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.885084] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.885101] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.885108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885115] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.885129] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:10.975 [2024-11-20 20:24:15.885139] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:10.975 [2024-11-20 20:24:15.885148] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:10.975 [2024-11-20 20:24:15.885164] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885173] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885179] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.885190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.885213] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.885353] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.885368] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.885375] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885381] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.885390] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:10.975 [2024-11-20 20:24:15.885403] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:10.975 [2024-11-20 20:24:15.885416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885423] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885429] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.885444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.885467] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.885560] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.885574] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.885581] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885587] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.885597] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:10.975 [2024-11-20 20:24:15.885610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:10.975 [2024-11-20 20:24:15.885622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.885645] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.885666] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.885758] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.885772] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.885779] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885785] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.885794] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:10.975 [2024-11-20 20:24:15.885811] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885819] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885826] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.885836] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.885857] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.885949] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.885963] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.885969] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.885975] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.885984] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:10.975 [2024-11-20 20:24:15.885992] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:10.975 [2024-11-20 20:24:15.886005] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:10.975 [2024-11-20 20:24:15.886114] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:10.975 [2024-11-20 20:24:15.886123] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:10.975 [2024-11-20 20:24:15.886151] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886161] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.886178] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.886200] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.886341] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.886353] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.886359] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886366] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.886375] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:10.975 [2024-11-20 20:24:15.886391] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886399] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886405] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.886415] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.886436] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.975 [2024-11-20 20:24:15.886542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.975 [2024-11-20 20:24:15.886556] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.975 [2024-11-20 20:24:15.886563] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886569] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.975 [2024-11-20 20:24:15.886578] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:10.975 [2024-11-20 20:24:15.886586] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:10.975 [2024-11-20 20:24:15.886599] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:10.975 [2024-11-20 20:24:15.886613] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:10.975 [2024-11-20 20:24:15.886626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.975 [2024-11-20 20:24:15.886640] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.975 [2024-11-20 20:24:15.886651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.975 [2024-11-20 20:24:15.886672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.976 [2024-11-20 20:24:15.886800] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.976 [2024-11-20 20:24:15.886815] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.976 [2024-11-20 20:24:15.886821] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.886827] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=4096, cccid=0 00:23:10.976 [2024-11-20 20:24:15.886835] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117cb30) on tqpair(0x10fce10): expected_datao=0, payload_size=4096 00:23:10.976 [2024-11-20 20:24:15.886871] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.886884] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.886936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.976 [2024-11-20 20:24:15.886948] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.976 [2024-11-20 20:24:15.886954] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.886960] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.976 [2024-11-20 20:24:15.886972] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:10.976 [2024-11-20 20:24:15.886980] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:10.976 [2024-11-20 20:24:15.886987] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:10.976 [2024-11-20 20:24:15.886994] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:10.976 [2024-11-20 20:24:15.887001] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:10.976 [2024-11-20 20:24:15.887009] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887027] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887040] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887047] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887053] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887064] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.976 [2024-11-20 20:24:15.887094] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.976 [2024-11-20 20:24:15.887201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.976 [2024-11-20 20:24:15.887213] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.976 [2024-11-20 20:24:15.887219] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887226] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cb30) on tqpair=0x10fce10 00:23:10.976 [2024-11-20 20:24:15.887237] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887250] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.976 [2024-11-20 20:24:15.887269] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887276] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887282] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887290] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.976 [2024-11-20 20:24:15.887300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887307] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887312] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.976 [2024-11-20 20:24:15.887331] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887337] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887349] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887358] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.976 [2024-11-20 20:24:15.887367] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887385] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887413] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887420] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887436] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.976 [2024-11-20 20:24:15.887459] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cb30, cid 0, qid 0 00:23:10.976 [2024-11-20 20:24:15.887485] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cc90, cid 1, qid 0 00:23:10.976 [2024-11-20 20:24:15.887492] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cdf0, cid 2, qid 0 00:23:10.976 [2024-11-20 20:24:15.887499] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.976 [2024-11-20 20:24:15.887507] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.976 [2024-11-20 20:24:15.887658] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.976 [2024-11-20 20:24:15.887670] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.976 [2024-11-20 20:24:15.887677] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887683] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.976 [2024-11-20 20:24:15.887692] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:10.976 [2024-11-20 20:24:15.887700] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887730] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.887742] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887749] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887755] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.887765] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.976 [2024-11-20 20:24:15.887800] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.976 [2024-11-20 20:24:15.887970] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.976 [2024-11-20 20:24:15.887985] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.976 [2024-11-20 20:24:15.887992] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.887998] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.976 [2024-11-20 20:24:15.888065] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.888094] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.888114] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888122] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.888138] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.976 [2024-11-20 20:24:15.888174] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.976 [2024-11-20 20:24:15.888352] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.976 [2024-11-20 20:24:15.888365] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.976 [2024-11-20 20:24:15.888371] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888377] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=4096, cccid=4 00:23:10.976 [2024-11-20 20:24:15.888385] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d0b0) on tqpair(0x10fce10): expected_datao=0, payload_size=4096 00:23:10.976 [2024-11-20 20:24:15.888401] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888410] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888434] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.976 [2024-11-20 20:24:15.888445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.976 [2024-11-20 20:24:15.888451] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.976 [2024-11-20 20:24:15.888483] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:10.976 [2024-11-20 20:24:15.888503] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.888521] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:10.976 [2024-11-20 20:24:15.888535] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888542] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.976 [2024-11-20 20:24:15.888548] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.976 [2024-11-20 20:24:15.888559] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.976 [2024-11-20 20:24:15.888580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.976 [2024-11-20 20:24:15.888691] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.976 [2024-11-20 20:24:15.888703] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.977 [2024-11-20 20:24:15.888709] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.888715] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=4096, cccid=4 00:23:10.977 [2024-11-20 20:24:15.888723] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d0b0) on tqpair(0x10fce10): expected_datao=0, payload_size=4096 00:23:10.977 [2024-11-20 20:24:15.888739] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.888748] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.888769] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.888779] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.888785] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.888791] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.888822] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.888841] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.888855] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.888862] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.888868] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.888878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.977 [2024-11-20 20:24:15.888900] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.977 [2024-11-20 20:24:15.889010] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.977 [2024-11-20 20:24:15.889022] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.977 [2024-11-20 20:24:15.889029] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.889035] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=4096, cccid=4 00:23:10.977 [2024-11-20 20:24:15.889042] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d0b0) on tqpair(0x10fce10): expected_datao=0, payload_size=4096 00:23:10.977 [2024-11-20 20:24:15.889053] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.889060] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893079] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.893095] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.893102] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893108] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.893124] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.893139] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.893156] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.893167] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.893175] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.893184] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:10.977 [2024-11-20 20:24:15.893191] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:10.977 [2024-11-20 20:24:15.893199] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:10.977 [2024-11-20 20:24:15.893219] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893226] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893232] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.893242] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.977 [2024-11-20 20:24:15.893253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893263] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893270] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.893279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.977 [2024-11-20 20:24:15.893304] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.977 [2024-11-20 20:24:15.893331] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d210, cid 5, qid 0 00:23:10.977 [2024-11-20 20:24:15.893462] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.893474] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.893481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893487] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.893498] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.893507] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.893513] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893519] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d210) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.893535] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893543] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893549] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.893559] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.977 [2024-11-20 20:24:15.893580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d210, cid 5, qid 0 00:23:10.977 [2024-11-20 20:24:15.893691] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.893705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.893712] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893718] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d210) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.893735] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893743] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893749] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.893759] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.977 [2024-11-20 20:24:15.893779] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d210, cid 5, qid 0 00:23:10.977 [2024-11-20 20:24:15.893865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.893879] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.893886] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d210) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.893909] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893917] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.893923] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.893934] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.977 [2024-11-20 20:24:15.893954] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d210, cid 5, qid 0 00:23:10.977 [2024-11-20 20:24:15.894047] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.977 [2024-11-20 20:24:15.894061] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.977 [2024-11-20 20:24:15.894074] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.894082] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d210) on tqpair=0x10fce10 00:23:10.977 [2024-11-20 20:24:15.894103] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.894113] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.977 [2024-11-20 20:24:15.894119] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10fce10) 00:23:10.977 [2024-11-20 20:24:15.894129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.978 [2024-11-20 20:24:15.894142] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894154] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894160] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10fce10) 00:23:10.978 [2024-11-20 20:24:15.894169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.978 [2024-11-20 20:24:15.894181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894188] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894194] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x10fce10) 00:23:10.978 [2024-11-20 20:24:15.894203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.978 [2024-11-20 20:24:15.894222] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894229] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894250] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x10fce10) 00:23:10.978 [2024-11-20 20:24:15.894260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.978 [2024-11-20 20:24:15.894282] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d210, cid 5, qid 0 00:23:10.978 [2024-11-20 20:24:15.894292] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d0b0, cid 4, qid 0 00:23:10.978 [2024-11-20 20:24:15.894314] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d370, cid 6, qid 0 00:23:10.978 [2024-11-20 20:24:15.894322] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d4d0, cid 7, qid 0 00:23:10.978 [2024-11-20 20:24:15.894560] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.978 [2024-11-20 20:24:15.894575] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.978 [2024-11-20 20:24:15.894582] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894588] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=8192, cccid=5 00:23:10.978 [2024-11-20 20:24:15.894595] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d210) on tqpair(0x10fce10): expected_datao=0, payload_size=8192 00:23:10.978 [2024-11-20 20:24:15.894606] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894614] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.978 [2024-11-20 20:24:15.894631] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.978 [2024-11-20 20:24:15.894637] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894643] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=512, cccid=4 00:23:10.978 [2024-11-20 20:24:15.894654] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d0b0) on tqpair(0x10fce10): expected_datao=0, payload_size=512 00:23:10.978 [2024-11-20 20:24:15.894665] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894672] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894680] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.978 [2024-11-20 20:24:15.894688] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.978 [2024-11-20 20:24:15.894694] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894700] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=512, cccid=6 00:23:10.978 [2024-11-20 20:24:15.894707] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d370) on tqpair(0x10fce10): expected_datao=0, payload_size=512 00:23:10.978 [2024-11-20 20:24:15.894717] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894724] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.978 [2024-11-20 20:24:15.894740] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.978 [2024-11-20 20:24:15.894746] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894752] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10fce10): datao=0, datal=4096, cccid=7 00:23:10.978 [2024-11-20 20:24:15.894760] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x117d4d0) on tqpair(0x10fce10): expected_datao=0, payload_size=4096 00:23:10.978 [2024-11-20 20:24:15.894770] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894777] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894788] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.978 [2024-11-20 20:24:15.894798] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.978 [2024-11-20 20:24:15.894804] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894810] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d210) on tqpair=0x10fce10 00:23:10.978 [2024-11-20 20:24:15.894831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.978 [2024-11-20 20:24:15.894842] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.978 [2024-11-20 20:24:15.894848] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894854] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d0b0) on tqpair=0x10fce10 00:23:10.978 [2024-11-20 20:24:15.894869] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.978 [2024-11-20 20:24:15.894879] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.978 [2024-11-20 20:24:15.894885] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894891] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d370) on tqpair=0x10fce10 00:23:10.978 [2024-11-20 20:24:15.894902] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.978 [2024-11-20 20:24:15.894911] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.978 [2024-11-20 20:24:15.894917] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.978 [2024-11-20 20:24:15.894923] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d4d0) on tqpair=0x10fce10 00:23:10.978 ===================================================== 00:23:10.978 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.978 ===================================================== 00:23:10.978 Controller Capabilities/Features 00:23:10.978 ================================ 00:23:10.978 Vendor ID: 8086 00:23:10.978 Subsystem Vendor ID: 8086 00:23:10.978 Serial Number: SPDK00000000000001 00:23:10.978 Model Number: SPDK bdev Controller 00:23:10.978 Firmware Version: 24.01.1 00:23:10.978 Recommended Arb Burst: 6 00:23:10.978 IEEE OUI Identifier: e4 d2 5c 00:23:10.978 Multi-path I/O 00:23:10.978 May have multiple subsystem ports: Yes 00:23:10.978 May have multiple controllers: Yes 00:23:10.978 Associated with SR-IOV VF: No 00:23:10.978 Max Data Transfer Size: 131072 00:23:10.978 Max Number of Namespaces: 32 00:23:10.978 Max Number of I/O Queues: 127 00:23:10.978 NVMe Specification Version (VS): 1.3 00:23:10.978 NVMe Specification Version (Identify): 1.3 00:23:10.978 Maximum Queue Entries: 128 00:23:10.978 Contiguous Queues Required: Yes 00:23:10.978 Arbitration Mechanisms Supported 00:23:10.978 Weighted Round Robin: Not Supported 00:23:10.978 Vendor Specific: Not Supported 00:23:10.978 Reset Timeout: 15000 ms 00:23:10.978 Doorbell Stride: 4 bytes 00:23:10.978 NVM Subsystem Reset: Not Supported 00:23:10.978 Command Sets Supported 00:23:10.978 NVM Command Set: Supported 00:23:10.978 Boot Partition: Not Supported 00:23:10.978 Memory Page Size Minimum: 4096 bytes 00:23:10.978 Memory Page Size Maximum: 4096 bytes 00:23:10.978 Persistent Memory Region: Not Supported 00:23:10.978 Optional Asynchronous Events Supported 00:23:10.978 Namespace Attribute Notices: Supported 00:23:10.978 Firmware Activation Notices: Not Supported 00:23:10.978 ANA Change Notices: Not Supported 00:23:10.978 PLE Aggregate Log Change Notices: Not Supported 00:23:10.978 LBA Status Info Alert Notices: Not Supported 00:23:10.978 EGE Aggregate Log Change Notices: Not Supported 00:23:10.978 Normal NVM Subsystem Shutdown event: Not Supported 00:23:10.978 Zone Descriptor Change Notices: Not Supported 00:23:10.978 Discovery Log Change Notices: Not Supported 00:23:10.978 Controller Attributes 00:23:10.978 128-bit Host Identifier: Supported 00:23:10.978 Non-Operational Permissive Mode: Not Supported 00:23:10.978 NVM Sets: Not Supported 00:23:10.978 Read Recovery Levels: Not Supported 00:23:10.978 Endurance Groups: Not Supported 00:23:10.978 Predictable Latency Mode: Not Supported 00:23:10.978 Traffic Based Keep ALive: Not Supported 00:23:10.978 Namespace Granularity: Not Supported 00:23:10.978 SQ Associations: Not Supported 00:23:10.978 UUID List: Not Supported 00:23:10.978 Multi-Domain Subsystem: Not Supported 00:23:10.978 Fixed Capacity Management: Not Supported 00:23:10.978 Variable Capacity Management: Not Supported 00:23:10.978 Delete Endurance Group: Not Supported 00:23:10.978 Delete NVM Set: Not Supported 00:23:10.978 Extended LBA Formats Supported: Not Supported 00:23:10.978 Flexible Data Placement Supported: Not Supported 00:23:10.978 00:23:10.978 Controller Memory Buffer Support 00:23:10.978 ================================ 00:23:10.978 Supported: No 00:23:10.978 00:23:10.978 Persistent Memory Region Support 00:23:10.978 ================================ 00:23:10.978 Supported: No 00:23:10.978 00:23:10.978 Admin Command Set Attributes 00:23:10.978 ============================ 00:23:10.978 Security Send/Receive: Not Supported 00:23:10.978 Format NVM: Not Supported 00:23:10.978 Firmware Activate/Download: Not Supported 00:23:10.978 Namespace Management: Not Supported 00:23:10.978 Device Self-Test: Not Supported 00:23:10.978 Directives: Not Supported 00:23:10.978 NVMe-MI: Not Supported 00:23:10.978 Virtualization Management: Not Supported 00:23:10.978 Doorbell Buffer Config: Not Supported 00:23:10.979 Get LBA Status Capability: Not Supported 00:23:10.979 Command & Feature Lockdown Capability: Not Supported 00:23:10.979 Abort Command Limit: 4 00:23:10.979 Async Event Request Limit: 4 00:23:10.979 Number of Firmware Slots: N/A 00:23:10.979 Firmware Slot 1 Read-Only: N/A 00:23:10.979 Firmware Activation Without Reset: N/A 00:23:10.979 Multiple Update Detection Support: N/A 00:23:10.979 Firmware Update Granularity: No Information Provided 00:23:10.979 Per-Namespace SMART Log: No 00:23:10.979 Asymmetric Namespace Access Log Page: Not Supported 00:23:10.979 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:10.979 Command Effects Log Page: Supported 00:23:10.979 Get Log Page Extended Data: Supported 00:23:10.979 Telemetry Log Pages: Not Supported 00:23:10.979 Persistent Event Log Pages: Not Supported 00:23:10.979 Supported Log Pages Log Page: May Support 00:23:10.979 Commands Supported & Effects Log Page: Not Supported 00:23:10.979 Feature Identifiers & Effects Log Page:May Support 00:23:10.979 NVMe-MI Commands & Effects Log Page: May Support 00:23:10.979 Data Area 4 for Telemetry Log: Not Supported 00:23:10.979 Error Log Page Entries Supported: 128 00:23:10.979 Keep Alive: Supported 00:23:10.979 Keep Alive Granularity: 10000 ms 00:23:10.979 00:23:10.979 NVM Command Set Attributes 00:23:10.979 ========================== 00:23:10.979 Submission Queue Entry Size 00:23:10.979 Max: 64 00:23:10.979 Min: 64 00:23:10.979 Completion Queue Entry Size 00:23:10.979 Max: 16 00:23:10.979 Min: 16 00:23:10.979 Number of Namespaces: 32 00:23:10.979 Compare Command: Supported 00:23:10.979 Write Uncorrectable Command: Not Supported 00:23:10.979 Dataset Management Command: Supported 00:23:10.979 Write Zeroes Command: Supported 00:23:10.979 Set Features Save Field: Not Supported 00:23:10.979 Reservations: Supported 00:23:10.979 Timestamp: Not Supported 00:23:10.979 Copy: Supported 00:23:10.979 Volatile Write Cache: Present 00:23:10.979 Atomic Write Unit (Normal): 1 00:23:10.979 Atomic Write Unit (PFail): 1 00:23:10.979 Atomic Compare & Write Unit: 1 00:23:10.979 Fused Compare & Write: Supported 00:23:10.979 Scatter-Gather List 00:23:10.979 SGL Command Set: Supported 00:23:10.979 SGL Keyed: Supported 00:23:10.979 SGL Bit Bucket Descriptor: Not Supported 00:23:10.979 SGL Metadata Pointer: Not Supported 00:23:10.979 Oversized SGL: Not Supported 00:23:10.979 SGL Metadata Address: Not Supported 00:23:10.979 SGL Offset: Supported 00:23:10.979 Transport SGL Data Block: Not Supported 00:23:10.979 Replay Protected Memory Block: Not Supported 00:23:10.979 00:23:10.979 Firmware Slot Information 00:23:10.979 ========================= 00:23:10.979 Active slot: 1 00:23:10.979 Slot 1 Firmware Revision: 24.01.1 00:23:10.979 00:23:10.979 00:23:10.979 Commands Supported and Effects 00:23:10.979 ============================== 00:23:10.979 Admin Commands 00:23:10.979 -------------- 00:23:10.979 Get Log Page (02h): Supported 00:23:10.979 Identify (06h): Supported 00:23:10.979 Abort (08h): Supported 00:23:10.979 Set Features (09h): Supported 00:23:10.979 Get Features (0Ah): Supported 00:23:10.979 Asynchronous Event Request (0Ch): Supported 00:23:10.979 Keep Alive (18h): Supported 00:23:10.979 I/O Commands 00:23:10.979 ------------ 00:23:10.979 Flush (00h): Supported LBA-Change 00:23:10.979 Write (01h): Supported LBA-Change 00:23:10.979 Read (02h): Supported 00:23:10.979 Compare (05h): Supported 00:23:10.979 Write Zeroes (08h): Supported LBA-Change 00:23:10.979 Dataset Management (09h): Supported LBA-Change 00:23:10.979 Copy (19h): Supported LBA-Change 00:23:10.979 Unknown (79h): Supported LBA-Change 00:23:10.979 Unknown (7Ah): Supported 00:23:10.979 00:23:10.979 Error Log 00:23:10.979 ========= 00:23:10.979 00:23:10.979 Arbitration 00:23:10.979 =========== 00:23:10.979 Arbitration Burst: 1 00:23:10.979 00:23:10.979 Power Management 00:23:10.979 ================ 00:23:10.979 Number of Power States: 1 00:23:10.979 Current Power State: Power State #0 00:23:10.979 Power State #0: 00:23:10.979 Max Power: 0.00 W 00:23:10.979 Non-Operational State: Operational 00:23:10.979 Entry Latency: Not Reported 00:23:10.979 Exit Latency: Not Reported 00:23:10.979 Relative Read Throughput: 0 00:23:10.979 Relative Read Latency: 0 00:23:10.979 Relative Write Throughput: 0 00:23:10.979 Relative Write Latency: 0 00:23:10.979 Idle Power: Not Reported 00:23:10.979 Active Power: Not Reported 00:23:10.979 Non-Operational Permissive Mode: Not Supported 00:23:10.979 00:23:10.979 Health Information 00:23:10.979 ================== 00:23:10.979 Critical Warnings: 00:23:10.979 Available Spare Space: OK 00:23:10.979 Temperature: OK 00:23:10.979 Device Reliability: OK 00:23:10.979 Read Only: No 00:23:10.979 Volatile Memory Backup: OK 00:23:10.979 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:10.979 Temperature Threshold: [2024-11-20 20:24:15.895060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895081] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895088] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x10fce10) 00:23:10.979 [2024-11-20 20:24:15.895099] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.979 [2024-11-20 20:24:15.895124] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117d4d0, cid 7, qid 0 00:23:10.979 [2024-11-20 20:24:15.895266] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.979 [2024-11-20 20:24:15.895278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.979 [2024-11-20 20:24:15.895285] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895291] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117d4d0) on tqpair=0x10fce10 00:23:10.979 [2024-11-20 20:24:15.895335] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:10.979 [2024-11-20 20:24:15.895355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.979 [2024-11-20 20:24:15.895367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.979 [2024-11-20 20:24:15.895376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.979 [2024-11-20 20:24:15.895385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.979 [2024-11-20 20:24:15.895397] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895404] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895410] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.979 [2024-11-20 20:24:15.895421] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.979 [2024-11-20 20:24:15.895457] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.979 [2024-11-20 20:24:15.895622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.979 [2024-11-20 20:24:15.895634] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.979 [2024-11-20 20:24:15.895641] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895647] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.979 [2024-11-20 20:24:15.895659] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895666] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895672] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.979 [2024-11-20 20:24:15.895682] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.979 [2024-11-20 20:24:15.895708] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.979 [2024-11-20 20:24:15.895815] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.979 [2024-11-20 20:24:15.895829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.979 [2024-11-20 20:24:15.895836] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.979 [2024-11-20 20:24:15.895851] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:10.979 [2024-11-20 20:24:15.895858] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:10.979 [2024-11-20 20:24:15.895874] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895883] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.895889] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.979 [2024-11-20 20:24:15.895899] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.979 [2024-11-20 20:24:15.895923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.979 [2024-11-20 20:24:15.896034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.979 [2024-11-20 20:24:15.896048] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.979 [2024-11-20 20:24:15.896054] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.979 [2024-11-20 20:24:15.896061] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.896086] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896096] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896103] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.896114] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.896135] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.896227] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.896242] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.896248] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896254] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.896272] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896280] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896286] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.896297] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.896317] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.896404] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.896416] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.896422] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896428] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.896445] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896453] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896459] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.896470] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.896489] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.896578] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.896592] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.896599] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896605] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.896622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896631] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.896647] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.896668] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.896752] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.896764] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.896771] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896777] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.896794] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896802] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896808] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.896819] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.896838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.896930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.896944] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.896951] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896957] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.896974] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896983] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.896989] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.896999] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.897019] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.901083] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.901100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.901107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.901113] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.901132] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.901141] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.901147] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10fce10) 00:23:10.980 [2024-11-20 20:24:15.901158] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.980 [2024-11-20 20:24:15.901179] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x117cf50, cid 3, qid 0 00:23:10.980 [2024-11-20 20:24:15.901311] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.980 [2024-11-20 20:24:15.901323] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.980 [2024-11-20 20:24:15.901329] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.980 [2024-11-20 20:24:15.901335] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x117cf50) on tqpair=0x10fce10 00:23:10.980 [2024-11-20 20:24:15.901349] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:10.980 0 Kelvin (-273 Celsius) 00:23:10.980 Available Spare: 0% 00:23:10.980 Available Spare Threshold: 0% 00:23:10.980 Life Percentage Used: 0% 00:23:10.980 Data Units Read: 0 00:23:10.980 Data Units Written: 0 00:23:10.980 Host Read Commands: 0 00:23:10.980 Host Write Commands: 0 00:23:10.980 Controller Busy Time: 0 minutes 00:23:10.980 Power Cycles: 0 00:23:10.980 Power On Hours: 0 hours 00:23:10.980 Unsafe Shutdowns: 0 00:23:10.980 Unrecoverable Media Errors: 0 00:23:10.980 Lifetime Error Log Entries: 0 00:23:10.980 Warning Temperature Time: 0 minutes 00:23:10.980 Critical Temperature Time: 0 minutes 00:23:10.980 00:23:10.980 Number of Queues 00:23:10.980 ================ 00:23:10.980 Number of I/O Submission Queues: 127 00:23:10.980 Number of I/O Completion Queues: 127 00:23:10.980 00:23:10.980 Active Namespaces 00:23:10.980 ================= 00:23:10.980 Namespace ID:1 00:23:10.980 Error Recovery Timeout: Unlimited 00:23:10.980 Command Set Identifier: NVM (00h) 00:23:10.980 Deallocate: Supported 00:23:10.980 Deallocated/Unwritten Error: Not Supported 00:23:10.980 Deallocated Read Value: Unknown 00:23:10.980 Deallocate in Write Zeroes: Not Supported 00:23:10.980 Deallocated Guard Field: 0xFFFF 00:23:10.980 Flush: Supported 00:23:10.980 Reservation: Supported 00:23:10.980 Namespace Sharing Capabilities: Multiple Controllers 00:23:10.980 Size (in LBAs): 131072 (0GiB) 00:23:10.980 Capacity (in LBAs): 131072 (0GiB) 00:23:10.980 Utilization (in LBAs): 131072 (0GiB) 00:23:10.980 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:10.980 EUI64: ABCDEF0123456789 00:23:10.980 UUID: a575b24a-2ec3-4393-b9d9-9aa3dbcaea4b 00:23:10.980 Thin Provisioning: Not Supported 00:23:10.980 Per-NS Atomic Units: Yes 00:23:10.980 Atomic Boundary Size (Normal): 0 00:23:10.980 Atomic Boundary Size (PFail): 0 00:23:10.980 Atomic Boundary Offset: 0 00:23:10.980 Maximum Single Source Range Length: 65535 00:23:10.980 Maximum Copy Length: 65535 00:23:10.980 Maximum Source Range Count: 1 00:23:10.980 NGUID/EUI64 Never Reused: No 00:23:10.980 Namespace Write Protected: No 00:23:10.980 Number of LBA Formats: 1 00:23:10.980 Current LBA Format: LBA Format #00 00:23:10.980 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:10.980 00:23:10.980 20:24:15 -- host/identify.sh@51 -- # sync 00:23:10.980 20:24:15 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:10.980 20:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.980 20:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:10.980 20:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.980 20:24:15 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:10.980 20:24:15 -- host/identify.sh@56 -- # nvmftestfini 00:23:10.980 20:24:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:10.980 20:24:15 -- nvmf/common.sh@116 -- # sync 00:23:10.980 20:24:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:10.980 20:24:15 -- nvmf/common.sh@119 -- # set +e 00:23:10.980 20:24:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:10.980 20:24:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:10.980 rmmod nvme_tcp 00:23:10.980 rmmod nvme_fabrics 00:23:10.980 rmmod nvme_keyring 00:23:10.980 20:24:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:10.980 20:24:15 -- nvmf/common.sh@123 -- # set -e 00:23:10.980 20:24:15 -- nvmf/common.sh@124 -- # return 0 00:23:10.980 20:24:15 -- nvmf/common.sh@477 -- # '[' -n 3235308 ']' 00:23:10.980 20:24:15 -- nvmf/common.sh@478 -- # killprocess 3235308 00:23:10.980 20:24:15 -- common/autotest_common.sh@936 -- # '[' -z 3235308 ']' 00:23:10.980 20:24:15 -- common/autotest_common.sh@940 -- # kill -0 3235308 00:23:10.981 20:24:15 -- common/autotest_common.sh@941 -- # uname 00:23:10.981 20:24:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:10.981 20:24:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3235308 00:23:11.239 20:24:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:11.239 20:24:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:11.239 20:24:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3235308' 00:23:11.239 killing process with pid 3235308 00:23:11.239 20:24:16 -- common/autotest_common.sh@955 -- # kill 3235308 00:23:11.239 [2024-11-20 20:24:16.026224] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:11.239 20:24:16 -- common/autotest_common.sh@960 -- # wait 3235308 00:23:11.497 20:24:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:11.497 20:24:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:11.497 20:24:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:11.497 20:24:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:11.497 20:24:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:11.497 20:24:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.497 20:24:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.497 20:24:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.406 20:24:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:13.406 00:23:13.406 real 0m6.069s 00:23:13.406 user 0m7.340s 00:23:13.406 sys 0m1.818s 00:23:13.406 20:24:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:13.406 20:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:13.406 ************************************ 00:23:13.406 END TEST nvmf_identify 00:23:13.406 ************************************ 00:23:13.406 20:24:18 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:13.406 20:24:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:13.406 20:24:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:13.406 20:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:13.406 ************************************ 00:23:13.406 START TEST nvmf_perf 00:23:13.406 ************************************ 00:23:13.406 20:24:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:13.406 * Looking for test storage... 00:23:13.406 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:13.406 20:24:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:13.406 20:24:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:13.406 20:24:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:13.666 20:24:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:13.666 20:24:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:13.666 20:24:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:13.666 20:24:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:13.666 20:24:18 -- scripts/common.sh@335 -- # IFS=.-: 00:23:13.666 20:24:18 -- scripts/common.sh@335 -- # read -ra ver1 00:23:13.666 20:24:18 -- scripts/common.sh@336 -- # IFS=.-: 00:23:13.666 20:24:18 -- scripts/common.sh@336 -- # read -ra ver2 00:23:13.666 20:24:18 -- scripts/common.sh@337 -- # local 'op=<' 00:23:13.666 20:24:18 -- scripts/common.sh@339 -- # ver1_l=2 00:23:13.666 20:24:18 -- scripts/common.sh@340 -- # ver2_l=1 00:23:13.666 20:24:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:13.666 20:24:18 -- scripts/common.sh@343 -- # case "$op" in 00:23:13.666 20:24:18 -- scripts/common.sh@344 -- # : 1 00:23:13.666 20:24:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:13.666 20:24:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:13.666 20:24:18 -- scripts/common.sh@364 -- # decimal 1 00:23:13.666 20:24:18 -- scripts/common.sh@352 -- # local d=1 00:23:13.666 20:24:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:13.666 20:24:18 -- scripts/common.sh@354 -- # echo 1 00:23:13.666 20:24:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:13.666 20:24:18 -- scripts/common.sh@365 -- # decimal 2 00:23:13.666 20:24:18 -- scripts/common.sh@352 -- # local d=2 00:23:13.666 20:24:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:13.666 20:24:18 -- scripts/common.sh@354 -- # echo 2 00:23:13.666 20:24:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:13.666 20:24:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:13.666 20:24:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:13.666 20:24:18 -- scripts/common.sh@367 -- # return 0 00:23:13.666 20:24:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:13.666 20:24:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:13.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.666 --rc genhtml_branch_coverage=1 00:23:13.666 --rc genhtml_function_coverage=1 00:23:13.666 --rc genhtml_legend=1 00:23:13.666 --rc geninfo_all_blocks=1 00:23:13.666 --rc geninfo_unexecuted_blocks=1 00:23:13.666 00:23:13.666 ' 00:23:13.666 20:24:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:13.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.666 --rc genhtml_branch_coverage=1 00:23:13.666 --rc genhtml_function_coverage=1 00:23:13.666 --rc genhtml_legend=1 00:23:13.666 --rc geninfo_all_blocks=1 00:23:13.666 --rc geninfo_unexecuted_blocks=1 00:23:13.666 00:23:13.666 ' 00:23:13.666 20:24:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:13.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.666 --rc genhtml_branch_coverage=1 00:23:13.666 --rc genhtml_function_coverage=1 00:23:13.666 --rc genhtml_legend=1 00:23:13.666 --rc geninfo_all_blocks=1 00:23:13.666 --rc geninfo_unexecuted_blocks=1 00:23:13.666 00:23:13.666 ' 00:23:13.666 20:24:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:13.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.666 --rc genhtml_branch_coverage=1 00:23:13.666 --rc genhtml_function_coverage=1 00:23:13.666 --rc genhtml_legend=1 00:23:13.666 --rc geninfo_all_blocks=1 00:23:13.666 --rc geninfo_unexecuted_blocks=1 00:23:13.666 00:23:13.666 ' 00:23:13.666 20:24:18 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:13.666 20:24:18 -- nvmf/common.sh@7 -- # uname -s 00:23:13.666 20:24:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:13.666 20:24:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:13.666 20:24:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:13.666 20:24:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:13.666 20:24:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:13.666 20:24:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:13.666 20:24:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:13.666 20:24:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:13.666 20:24:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:13.666 20:24:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:13.666 20:24:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.666 20:24:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.666 20:24:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:13.666 20:24:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:13.666 20:24:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:13.666 20:24:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:13.666 20:24:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:13.666 20:24:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:13.666 20:24:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:13.666 20:24:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.666 20:24:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.666 20:24:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.666 20:24:18 -- paths/export.sh@5 -- # export PATH 00:23:13.666 20:24:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.666 20:24:18 -- nvmf/common.sh@46 -- # : 0 00:23:13.666 20:24:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:13.666 20:24:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:13.666 20:24:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:13.666 20:24:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:13.666 20:24:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:13.666 20:24:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:13.666 20:24:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:13.666 20:24:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:13.666 20:24:18 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:13.666 20:24:18 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:13.666 20:24:18 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:13.666 20:24:18 -- host/perf.sh@17 -- # nvmftestinit 00:23:13.666 20:24:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:13.666 20:24:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:13.666 20:24:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:13.666 20:24:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:13.666 20:24:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:13.666 20:24:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.666 20:24:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.666 20:24:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.666 20:24:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:13.666 20:24:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:13.666 20:24:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:13.666 20:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:15.572 20:24:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:15.572 20:24:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:15.572 20:24:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:15.572 20:24:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:15.572 20:24:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:15.572 20:24:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:15.572 20:24:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:15.572 20:24:20 -- nvmf/common.sh@294 -- # net_devs=() 00:23:15.572 20:24:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:15.572 20:24:20 -- nvmf/common.sh@295 -- # e810=() 00:23:15.572 20:24:20 -- nvmf/common.sh@295 -- # local -ga e810 00:23:15.572 20:24:20 -- nvmf/common.sh@296 -- # x722=() 00:23:15.572 20:24:20 -- nvmf/common.sh@296 -- # local -ga x722 00:23:15.572 20:24:20 -- nvmf/common.sh@297 -- # mlx=() 00:23:15.572 20:24:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:15.572 20:24:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:15.572 20:24:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:15.572 20:24:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:15.572 20:24:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:15.572 20:24:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.572 20:24:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:15.572 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:15.572 20:24:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.572 20:24:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:15.572 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:15.572 20:24:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:15.572 20:24:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.572 20:24:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.572 20:24:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.572 20:24:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.572 20:24:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:15.572 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:15.572 20:24:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.572 20:24:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.572 20:24:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.572 20:24:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.572 20:24:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.572 20:24:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:15.572 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:15.572 20:24:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.572 20:24:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:15.572 20:24:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:15.572 20:24:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:15.572 20:24:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:15.572 20:24:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:15.572 20:24:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:15.572 20:24:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:15.572 20:24:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:15.572 20:24:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:15.572 20:24:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:15.572 20:24:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:15.572 20:24:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:15.572 20:24:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:15.572 20:24:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:15.572 20:24:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:15.572 20:24:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:15.572 20:24:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:15.572 20:24:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:15.572 20:24:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:15.572 20:24:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:15.572 20:24:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:15.572 20:24:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:15.572 20:24:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:15.572 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:15.572 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:23:15.572 00:23:15.572 --- 10.0.0.2 ping statistics --- 00:23:15.572 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.572 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:23:15.572 20:24:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:15.572 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:15.572 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:23:15.572 00:23:15.572 --- 10.0.0.1 ping statistics --- 00:23:15.572 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.572 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:23:15.572 20:24:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:15.572 20:24:20 -- nvmf/common.sh@410 -- # return 0 00:23:15.572 20:24:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:15.572 20:24:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:15.572 20:24:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:15.572 20:24:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:15.572 20:24:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:15.572 20:24:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:15.572 20:24:20 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:15.572 20:24:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:15.572 20:24:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:15.572 20:24:20 -- common/autotest_common.sh@10 -- # set +x 00:23:15.572 20:24:20 -- nvmf/common.sh@469 -- # nvmfpid=3237421 00:23:15.572 20:24:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:15.572 20:24:20 -- nvmf/common.sh@470 -- # waitforlisten 3237421 00:23:15.572 20:24:20 -- common/autotest_common.sh@829 -- # '[' -z 3237421 ']' 00:23:15.572 20:24:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:15.572 20:24:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:15.572 20:24:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:15.572 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:15.572 20:24:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:15.572 20:24:20 -- common/autotest_common.sh@10 -- # set +x 00:23:15.832 [2024-11-20 20:24:20.648526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:15.833 [2024-11-20 20:24:20.648602] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:15.833 EAL: No free 2048 kB hugepages reported on node 1 00:23:15.833 [2024-11-20 20:24:20.717404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:15.833 [2024-11-20 20:24:20.832393] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:15.833 [2024-11-20 20:24:20.832555] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:15.833 [2024-11-20 20:24:20.832583] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:15.833 [2024-11-20 20:24:20.832597] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:15.833 [2024-11-20 20:24:20.832684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:15.833 [2024-11-20 20:24:20.832753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:15.833 [2024-11-20 20:24:20.832938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:15.833 [2024-11-20 20:24:20.832943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:16.767 20:24:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:16.767 20:24:21 -- common/autotest_common.sh@862 -- # return 0 00:23:16.767 20:24:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:16.767 20:24:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:16.767 20:24:21 -- common/autotest_common.sh@10 -- # set +x 00:23:16.767 20:24:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:16.767 20:24:21 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:16.767 20:24:21 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:20.058 20:24:24 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:20.058 20:24:24 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:20.058 20:24:24 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:20.058 20:24:24 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:20.315 20:24:25 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:20.315 20:24:25 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:20.315 20:24:25 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:20.315 20:24:25 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:20.315 20:24:25 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:20.573 [2024-11-20 20:24:25.451903] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.573 20:24:25 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:20.831 20:24:25 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:20.831 20:24:25 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:21.089 20:24:25 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:21.089 20:24:25 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:21.347 20:24:26 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:21.606 [2024-11-20 20:24:26.475765] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:21.606 20:24:26 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:21.864 20:24:26 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:21.864 20:24:26 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:21.864 20:24:26 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:21.864 20:24:26 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:23.242 Initializing NVMe Controllers 00:23:23.242 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:23.242 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:23.242 Initialization complete. Launching workers. 00:23:23.242 ======================================================== 00:23:23.242 Latency(us) 00:23:23.242 Device Information : IOPS MiB/s Average min max 00:23:23.243 PCIE (0000:88:00.0) NSID 1 from core 0: 86354.58 337.32 369.91 10.58 5291.46 00:23:23.243 ======================================================== 00:23:23.243 Total : 86354.58 337.32 369.91 10.58 5291.46 00:23:23.243 00:23:23.243 20:24:27 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:23.243 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.620 Initializing NVMe Controllers 00:23:24.620 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:24.620 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:24.620 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:24.620 Initialization complete. Launching workers. 00:23:24.620 ======================================================== 00:23:24.620 Latency(us) 00:23:24.620 Device Information : IOPS MiB/s Average min max 00:23:24.620 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 89.00 0.35 11578.89 150.63 46052.96 00:23:24.620 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 51.00 0.20 19695.91 7959.52 49889.62 00:23:24.620 ======================================================== 00:23:24.620 Total : 140.00 0.55 14535.81 150.63 49889.62 00:23:24.620 00:23:24.620 20:24:29 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:24.620 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.554 Initializing NVMe Controllers 00:23:25.554 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:25.554 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:25.554 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:25.554 Initialization complete. Launching workers. 00:23:25.554 ======================================================== 00:23:25.554 Latency(us) 00:23:25.554 Device Information : IOPS MiB/s Average min max 00:23:25.554 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8604.36 33.61 3735.61 584.28 7843.62 00:23:25.554 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3864.71 15.10 8316.97 5107.71 15913.76 00:23:25.554 ======================================================== 00:23:25.554 Total : 12469.08 48.71 5155.58 584.28 15913.76 00:23:25.554 00:23:25.554 20:24:30 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:25.554 20:24:30 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:25.554 20:24:30 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:25.554 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.085 Initializing NVMe Controllers 00:23:28.085 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.085 Controller IO queue size 128, less than required. 00:23:28.085 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.085 Controller IO queue size 128, less than required. 00:23:28.085 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.085 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:28.085 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:28.085 Initialization complete. Launching workers. 00:23:28.085 ======================================================== 00:23:28.085 Latency(us) 00:23:28.085 Device Information : IOPS MiB/s Average min max 00:23:28.085 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1340.75 335.19 97615.23 74077.89 163957.82 00:23:28.085 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 589.35 147.34 230059.70 125126.34 334821.25 00:23:28.085 ======================================================== 00:23:28.085 Total : 1930.11 482.53 138056.81 74077.89 334821.25 00:23:28.085 00:23:28.085 20:24:33 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:28.085 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.343 No valid NVMe controllers or AIO or URING devices found 00:23:28.601 Initializing NVMe Controllers 00:23:28.601 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.601 Controller IO queue size 128, less than required. 00:23:28.601 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.601 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:28.601 Controller IO queue size 128, less than required. 00:23:28.601 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.601 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:28.601 WARNING: Some requested NVMe devices were skipped 00:23:28.601 20:24:33 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:28.601 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.135 Initializing NVMe Controllers 00:23:31.135 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:31.135 Controller IO queue size 128, less than required. 00:23:31.135 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:31.135 Controller IO queue size 128, less than required. 00:23:31.135 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:31.135 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:31.135 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:31.135 Initialization complete. Launching workers. 00:23:31.135 00:23:31.135 ==================== 00:23:31.135 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:31.135 TCP transport: 00:23:31.135 polls: 12251 00:23:31.135 idle_polls: 8703 00:23:31.135 sock_completions: 3548 00:23:31.135 nvme_completions: 5862 00:23:31.135 submitted_requests: 9003 00:23:31.135 queued_requests: 1 00:23:31.135 00:23:31.135 ==================== 00:23:31.135 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:31.135 TCP transport: 00:23:31.135 polls: 12637 00:23:31.135 idle_polls: 9538 00:23:31.135 sock_completions: 3099 00:23:31.135 nvme_completions: 4897 00:23:31.135 submitted_requests: 7555 00:23:31.135 queued_requests: 1 00:23:31.135 ======================================================== 00:23:31.135 Latency(us) 00:23:31.135 Device Information : IOPS MiB/s Average min max 00:23:31.135 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1528.97 382.24 85800.94 56217.98 136104.45 00:23:31.135 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1287.98 321.99 100033.59 46606.89 150579.09 00:23:31.135 ======================================================== 00:23:31.135 Total : 2816.95 704.24 92308.45 46606.89 150579.09 00:23:31.135 00:23:31.135 20:24:35 -- host/perf.sh@66 -- # sync 00:23:31.135 20:24:35 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:31.135 20:24:36 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:31.135 20:24:36 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:31.135 20:24:36 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:34.421 20:24:39 -- host/perf.sh@72 -- # ls_guid=09845451-8916-46ba-ab07-fd4c187918b6 00:23:34.421 20:24:39 -- host/perf.sh@73 -- # get_lvs_free_mb 09845451-8916-46ba-ab07-fd4c187918b6 00:23:34.421 20:24:39 -- common/autotest_common.sh@1353 -- # local lvs_uuid=09845451-8916-46ba-ab07-fd4c187918b6 00:23:34.421 20:24:39 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:34.421 20:24:39 -- common/autotest_common.sh@1355 -- # local fc 00:23:34.421 20:24:39 -- common/autotest_common.sh@1356 -- # local cs 00:23:34.421 20:24:39 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:34.679 20:24:39 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:34.679 { 00:23:34.679 "uuid": "09845451-8916-46ba-ab07-fd4c187918b6", 00:23:34.679 "name": "lvs_0", 00:23:34.679 "base_bdev": "Nvme0n1", 00:23:34.679 "total_data_clusters": 238234, 00:23:34.679 "free_clusters": 238234, 00:23:34.679 "block_size": 512, 00:23:34.679 "cluster_size": 4194304 00:23:34.679 } 00:23:34.679 ]' 00:23:34.679 20:24:39 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="09845451-8916-46ba-ab07-fd4c187918b6") .free_clusters' 00:23:34.679 20:24:39 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:34.679 20:24:39 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="09845451-8916-46ba-ab07-fd4c187918b6") .cluster_size' 00:23:34.679 20:24:39 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:34.679 20:24:39 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:34.679 20:24:39 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:34.679 952936 00:23:34.679 20:24:39 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:34.679 20:24:39 -- host/perf.sh@78 -- # free_mb=20480 00:23:34.679 20:24:39 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 09845451-8916-46ba-ab07-fd4c187918b6 lbd_0 20480 00:23:35.615 20:24:40 -- host/perf.sh@80 -- # lb_guid=573290c2-3966-4ad4-ba7e-66abef76605c 00:23:35.615 20:24:40 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 573290c2-3966-4ad4-ba7e-66abef76605c lvs_n_0 00:23:36.188 20:24:41 -- host/perf.sh@83 -- # ls_nested_guid=fd4f9663-9356-4038-b1fe-bcd2ac955cf2 00:23:36.188 20:24:41 -- host/perf.sh@84 -- # get_lvs_free_mb fd4f9663-9356-4038-b1fe-bcd2ac955cf2 00:23:36.188 20:24:41 -- common/autotest_common.sh@1353 -- # local lvs_uuid=fd4f9663-9356-4038-b1fe-bcd2ac955cf2 00:23:36.188 20:24:41 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:36.188 20:24:41 -- common/autotest_common.sh@1355 -- # local fc 00:23:36.188 20:24:41 -- common/autotest_common.sh@1356 -- # local cs 00:23:36.188 20:24:41 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:36.446 20:24:41 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:36.446 { 00:23:36.446 "uuid": "09845451-8916-46ba-ab07-fd4c187918b6", 00:23:36.446 "name": "lvs_0", 00:23:36.446 "base_bdev": "Nvme0n1", 00:23:36.446 "total_data_clusters": 238234, 00:23:36.446 "free_clusters": 233114, 00:23:36.447 "block_size": 512, 00:23:36.447 "cluster_size": 4194304 00:23:36.447 }, 00:23:36.447 { 00:23:36.447 "uuid": "fd4f9663-9356-4038-b1fe-bcd2ac955cf2", 00:23:36.447 "name": "lvs_n_0", 00:23:36.447 "base_bdev": "573290c2-3966-4ad4-ba7e-66abef76605c", 00:23:36.447 "total_data_clusters": 5114, 00:23:36.447 "free_clusters": 5114, 00:23:36.447 "block_size": 512, 00:23:36.447 "cluster_size": 4194304 00:23:36.447 } 00:23:36.447 ]' 00:23:36.447 20:24:41 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="fd4f9663-9356-4038-b1fe-bcd2ac955cf2") .free_clusters' 00:23:36.447 20:24:41 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:36.447 20:24:41 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="fd4f9663-9356-4038-b1fe-bcd2ac955cf2") .cluster_size' 00:23:36.447 20:24:41 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:36.447 20:24:41 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:36.447 20:24:41 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:36.447 20456 00:23:36.447 20:24:41 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:36.447 20:24:41 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u fd4f9663-9356-4038-b1fe-bcd2ac955cf2 lbd_nest_0 20456 00:23:36.705 20:24:41 -- host/perf.sh@88 -- # lb_nested_guid=313f0eb4-1905-4d85-81b8-a4097cf7ee50 00:23:36.705 20:24:41 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:36.963 20:24:41 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:36.963 20:24:41 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 313f0eb4-1905-4d85-81b8-a4097cf7ee50 00:23:37.237 20:24:42 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:37.496 20:24:42 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:37.496 20:24:42 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:37.496 20:24:42 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:37.496 20:24:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:37.496 20:24:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:37.496 EAL: No free 2048 kB hugepages reported on node 1 00:23:49.719 Initializing NVMe Controllers 00:23:49.719 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:49.719 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:49.719 Initialization complete. Launching workers. 00:23:49.719 ======================================================== 00:23:49.719 Latency(us) 00:23:49.719 Device Information : IOPS MiB/s Average min max 00:23:49.720 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.60 0.02 21502.65 190.41 46044.88 00:23:49.720 ======================================================== 00:23:49.720 Total : 46.60 0.02 21502.65 190.41 46044.88 00:23:49.720 00:23:49.720 20:24:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:49.720 20:24:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:49.720 EAL: No free 2048 kB hugepages reported on node 1 00:23:59.715 Initializing NVMe Controllers 00:23:59.715 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:59.715 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:59.715 Initialization complete. Launching workers. 00:23:59.715 ======================================================== 00:23:59.715 Latency(us) 00:23:59.715 Device Information : IOPS MiB/s Average min max 00:23:59.715 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 70.28 8.79 14227.83 5977.04 51872.09 00:23:59.715 ======================================================== 00:23:59.715 Total : 70.28 8.79 14227.83 5977.04 51872.09 00:23:59.715 00:23:59.715 20:25:03 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:59.715 20:25:03 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:59.715 20:25:03 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:59.715 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.753 Initializing NVMe Controllers 00:24:09.753 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:09.753 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:09.753 Initialization complete. Launching workers. 00:24:09.753 ======================================================== 00:24:09.753 Latency(us) 00:24:09.753 Device Information : IOPS MiB/s Average min max 00:24:09.753 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7702.48 3.76 4155.01 259.82 11969.53 00:24:09.753 ======================================================== 00:24:09.753 Total : 7702.48 3.76 4155.01 259.82 11969.53 00:24:09.753 00:24:09.753 20:25:13 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:09.753 20:25:13 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:09.753 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.736 Initializing NVMe Controllers 00:24:19.736 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:19.736 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:19.737 Initialization complete. Launching workers. 00:24:19.737 ======================================================== 00:24:19.737 Latency(us) 00:24:19.737 Device Information : IOPS MiB/s Average min max 00:24:19.737 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3998.89 499.86 8003.31 651.31 16266.03 00:24:19.737 ======================================================== 00:24:19.737 Total : 3998.89 499.86 8003.31 651.31 16266.03 00:24:19.737 00:24:19.737 20:25:23 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:19.737 20:25:23 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:19.737 20:25:23 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:19.737 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.746 Initializing NVMe Controllers 00:24:29.746 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:29.746 Controller IO queue size 128, less than required. 00:24:29.746 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:29.746 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:29.746 Initialization complete. Launching workers. 00:24:29.746 ======================================================== 00:24:29.746 Latency(us) 00:24:29.746 Device Information : IOPS MiB/s Average min max 00:24:29.746 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12050.23 5.88 10630.81 1735.75 26759.93 00:24:29.746 ======================================================== 00:24:29.746 Total : 12050.23 5.88 10630.81 1735.75 26759.93 00:24:29.746 00:24:29.746 20:25:34 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:29.746 20:25:34 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:29.746 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.731 Initializing NVMe Controllers 00:24:39.731 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:39.731 Controller IO queue size 128, less than required. 00:24:39.731 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:39.731 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:39.731 Initialization complete. Launching workers. 00:24:39.731 ======================================================== 00:24:39.731 Latency(us) 00:24:39.731 Device Information : IOPS MiB/s Average min max 00:24:39.731 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1197.69 149.71 107497.18 40018.98 191074.95 00:24:39.731 ======================================================== 00:24:39.731 Total : 1197.69 149.71 107497.18 40018.98 191074.95 00:24:39.731 00:24:39.731 20:25:44 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:39.731 20:25:44 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 313f0eb4-1905-4d85-81b8-a4097cf7ee50 00:24:40.670 20:25:45 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:40.928 20:25:45 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 573290c2-3966-4ad4-ba7e-66abef76605c 00:24:41.186 20:25:46 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:41.444 20:25:46 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:41.444 20:25:46 -- host/perf.sh@114 -- # nvmftestfini 00:24:41.444 20:25:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:41.444 20:25:46 -- nvmf/common.sh@116 -- # sync 00:24:41.444 20:25:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:41.444 20:25:46 -- nvmf/common.sh@119 -- # set +e 00:24:41.444 20:25:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:41.444 20:25:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:41.444 rmmod nvme_tcp 00:24:41.444 rmmod nvme_fabrics 00:24:41.444 rmmod nvme_keyring 00:24:41.444 20:25:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:41.444 20:25:46 -- nvmf/common.sh@123 -- # set -e 00:24:41.444 20:25:46 -- nvmf/common.sh@124 -- # return 0 00:24:41.444 20:25:46 -- nvmf/common.sh@477 -- # '[' -n 3237421 ']' 00:24:41.444 20:25:46 -- nvmf/common.sh@478 -- # killprocess 3237421 00:24:41.444 20:25:46 -- common/autotest_common.sh@936 -- # '[' -z 3237421 ']' 00:24:41.444 20:25:46 -- common/autotest_common.sh@940 -- # kill -0 3237421 00:24:41.444 20:25:46 -- common/autotest_common.sh@941 -- # uname 00:24:41.444 20:25:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:41.444 20:25:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3237421 00:24:41.444 20:25:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:41.444 20:25:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:41.444 20:25:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3237421' 00:24:41.444 killing process with pid 3237421 00:24:41.444 20:25:46 -- common/autotest_common.sh@955 -- # kill 3237421 00:24:41.444 20:25:46 -- common/autotest_common.sh@960 -- # wait 3237421 00:24:43.354 20:25:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:43.354 20:25:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:43.354 20:25:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:43.354 20:25:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:43.354 20:25:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:43.354 20:25:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:43.354 20:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:43.354 20:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.265 20:25:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:45.265 00:24:45.265 real 1m31.744s 00:24:45.265 user 5m38.174s 00:24:45.265 sys 0m15.960s 00:24:45.265 20:25:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:45.265 20:25:50 -- common/autotest_common.sh@10 -- # set +x 00:24:45.265 ************************************ 00:24:45.265 END TEST nvmf_perf 00:24:45.265 ************************************ 00:24:45.265 20:25:50 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:45.265 20:25:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:45.265 20:25:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:45.265 20:25:50 -- common/autotest_common.sh@10 -- # set +x 00:24:45.265 ************************************ 00:24:45.265 START TEST nvmf_fio_host 00:24:45.265 ************************************ 00:24:45.265 20:25:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:45.265 * Looking for test storage... 00:24:45.265 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:45.265 20:25:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:45.265 20:25:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:45.265 20:25:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:45.265 20:25:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:45.265 20:25:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:45.265 20:25:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:45.265 20:25:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:45.265 20:25:50 -- scripts/common.sh@335 -- # IFS=.-: 00:24:45.265 20:25:50 -- scripts/common.sh@335 -- # read -ra ver1 00:24:45.265 20:25:50 -- scripts/common.sh@336 -- # IFS=.-: 00:24:45.265 20:25:50 -- scripts/common.sh@336 -- # read -ra ver2 00:24:45.265 20:25:50 -- scripts/common.sh@337 -- # local 'op=<' 00:24:45.265 20:25:50 -- scripts/common.sh@339 -- # ver1_l=2 00:24:45.265 20:25:50 -- scripts/common.sh@340 -- # ver2_l=1 00:24:45.265 20:25:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:45.265 20:25:50 -- scripts/common.sh@343 -- # case "$op" in 00:24:45.265 20:25:50 -- scripts/common.sh@344 -- # : 1 00:24:45.265 20:25:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:45.265 20:25:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:45.265 20:25:50 -- scripts/common.sh@364 -- # decimal 1 00:24:45.265 20:25:50 -- scripts/common.sh@352 -- # local d=1 00:24:45.265 20:25:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:45.265 20:25:50 -- scripts/common.sh@354 -- # echo 1 00:24:45.265 20:25:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:45.265 20:25:50 -- scripts/common.sh@365 -- # decimal 2 00:24:45.265 20:25:50 -- scripts/common.sh@352 -- # local d=2 00:24:45.265 20:25:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:45.265 20:25:50 -- scripts/common.sh@354 -- # echo 2 00:24:45.265 20:25:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:45.265 20:25:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:45.265 20:25:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:45.265 20:25:50 -- scripts/common.sh@367 -- # return 0 00:24:45.265 20:25:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:45.266 20:25:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:45.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.266 --rc genhtml_branch_coverage=1 00:24:45.266 --rc genhtml_function_coverage=1 00:24:45.266 --rc genhtml_legend=1 00:24:45.266 --rc geninfo_all_blocks=1 00:24:45.266 --rc geninfo_unexecuted_blocks=1 00:24:45.266 00:24:45.266 ' 00:24:45.266 20:25:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:45.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.266 --rc genhtml_branch_coverage=1 00:24:45.266 --rc genhtml_function_coverage=1 00:24:45.266 --rc genhtml_legend=1 00:24:45.266 --rc geninfo_all_blocks=1 00:24:45.266 --rc geninfo_unexecuted_blocks=1 00:24:45.266 00:24:45.266 ' 00:24:45.266 20:25:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:45.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.266 --rc genhtml_branch_coverage=1 00:24:45.266 --rc genhtml_function_coverage=1 00:24:45.266 --rc genhtml_legend=1 00:24:45.266 --rc geninfo_all_blocks=1 00:24:45.266 --rc geninfo_unexecuted_blocks=1 00:24:45.266 00:24:45.266 ' 00:24:45.266 20:25:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:45.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.266 --rc genhtml_branch_coverage=1 00:24:45.266 --rc genhtml_function_coverage=1 00:24:45.266 --rc genhtml_legend=1 00:24:45.266 --rc geninfo_all_blocks=1 00:24:45.266 --rc geninfo_unexecuted_blocks=1 00:24:45.266 00:24:45.266 ' 00:24:45.266 20:25:50 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:45.266 20:25:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:45.266 20:25:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:45.266 20:25:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:45.266 20:25:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.266 20:25:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.266 20:25:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.266 20:25:50 -- paths/export.sh@5 -- # export PATH 00:24:45.266 20:25:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.266 20:25:50 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:45.266 20:25:50 -- nvmf/common.sh@7 -- # uname -s 00:24:45.527 20:25:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:45.527 20:25:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:45.527 20:25:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:45.527 20:25:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:45.527 20:25:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:45.527 20:25:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:45.527 20:25:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:45.527 20:25:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:45.527 20:25:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:45.527 20:25:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:45.527 20:25:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:45.527 20:25:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:45.527 20:25:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:45.527 20:25:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:45.527 20:25:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:45.527 20:25:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:45.527 20:25:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:45.527 20:25:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:45.527 20:25:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:45.527 20:25:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.527 20:25:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.527 20:25:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.527 20:25:50 -- paths/export.sh@5 -- # export PATH 00:24:45.527 20:25:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.527 20:25:50 -- nvmf/common.sh@46 -- # : 0 00:24:45.527 20:25:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:45.527 20:25:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:45.527 20:25:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:45.527 20:25:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:45.527 20:25:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:45.527 20:25:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:45.527 20:25:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:45.527 20:25:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:45.527 20:25:50 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:45.527 20:25:50 -- host/fio.sh@14 -- # nvmftestinit 00:24:45.527 20:25:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:45.527 20:25:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:45.527 20:25:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:45.527 20:25:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:45.527 20:25:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:45.527 20:25:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:45.527 20:25:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:45.527 20:25:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.527 20:25:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:45.527 20:25:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:45.527 20:25:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:45.527 20:25:50 -- common/autotest_common.sh@10 -- # set +x 00:24:47.433 20:25:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:47.433 20:25:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:47.433 20:25:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:47.433 20:25:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:47.433 20:25:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:47.433 20:25:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:47.433 20:25:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:47.433 20:25:52 -- nvmf/common.sh@294 -- # net_devs=() 00:24:47.433 20:25:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:47.433 20:25:52 -- nvmf/common.sh@295 -- # e810=() 00:24:47.433 20:25:52 -- nvmf/common.sh@295 -- # local -ga e810 00:24:47.433 20:25:52 -- nvmf/common.sh@296 -- # x722=() 00:24:47.433 20:25:52 -- nvmf/common.sh@296 -- # local -ga x722 00:24:47.433 20:25:52 -- nvmf/common.sh@297 -- # mlx=() 00:24:47.433 20:25:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:47.433 20:25:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:47.433 20:25:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:47.434 20:25:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:47.434 20:25:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:47.434 20:25:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:47.434 20:25:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:47.434 20:25:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:47.434 20:25:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:47.434 20:25:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.434 20:25:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:47.434 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:47.434 20:25:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.434 20:25:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:47.434 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:47.434 20:25:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:47.434 20:25:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.434 20:25:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.434 20:25:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.434 20:25:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.434 20:25:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:47.434 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:47.434 20:25:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.434 20:25:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.434 20:25:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.434 20:25:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.434 20:25:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.434 20:25:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:47.434 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:47.434 20:25:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.434 20:25:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:47.434 20:25:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:47.434 20:25:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:47.434 20:25:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:47.434 20:25:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:47.434 20:25:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:47.434 20:25:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:47.434 20:25:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:47.434 20:25:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:47.434 20:25:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:47.434 20:25:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:47.434 20:25:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:47.434 20:25:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:47.434 20:25:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:47.434 20:25:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:47.434 20:25:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:47.434 20:25:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:47.434 20:25:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:47.434 20:25:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:47.434 20:25:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:47.434 20:25:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:47.434 20:25:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:47.693 20:25:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:47.693 20:25:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:47.693 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:47.693 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:24:47.693 00:24:47.693 --- 10.0.0.2 ping statistics --- 00:24:47.693 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:47.693 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:24:47.693 20:25:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:47.693 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:47.693 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:24:47.693 00:24:47.693 --- 10.0.0.1 ping statistics --- 00:24:47.693 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:47.693 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:24:47.693 20:25:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:47.693 20:25:52 -- nvmf/common.sh@410 -- # return 0 00:24:47.693 20:25:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:47.693 20:25:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:47.693 20:25:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:47.693 20:25:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:47.693 20:25:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:47.693 20:25:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:47.693 20:25:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:47.693 20:25:52 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:47.693 20:25:52 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:47.693 20:25:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:47.693 20:25:52 -- common/autotest_common.sh@10 -- # set +x 00:24:47.693 20:25:52 -- host/fio.sh@24 -- # nvmfpid=3249884 00:24:47.693 20:25:52 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:47.693 20:25:52 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:47.693 20:25:52 -- host/fio.sh@28 -- # waitforlisten 3249884 00:24:47.693 20:25:52 -- common/autotest_common.sh@829 -- # '[' -z 3249884 ']' 00:24:47.693 20:25:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:47.694 20:25:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:47.694 20:25:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:47.694 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:47.694 20:25:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:47.694 20:25:52 -- common/autotest_common.sh@10 -- # set +x 00:24:47.694 [2024-11-20 20:25:52.556790] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:47.694 [2024-11-20 20:25:52.556862] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:47.694 EAL: No free 2048 kB hugepages reported on node 1 00:24:47.694 [2024-11-20 20:25:52.624957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:47.952 [2024-11-20 20:25:52.740797] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:47.952 [2024-11-20 20:25:52.740983] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:47.952 [2024-11-20 20:25:52.741014] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:47.952 [2024-11-20 20:25:52.741036] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:47.952 [2024-11-20 20:25:52.741137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:47.952 [2024-11-20 20:25:52.741202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:47.952 [2024-11-20 20:25:52.741320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:47.952 [2024-11-20 20:25:52.741327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:48.520 20:25:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:48.520 20:25:53 -- common/autotest_common.sh@862 -- # return 0 00:24:48.520 20:25:53 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:48.778 [2024-11-20 20:25:53.738249] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:48.778 20:25:53 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:48.778 20:25:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:48.778 20:25:53 -- common/autotest_common.sh@10 -- # set +x 00:24:48.778 20:25:53 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:49.036 Malloc1 00:24:49.036 20:25:54 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:49.294 20:25:54 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:49.552 20:25:54 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:49.810 [2024-11-20 20:25:54.789910] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:49.810 20:25:54 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:50.068 20:25:55 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:50.068 20:25:55 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.068 20:25:55 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.068 20:25:55 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:50.068 20:25:55 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:50.068 20:25:55 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:50.068 20:25:55 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.068 20:25:55 -- common/autotest_common.sh@1330 -- # shift 00:24:50.068 20:25:55 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:50.068 20:25:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.068 20:25:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.068 20:25:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.068 20:25:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.068 20:25:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.068 20:25:55 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:50.068 20:25:55 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.327 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:50.327 fio-3.35 00:24:50.327 Starting 1 thread 00:24:50.327 EAL: No free 2048 kB hugepages reported on node 1 00:24:52.855 00:24:52.855 test: (groupid=0, jobs=1): err= 0: pid=3250384: Wed Nov 20 20:25:57 2024 00:24:52.855 read: IOPS=9547, BW=37.3MiB/s (39.1MB/s)(74.8MiB/2006msec) 00:24:52.855 slat (nsec): min=1827, max=160991, avg=2341.84, stdev=1893.06 00:24:52.855 clat (usec): min=2304, max=12733, avg=7386.04, stdev=565.50 00:24:52.855 lat (usec): min=2328, max=12735, avg=7388.38, stdev=565.39 00:24:52.855 clat percentiles (usec): 00:24:52.855 | 1.00th=[ 6063], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:24:52.855 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:24:52.855 | 70.00th=[ 7635], 80.00th=[ 7832], 90.00th=[ 8029], 95.00th=[ 8225], 00:24:52.855 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[10683], 99.95th=[11469], 00:24:52.855 | 99.99th=[12649] 00:24:52.855 bw ( KiB/s): min=37400, max=38808, per=99.95%, avg=38172.00, stdev=590.68, samples=4 00:24:52.855 iops : min= 9350, max= 9702, avg=9543.00, stdev=147.67, samples=4 00:24:52.855 write: IOPS=9558, BW=37.3MiB/s (39.1MB/s)(74.9MiB/2006msec); 0 zone resets 00:24:52.855 slat (nsec): min=1919, max=136699, avg=2416.98, stdev=1378.59 00:24:52.855 clat (usec): min=1425, max=11407, avg=5965.25, stdev=489.18 00:24:52.855 lat (usec): min=1434, max=11409, avg=5967.66, stdev=489.14 00:24:52.855 clat percentiles (usec): 00:24:52.855 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:24:52.855 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5932], 60.00th=[ 6063], 00:24:52.855 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6652], 00:24:52.855 | 99.00th=[ 6980], 99.50th=[ 7177], 99.90th=[ 9634], 99.95th=[11076], 00:24:52.855 | 99.99th=[11338] 00:24:52.855 bw ( KiB/s): min=38088, max=38464, per=99.98%, avg=38226.00, stdev=166.07, samples=4 00:24:52.855 iops : min= 9522, max= 9616, avg=9556.50, stdev=41.52, samples=4 00:24:52.855 lat (msec) : 2=0.02%, 4=0.10%, 10=99.77%, 20=0.11% 00:24:52.855 cpu : usr=63.99%, sys=33.12%, ctx=58, majf=0, minf=37 00:24:52.855 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:52.855 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:52.855 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:52.855 issued rwts: total=19152,19174,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:52.855 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:52.855 00:24:52.855 Run status group 0 (all jobs): 00:24:52.855 READ: bw=37.3MiB/s (39.1MB/s), 37.3MiB/s-37.3MiB/s (39.1MB/s-39.1MB/s), io=74.8MiB (78.4MB), run=2006-2006msec 00:24:52.855 WRITE: bw=37.3MiB/s (39.1MB/s), 37.3MiB/s-37.3MiB/s (39.1MB/s-39.1MB/s), io=74.9MiB (78.5MB), run=2006-2006msec 00:24:52.855 20:25:57 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:52.855 20:25:57 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:52.855 20:25:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:52.855 20:25:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:52.855 20:25:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:52.855 20:25:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.855 20:25:57 -- common/autotest_common.sh@1330 -- # shift 00:24:52.855 20:25:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:52.855 20:25:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:52.856 20:25:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:52.856 20:25:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:52.856 20:25:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:52.856 20:25:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:52.856 20:25:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:52.856 20:25:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:52.856 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:52.856 fio-3.35 00:24:52.856 Starting 1 thread 00:24:53.114 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.641 00:24:55.641 test: (groupid=0, jobs=1): err= 0: pid=3250727: Wed Nov 20 20:26:00 2024 00:24:55.641 read: IOPS=7821, BW=122MiB/s (128MB/s)(245MiB/2007msec) 00:24:55.641 slat (usec): min=2, max=104, avg= 3.68, stdev= 2.09 00:24:55.641 clat (usec): min=2095, max=17598, avg=9133.09, stdev=2024.71 00:24:55.641 lat (usec): min=2098, max=17601, avg=9136.76, stdev=2024.77 00:24:55.641 clat percentiles (usec): 00:24:55.641 | 1.00th=[ 4817], 5.00th=[ 5866], 10.00th=[ 6521], 20.00th=[ 7373], 00:24:55.641 | 30.00th=[ 8094], 40.00th=[ 8717], 50.00th=[ 9110], 60.00th=[ 9634], 00:24:55.641 | 70.00th=[10028], 80.00th=[10683], 90.00th=[11600], 95.00th=[12518], 00:24:55.641 | 99.00th=[14353], 99.50th=[15270], 99.90th=[16909], 99.95th=[16909], 00:24:55.641 | 99.99th=[17433] 00:24:55.641 bw ( KiB/s): min=58304, max=72416, per=51.95%, avg=65008.00, stdev=5853.73, samples=4 00:24:55.641 iops : min= 3644, max= 4526, avg=4063.00, stdev=365.86, samples=4 00:24:55.641 write: IOPS=4716, BW=73.7MiB/s (77.3MB/s)(134MiB/1814msec); 0 zone resets 00:24:55.641 slat (usec): min=30, max=188, avg=34.44, stdev= 6.47 00:24:55.641 clat (usec): min=6327, max=21943, avg=12457.93, stdev=2568.42 00:24:55.641 lat (usec): min=6358, max=21977, avg=12492.37, stdev=2568.77 00:24:55.641 clat percentiles (usec): 00:24:55.641 | 1.00th=[ 7373], 5.00th=[ 8455], 10.00th=[ 9241], 20.00th=[10159], 00:24:55.641 | 30.00th=[10814], 40.00th=[11600], 50.00th=[12387], 60.00th=[13173], 00:24:55.641 | 70.00th=[13829], 80.00th=[14746], 90.00th=[16057], 95.00th=[16712], 00:24:55.641 | 99.00th=[18482], 99.50th=[19006], 99.90th=[19268], 99.95th=[20055], 00:24:55.641 | 99.99th=[21890] 00:24:55.641 bw ( KiB/s): min=61280, max=75456, per=90.06%, avg=67968.00, stdev=5818.08, samples=4 00:24:55.641 iops : min= 3830, max= 4716, avg=4248.00, stdev=363.63, samples=4 00:24:55.641 lat (msec) : 4=0.17%, 10=50.43%, 20=49.38%, 50=0.02% 00:24:55.641 cpu : usr=72.48%, sys=24.93%, ctx=62, majf=0, minf=61 00:24:55.641 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:24:55.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:55.641 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:55.641 issued rwts: total=15697,8556,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:55.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:55.641 00:24:55.641 Run status group 0 (all jobs): 00:24:55.641 READ: bw=122MiB/s (128MB/s), 122MiB/s-122MiB/s (128MB/s-128MB/s), io=245MiB (257MB), run=2007-2007msec 00:24:55.641 WRITE: bw=73.7MiB/s (77.3MB/s), 73.7MiB/s-73.7MiB/s (77.3MB/s-77.3MB/s), io=134MiB (140MB), run=1814-1814msec 00:24:55.641 20:26:00 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:55.641 20:26:00 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:55.641 20:26:00 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:55.641 20:26:00 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:55.641 20:26:00 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:55.641 20:26:00 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:55.641 20:26:00 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:55.641 20:26:00 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:55.641 20:26:00 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:55.641 20:26:00 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:55.642 20:26:00 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:55.642 20:26:00 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:58.935 Nvme0n1 00:24:58.935 20:26:03 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:02.224 20:26:06 -- host/fio.sh@53 -- # ls_guid=27733466-0bca-458b-a758-b798a910e42c 00:25:02.224 20:26:06 -- host/fio.sh@54 -- # get_lvs_free_mb 27733466-0bca-458b-a758-b798a910e42c 00:25:02.224 20:26:06 -- common/autotest_common.sh@1353 -- # local lvs_uuid=27733466-0bca-458b-a758-b798a910e42c 00:25:02.224 20:26:06 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:02.224 20:26:06 -- common/autotest_common.sh@1355 -- # local fc 00:25:02.224 20:26:06 -- common/autotest_common.sh@1356 -- # local cs 00:25:02.224 20:26:06 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:02.224 20:26:06 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:02.224 { 00:25:02.224 "uuid": "27733466-0bca-458b-a758-b798a910e42c", 00:25:02.224 "name": "lvs_0", 00:25:02.224 "base_bdev": "Nvme0n1", 00:25:02.224 "total_data_clusters": 930, 00:25:02.224 "free_clusters": 930, 00:25:02.224 "block_size": 512, 00:25:02.224 "cluster_size": 1073741824 00:25:02.224 } 00:25:02.224 ]' 00:25:02.224 20:26:06 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="27733466-0bca-458b-a758-b798a910e42c") .free_clusters' 00:25:02.224 20:26:06 -- common/autotest_common.sh@1358 -- # fc=930 00:25:02.224 20:26:06 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="27733466-0bca-458b-a758-b798a910e42c") .cluster_size' 00:25:02.224 20:26:06 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:02.224 20:26:06 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:02.224 20:26:06 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:02.224 952320 00:25:02.225 20:26:06 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:02.482 8008a8ad-ed47-4165-a4ff-fb9eb40bad30 00:25:02.482 20:26:07 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:02.740 20:26:07 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:02.998 20:26:07 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:03.257 20:26:08 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.257 20:26:08 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.257 20:26:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:03.257 20:26:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:03.257 20:26:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:03.257 20:26:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.257 20:26:08 -- common/autotest_common.sh@1330 -- # shift 00:25:03.257 20:26:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:03.257 20:26:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.257 20:26:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.257 20:26:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.257 20:26:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.257 20:26:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.257 20:26:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:03.257 20:26:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.601 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:03.601 fio-3.35 00:25:03.601 Starting 1 thread 00:25:03.601 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.150 00:25:06.150 test: (groupid=0, jobs=1): err= 0: pid=3252045: Wed Nov 20 20:26:10 2024 00:25:06.150 read: IOPS=6351, BW=24.8MiB/s (26.0MB/s)(49.8MiB/2007msec) 00:25:06.150 slat (nsec): min=1862, max=155407, avg=2472.58, stdev=2121.64 00:25:06.150 clat (usec): min=1166, max=170868, avg=11105.31, stdev=11334.51 00:25:06.150 lat (usec): min=1169, max=170904, avg=11107.79, stdev=11334.81 00:25:06.150 clat percentiles (msec): 00:25:06.150 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:25:06.150 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:25:06.150 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:06.150 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:06.150 | 99.99th=[ 171] 00:25:06.150 bw ( KiB/s): min=18184, max=28240, per=99.79%, avg=25354.00, stdev=4797.41, samples=4 00:25:06.150 iops : min= 4546, max= 7060, avg=6338.50, stdev=1199.35, samples=4 00:25:06.150 write: IOPS=6348, BW=24.8MiB/s (26.0MB/s)(49.8MiB/2007msec); 0 zone resets 00:25:06.150 slat (usec): min=2, max=105, avg= 2.62, stdev= 1.65 00:25:06.150 clat (usec): min=330, max=169123, avg=8921.06, stdev=10641.17 00:25:06.150 lat (usec): min=333, max=169129, avg=8923.69, stdev=10641.43 00:25:06.150 clat percentiles (msec): 00:25:06.150 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:25:06.150 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:25:06.150 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:06.150 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:06.150 | 99.99th=[ 169] 00:25:06.150 bw ( KiB/s): min=19176, max=27808, per=99.91%, avg=25370.00, stdev=4137.95, samples=4 00:25:06.150 iops : min= 4794, max= 6952, avg=6342.50, stdev=1034.49, samples=4 00:25:06.150 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:06.150 lat (msec) : 2=0.02%, 4=0.13%, 10=67.73%, 20=31.59%, 250=0.50% 00:25:06.150 cpu : usr=61.17%, sys=36.59%, ctx=104, majf=0, minf=37 00:25:06.150 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:06.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:06.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:06.150 issued rwts: total=12748,12741,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:06.150 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:06.150 00:25:06.150 Run status group 0 (all jobs): 00:25:06.150 READ: bw=24.8MiB/s (26.0MB/s), 24.8MiB/s-24.8MiB/s (26.0MB/s-26.0MB/s), io=49.8MiB (52.2MB), run=2007-2007msec 00:25:06.150 WRITE: bw=24.8MiB/s (26.0MB/s), 24.8MiB/s-24.8MiB/s (26.0MB/s-26.0MB/s), io=49.8MiB (52.2MB), run=2007-2007msec 00:25:06.150 20:26:10 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:06.150 20:26:10 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:07.089 20:26:12 -- host/fio.sh@64 -- # ls_nested_guid=a6ecf0e2-82f8-4e45-8ea2-1aab33b0de72 00:25:07.089 20:26:12 -- host/fio.sh@65 -- # get_lvs_free_mb a6ecf0e2-82f8-4e45-8ea2-1aab33b0de72 00:25:07.089 20:26:12 -- common/autotest_common.sh@1353 -- # local lvs_uuid=a6ecf0e2-82f8-4e45-8ea2-1aab33b0de72 00:25:07.089 20:26:12 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:07.089 20:26:12 -- common/autotest_common.sh@1355 -- # local fc 00:25:07.089 20:26:12 -- common/autotest_common.sh@1356 -- # local cs 00:25:07.089 20:26:12 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:07.348 20:26:12 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:07.348 { 00:25:07.348 "uuid": "27733466-0bca-458b-a758-b798a910e42c", 00:25:07.348 "name": "lvs_0", 00:25:07.348 "base_bdev": "Nvme0n1", 00:25:07.348 "total_data_clusters": 930, 00:25:07.348 "free_clusters": 0, 00:25:07.348 "block_size": 512, 00:25:07.348 "cluster_size": 1073741824 00:25:07.348 }, 00:25:07.348 { 00:25:07.348 "uuid": "a6ecf0e2-82f8-4e45-8ea2-1aab33b0de72", 00:25:07.348 "name": "lvs_n_0", 00:25:07.348 "base_bdev": "8008a8ad-ed47-4165-a4ff-fb9eb40bad30", 00:25:07.348 "total_data_clusters": 237847, 00:25:07.348 "free_clusters": 237847, 00:25:07.348 "block_size": 512, 00:25:07.348 "cluster_size": 4194304 00:25:07.348 } 00:25:07.348 ]' 00:25:07.348 20:26:12 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="a6ecf0e2-82f8-4e45-8ea2-1aab33b0de72") .free_clusters' 00:25:07.348 20:26:12 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:07.348 20:26:12 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="a6ecf0e2-82f8-4e45-8ea2-1aab33b0de72") .cluster_size' 00:25:07.607 20:26:12 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:07.607 20:26:12 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:07.607 20:26:12 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:07.607 951388 00:25:07.607 20:26:12 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:08.174 e644b548-b3bb-4710-9999-53a2b14c5874 00:25:08.174 20:26:13 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:08.431 20:26:13 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:08.688 20:26:13 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:08.946 20:26:13 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:08.946 20:26:13 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:08.946 20:26:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:08.946 20:26:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:08.946 20:26:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:08.946 20:26:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.946 20:26:13 -- common/autotest_common.sh@1330 -- # shift 00:25:08.946 20:26:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:08.946 20:26:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:08.946 20:26:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:08.946 20:26:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:08.946 20:26:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:08.946 20:26:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:08.946 20:26:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:08.946 20:26:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.204 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:09.204 fio-3.35 00:25:09.204 Starting 1 thread 00:25:09.204 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.733 00:25:11.733 test: (groupid=0, jobs=1): err= 0: pid=3252905: Wed Nov 20 20:26:16 2024 00:25:11.733 read: IOPS=6155, BW=24.0MiB/s (25.2MB/s)(48.3MiB/2009msec) 00:25:11.733 slat (nsec): min=1864, max=146858, avg=2507.63, stdev=2130.45 00:25:11.733 clat (usec): min=4056, max=19252, avg=11474.50, stdev=954.37 00:25:11.733 lat (usec): min=4068, max=19255, avg=11477.01, stdev=954.26 00:25:11.733 clat percentiles (usec): 00:25:11.733 | 1.00th=[ 9241], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10814], 00:25:11.733 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:25:11.733 | 70.00th=[11863], 80.00th=[12256], 90.00th=[12649], 95.00th=[12911], 00:25:11.733 | 99.00th=[13566], 99.50th=[13960], 99.90th=[17171], 99.95th=[17433], 00:25:11.733 | 99.99th=[18482] 00:25:11.733 bw ( KiB/s): min=23304, max=25120, per=99.89%, avg=24594.00, stdev=865.66, samples=4 00:25:11.733 iops : min= 5826, max= 6280, avg=6148.50, stdev=216.42, samples=4 00:25:11.733 write: IOPS=6137, BW=24.0MiB/s (25.1MB/s)(48.2MiB/2009msec); 0 zone resets 00:25:11.733 slat (nsec): min=1944, max=94615, avg=2554.15, stdev=1413.61 00:25:11.733 clat (usec): min=1942, max=17239, avg=9210.86, stdev=865.05 00:25:11.733 lat (usec): min=1950, max=17241, avg=9213.41, stdev=865.00 00:25:11.733 clat percentiles (usec): 00:25:11.733 | 1.00th=[ 7242], 5.00th=[ 7898], 10.00th=[ 8225], 20.00th=[ 8586], 00:25:11.733 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:25:11.733 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10421], 00:25:11.733 | 99.00th=[11076], 99.50th=[11469], 99.90th=[15926], 99.95th=[16188], 00:25:11.733 | 99.99th=[17171] 00:25:11.733 bw ( KiB/s): min=24456, max=24640, per=99.98%, avg=24546.00, stdev=79.57, samples=4 00:25:11.733 iops : min= 6114, max= 6160, avg=6136.50, stdev=19.89, samples=4 00:25:11.733 lat (msec) : 2=0.01%, 4=0.03%, 10=44.79%, 20=55.17% 00:25:11.733 cpu : usr=62.90%, sys=34.76%, ctx=127, majf=0, minf=37 00:25:11.733 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:11.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:11.733 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:11.733 issued rwts: total=12366,12331,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:11.733 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:11.733 00:25:11.733 Run status group 0 (all jobs): 00:25:11.733 READ: bw=24.0MiB/s (25.2MB/s), 24.0MiB/s-24.0MiB/s (25.2MB/s-25.2MB/s), io=48.3MiB (50.7MB), run=2009-2009msec 00:25:11.733 WRITE: bw=24.0MiB/s (25.1MB/s), 24.0MiB/s-24.0MiB/s (25.1MB/s-25.1MB/s), io=48.2MiB (50.5MB), run=2009-2009msec 00:25:11.733 20:26:16 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:11.733 20:26:16 -- host/fio.sh@74 -- # sync 00:25:11.733 20:26:16 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:15.921 20:26:20 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:15.922 20:26:20 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:19.210 20:26:23 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:19.210 20:26:24 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:21.114 20:26:25 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:21.114 20:26:25 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:21.114 20:26:25 -- host/fio.sh@86 -- # nvmftestfini 00:25:21.114 20:26:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:21.114 20:26:25 -- nvmf/common.sh@116 -- # sync 00:25:21.114 20:26:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:21.114 20:26:25 -- nvmf/common.sh@119 -- # set +e 00:25:21.114 20:26:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:21.114 20:26:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:21.114 rmmod nvme_tcp 00:25:21.114 rmmod nvme_fabrics 00:25:21.114 rmmod nvme_keyring 00:25:21.114 20:26:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:21.114 20:26:26 -- nvmf/common.sh@123 -- # set -e 00:25:21.114 20:26:26 -- nvmf/common.sh@124 -- # return 0 00:25:21.114 20:26:26 -- nvmf/common.sh@477 -- # '[' -n 3249884 ']' 00:25:21.114 20:26:26 -- nvmf/common.sh@478 -- # killprocess 3249884 00:25:21.114 20:26:26 -- common/autotest_common.sh@936 -- # '[' -z 3249884 ']' 00:25:21.114 20:26:26 -- common/autotest_common.sh@940 -- # kill -0 3249884 00:25:21.114 20:26:26 -- common/autotest_common.sh@941 -- # uname 00:25:21.114 20:26:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.114 20:26:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3249884 00:25:21.114 20:26:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:21.114 20:26:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:21.114 20:26:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3249884' 00:25:21.114 killing process with pid 3249884 00:25:21.114 20:26:26 -- common/autotest_common.sh@955 -- # kill 3249884 00:25:21.114 20:26:26 -- common/autotest_common.sh@960 -- # wait 3249884 00:25:21.373 20:26:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:21.373 20:26:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:21.373 20:26:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:21.373 20:26:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:21.373 20:26:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:21.373 20:26:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.373 20:26:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.373 20:26:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:23.910 20:26:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:23.910 00:25:23.910 real 0m38.234s 00:25:23.910 user 2m25.919s 00:25:23.910 sys 0m7.187s 00:25:23.910 20:26:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:23.910 20:26:28 -- common/autotest_common.sh@10 -- # set +x 00:25:23.910 ************************************ 00:25:23.910 END TEST nvmf_fio_host 00:25:23.910 ************************************ 00:25:23.910 20:26:28 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:23.910 20:26:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:23.910 20:26:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:23.910 20:26:28 -- common/autotest_common.sh@10 -- # set +x 00:25:23.910 ************************************ 00:25:23.910 START TEST nvmf_failover 00:25:23.910 ************************************ 00:25:23.910 20:26:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:23.910 * Looking for test storage... 00:25:23.910 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:23.910 20:26:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:23.910 20:26:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:23.910 20:26:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:23.910 20:26:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:23.910 20:26:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:23.910 20:26:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:23.910 20:26:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:23.910 20:26:28 -- scripts/common.sh@335 -- # IFS=.-: 00:25:23.910 20:26:28 -- scripts/common.sh@335 -- # read -ra ver1 00:25:23.910 20:26:28 -- scripts/common.sh@336 -- # IFS=.-: 00:25:23.911 20:26:28 -- scripts/common.sh@336 -- # read -ra ver2 00:25:23.911 20:26:28 -- scripts/common.sh@337 -- # local 'op=<' 00:25:23.911 20:26:28 -- scripts/common.sh@339 -- # ver1_l=2 00:25:23.911 20:26:28 -- scripts/common.sh@340 -- # ver2_l=1 00:25:23.911 20:26:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:23.911 20:26:28 -- scripts/common.sh@343 -- # case "$op" in 00:25:23.911 20:26:28 -- scripts/common.sh@344 -- # : 1 00:25:23.911 20:26:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:23.911 20:26:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:23.911 20:26:28 -- scripts/common.sh@364 -- # decimal 1 00:25:23.911 20:26:28 -- scripts/common.sh@352 -- # local d=1 00:25:23.911 20:26:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:23.911 20:26:28 -- scripts/common.sh@354 -- # echo 1 00:25:23.911 20:26:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:23.911 20:26:28 -- scripts/common.sh@365 -- # decimal 2 00:25:23.911 20:26:28 -- scripts/common.sh@352 -- # local d=2 00:25:23.911 20:26:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:23.911 20:26:28 -- scripts/common.sh@354 -- # echo 2 00:25:23.911 20:26:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:23.911 20:26:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:23.911 20:26:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:23.911 20:26:28 -- scripts/common.sh@367 -- # return 0 00:25:23.911 20:26:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:23.911 20:26:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:23.911 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.911 --rc genhtml_branch_coverage=1 00:25:23.911 --rc genhtml_function_coverage=1 00:25:23.911 --rc genhtml_legend=1 00:25:23.911 --rc geninfo_all_blocks=1 00:25:23.911 --rc geninfo_unexecuted_blocks=1 00:25:23.911 00:25:23.911 ' 00:25:23.911 20:26:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:23.911 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.911 --rc genhtml_branch_coverage=1 00:25:23.911 --rc genhtml_function_coverage=1 00:25:23.911 --rc genhtml_legend=1 00:25:23.911 --rc geninfo_all_blocks=1 00:25:23.911 --rc geninfo_unexecuted_blocks=1 00:25:23.911 00:25:23.911 ' 00:25:23.911 20:26:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:23.911 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.911 --rc genhtml_branch_coverage=1 00:25:23.911 --rc genhtml_function_coverage=1 00:25:23.911 --rc genhtml_legend=1 00:25:23.911 --rc geninfo_all_blocks=1 00:25:23.911 --rc geninfo_unexecuted_blocks=1 00:25:23.911 00:25:23.911 ' 00:25:23.911 20:26:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:23.911 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:23.911 --rc genhtml_branch_coverage=1 00:25:23.911 --rc genhtml_function_coverage=1 00:25:23.911 --rc genhtml_legend=1 00:25:23.911 --rc geninfo_all_blocks=1 00:25:23.911 --rc geninfo_unexecuted_blocks=1 00:25:23.911 00:25:23.911 ' 00:25:23.911 20:26:28 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:23.911 20:26:28 -- nvmf/common.sh@7 -- # uname -s 00:25:23.911 20:26:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:23.911 20:26:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:23.911 20:26:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:23.911 20:26:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:23.911 20:26:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:23.911 20:26:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:23.911 20:26:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:23.911 20:26:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:23.911 20:26:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:23.911 20:26:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:23.911 20:26:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:23.911 20:26:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:23.911 20:26:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:23.911 20:26:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:23.911 20:26:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:23.911 20:26:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:23.911 20:26:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:23.911 20:26:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:23.911 20:26:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:23.911 20:26:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.911 20:26:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.911 20:26:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.911 20:26:28 -- paths/export.sh@5 -- # export PATH 00:25:23.911 20:26:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:23.911 20:26:28 -- nvmf/common.sh@46 -- # : 0 00:25:23.911 20:26:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:23.911 20:26:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:23.911 20:26:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:23.911 20:26:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:23.911 20:26:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:23.911 20:26:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:23.911 20:26:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:23.911 20:26:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:23.911 20:26:28 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:23.911 20:26:28 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:23.911 20:26:28 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:23.911 20:26:28 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:23.911 20:26:28 -- host/failover.sh@18 -- # nvmftestinit 00:25:23.911 20:26:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:23.911 20:26:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:23.911 20:26:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:23.911 20:26:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:23.911 20:26:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:23.911 20:26:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.911 20:26:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.911 20:26:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:23.911 20:26:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:23.911 20:26:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:23.911 20:26:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:23.911 20:26:28 -- common/autotest_common.sh@10 -- # set +x 00:25:25.815 20:26:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:25.815 20:26:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:25.815 20:26:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:25.815 20:26:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:25.815 20:26:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:25.815 20:26:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:25.815 20:26:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:25.815 20:26:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:25.815 20:26:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:25.815 20:26:30 -- nvmf/common.sh@295 -- # e810=() 00:25:25.815 20:26:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:25.815 20:26:30 -- nvmf/common.sh@296 -- # x722=() 00:25:25.815 20:26:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:25.815 20:26:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:25.815 20:26:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:25.815 20:26:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:25.815 20:26:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:25.815 20:26:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:25.815 20:26:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:25.815 20:26:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.815 20:26:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:25.815 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:25.815 20:26:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.815 20:26:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:25.815 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:25.815 20:26:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:25.815 20:26:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.815 20:26:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.815 20:26:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.815 20:26:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.815 20:26:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:25.815 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:25.815 20:26:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.815 20:26:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.815 20:26:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.815 20:26:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.815 20:26:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.815 20:26:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:25.815 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:25.815 20:26:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.815 20:26:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:25.815 20:26:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:25.815 20:26:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:25.815 20:26:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:25.815 20:26:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:25.815 20:26:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:25.815 20:26:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:25.815 20:26:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:25.815 20:26:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:25.815 20:26:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:25.815 20:26:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:25.815 20:26:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:25.815 20:26:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:25.815 20:26:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:25.815 20:26:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:25.815 20:26:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:25.815 20:26:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:25.815 20:26:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:25.815 20:26:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:25.815 20:26:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:25.815 20:26:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:25.815 20:26:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:25.815 20:26:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:25.815 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:25.815 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:25:25.815 00:25:25.815 --- 10.0.0.2 ping statistics --- 00:25:25.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.815 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:25:25.815 20:26:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:25.815 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:25.815 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:25:25.815 00:25:25.815 --- 10.0.0.1 ping statistics --- 00:25:25.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.815 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:25:25.815 20:26:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:25.815 20:26:30 -- nvmf/common.sh@410 -- # return 0 00:25:25.815 20:26:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:25.815 20:26:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:25.815 20:26:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:25.815 20:26:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:25.815 20:26:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:25.815 20:26:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:25.815 20:26:30 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:25.815 20:26:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:25.815 20:26:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.815 20:26:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.815 20:26:30 -- nvmf/common.sh@469 -- # nvmfpid=3256239 00:25:25.815 20:26:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:25.815 20:26:30 -- nvmf/common.sh@470 -- # waitforlisten 3256239 00:25:25.815 20:26:30 -- common/autotest_common.sh@829 -- # '[' -z 3256239 ']' 00:25:25.815 20:26:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:25.815 20:26:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.815 20:26:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:25.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:25.815 20:26:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.815 20:26:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.815 [2024-11-20 20:26:30.791133] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:25.815 [2024-11-20 20:26:30.791207] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:25.815 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.076 [2024-11-20 20:26:30.860547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:26.076 [2024-11-20 20:26:30.974553] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:26.076 [2024-11-20 20:26:30.974712] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:26.076 [2024-11-20 20:26:30.974731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:26.076 [2024-11-20 20:26:30.974745] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:26.076 [2024-11-20 20:26:30.974853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:26.076 [2024-11-20 20:26:30.974987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:26.076 [2024-11-20 20:26:30.974991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:27.011 20:26:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:27.011 20:26:31 -- common/autotest_common.sh@862 -- # return 0 00:25:27.011 20:26:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:27.011 20:26:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:27.011 20:26:31 -- common/autotest_common.sh@10 -- # set +x 00:25:27.011 20:26:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:27.011 20:26:31 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:27.011 [2024-11-20 20:26:31.981829] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:27.011 20:26:32 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:27.269 Malloc0 00:25:27.269 20:26:32 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:27.527 20:26:32 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:27.786 20:26:32 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:28.044 [2024-11-20 20:26:33.022253] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.044 20:26:33 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:28.302 [2024-11-20 20:26:33.270926] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:28.302 20:26:33 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:28.561 [2024-11-20 20:26:33.543880] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:28.561 20:26:33 -- host/failover.sh@31 -- # bdevperf_pid=3256666 00:25:28.561 20:26:33 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:28.561 20:26:33 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:28.561 20:26:33 -- host/failover.sh@34 -- # waitforlisten 3256666 /var/tmp/bdevperf.sock 00:25:28.561 20:26:33 -- common/autotest_common.sh@829 -- # '[' -z 3256666 ']' 00:25:28.561 20:26:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:28.561 20:26:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:28.561 20:26:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:28.561 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:28.561 20:26:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:28.561 20:26:33 -- common/autotest_common.sh@10 -- # set +x 00:25:29.940 20:26:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:29.940 20:26:34 -- common/autotest_common.sh@862 -- # return 0 00:25:29.940 20:26:34 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:29.940 NVMe0n1 00:25:29.940 20:26:34 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.198 00:25:30.458 20:26:35 -- host/failover.sh@39 -- # run_test_pid=3256815 00:25:30.458 20:26:35 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:30.458 20:26:35 -- host/failover.sh@41 -- # sleep 1 00:25:31.394 20:26:36 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:31.653 [2024-11-20 20:26:36.480057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 [2024-11-20 20:26:36.480689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c06cb0 is same with the state(5) to be set 00:25:31.653 20:26:36 -- host/failover.sh@45 -- # sleep 3 00:25:34.942 20:26:39 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:34.942 00:25:34.942 20:26:39 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:35.206 [2024-11-20 20:26:40.166392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.166999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.206 [2024-11-20 20:26:40.167152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.207 [2024-11-20 20:26:40.167163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c083a0 is same with the state(5) to be set 00:25:35.207 20:26:40 -- host/failover.sh@50 -- # sleep 3 00:25:38.491 20:26:43 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:38.491 [2024-11-20 20:26:43.461302] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:38.491 20:26:43 -- host/failover.sh@55 -- # sleep 1 00:25:39.870 20:26:44 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:39.870 [2024-11-20 20:26:44.773111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 [2024-11-20 20:26:44.773952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c08a80 is same with the state(5) to be set 00:25:39.870 20:26:44 -- host/failover.sh@59 -- # wait 3256815 00:25:46.441 0 00:25:46.441 20:26:50 -- host/failover.sh@61 -- # killprocess 3256666 00:25:46.441 20:26:50 -- common/autotest_common.sh@936 -- # '[' -z 3256666 ']' 00:25:46.441 20:26:50 -- common/autotest_common.sh@940 -- # kill -0 3256666 00:25:46.441 20:26:50 -- common/autotest_common.sh@941 -- # uname 00:25:46.441 20:26:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:46.441 20:26:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3256666 00:25:46.441 20:26:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:46.441 20:26:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:46.441 20:26:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3256666' 00:25:46.441 killing process with pid 3256666 00:25:46.441 20:26:50 -- common/autotest_common.sh@955 -- # kill 3256666 00:25:46.441 20:26:50 -- common/autotest_common.sh@960 -- # wait 3256666 00:25:46.441 20:26:50 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:46.441 [2024-11-20 20:26:33.599186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:46.441 [2024-11-20 20:26:33.599290] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3256666 ] 00:25:46.441 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.441 [2024-11-20 20:26:33.660469] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:46.441 [2024-11-20 20:26:33.767335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:46.441 Running I/O for 15 seconds... 00:25:46.441 [2024-11-20 20:26:36.480972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:115824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:115832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.441 [2024-11-20 20:26:36.481559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:115840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.441 [2024-11-20 20:26:36.481618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:115848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.441 [2024-11-20 20:26:36.481681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:115856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.441 [2024-11-20 20:26:36.481729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:115864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:115872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.441 [2024-11-20 20:26:36.481840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.481966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.481989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.482013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.482037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.482062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.441 [2024-11-20 20:26:36.482110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.441 [2024-11-20 20:26:36.482136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:115320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:115880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.482727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:115896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.482825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.482926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:115920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.482975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.482999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:115928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:115944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:115968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:115976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:115992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:116008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:116024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:116032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:116040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:116064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.442 [2024-11-20 20:26:36.483920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.442 [2024-11-20 20:26:36.483968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.442 [2024-11-20 20:26:36.483994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:116072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.484424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:116088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.484522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:116112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.484669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:116136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.484816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:116152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.484920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.484968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.484992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:116176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.485065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:116192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.485191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:116200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.485242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:116216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.443 [2024-11-20 20:26:36.485343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.443 [2024-11-20 20:26:36.485853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.443 [2024-11-20 20:26:36.485880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:116240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.485903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.485930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:116248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.485952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.485978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:116272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:116280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:116296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:116304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:116312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:116328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:116336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:116344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:116368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:116384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:116400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.486942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.486966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.486990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.487039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.487117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:116432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.487168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.487219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.444 [2024-11-20 20:26:36.487269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.487321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.487370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.487434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.444 [2024-11-20 20:26:36.487482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.444 [2024-11-20 20:26:36.487512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:36.487537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.487561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:36.487585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.487610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:36.487633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.487656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d49730 is same with the state(5) to be set 00:25:46.445 [2024-11-20 20:26:36.487683] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:46.445 [2024-11-20 20:26:36.487702] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:46.445 [2024-11-20 20:26:36.487740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115808 len:8 PRP1 0x0 PRP2 0x0 00:25:46.445 [2024-11-20 20:26:36.487764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.487838] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d49730 was disconnected and freed. reset controller. 00:25:46.445 [2024-11-20 20:26:36.487873] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:46.445 [2024-11-20 20:26:36.487937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.445 [2024-11-20 20:26:36.487964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.487990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.445 [2024-11-20 20:26:36.488012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.488036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.445 [2024-11-20 20:26:36.488060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.488094] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.445 [2024-11-20 20:26:36.488120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:36.488142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:46.445 [2024-11-20 20:26:36.488220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2a870 (9): Bad file descriptor 00:25:46.445 [2024-11-20 20:26:36.491045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:46.445 [2024-11-20 20:26:36.604025] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:46.445 [2024-11-20 20:26:40.167287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:6392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:6408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.167972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.167997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.168025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.168051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.168097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.168126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.168149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.168177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:5856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.168201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.168228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.168251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.168277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.445 [2024-11-20 20:26:40.168300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.445 [2024-11-20 20:26:40.168327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:5912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:5920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:5944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:6480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.168966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.168995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:6536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:6632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.446 [2024-11-20 20:26:40.169587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.446 [2024-11-20 20:26:40.169754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.446 [2024-11-20 20:26:40.169777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.169801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:6048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.169840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.169866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.169889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.169913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.169936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.169959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.169988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:6696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.170227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:6728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.170453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.170501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:6744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.170550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:6752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.170600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:6160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:6192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.170957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.170982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:6800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:6808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:6816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:6824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:6832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:6840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:6848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:6856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.447 [2024-11-20 20:26:40.171722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.447 [2024-11-20 20:26:40.171748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:6864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.447 [2024-11-20 20:26:40.171771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.171797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.171820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.171847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:6880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.171869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.171897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:6888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.171920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.171946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.171969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:6920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:6928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.172210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:6272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:6296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:6312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:6432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:6440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.172954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:6488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.172977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:6936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.173096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.173151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:6952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:6960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:6968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.173300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:7000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:7008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.448 [2024-11-20 20:26:40.173573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:7016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.448 [2024-11-20 20:26:40.173648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:6520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.448 [2024-11-20 20:26:40.173672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:6584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:40.173721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:6600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:40.173770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:40.173828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:6616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:40.173876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:6640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:40.173923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:40.173971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.173996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36d10 is same with the state(5) to be set 00:25:46.449 [2024-11-20 20:26:40.174028] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:46.449 [2024-11-20 20:26:40.174063] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:46.449 [2024-11-20 20:26:40.174091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6656 len:8 PRP1 0x0 PRP2 0x0 00:25:46.449 [2024-11-20 20:26:40.174115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.174200] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d36d10 was disconnected and freed. reset controller. 00:25:46.449 [2024-11-20 20:26:40.174228] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:46.449 [2024-11-20 20:26:40.174278] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.449 [2024-11-20 20:26:40.174306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.174330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.449 [2024-11-20 20:26:40.174354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.174376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.449 [2024-11-20 20:26:40.174400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.174430] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.449 [2024-11-20 20:26:40.174454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:40.174478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:46.449 [2024-11-20 20:26:40.174528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2a870 (9): Bad file descriptor 00:25:46.449 [2024-11-20 20:26:40.177294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:46.449 [2024-11-20 20:26:40.324572] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:46.449 [2024-11-20 20:26:44.774138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:9400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:9416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:9432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:9448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:9496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:9976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:9992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:10000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:10024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:10040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.774955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.774979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.775003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.775028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.775066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.775108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:9584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.775149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.449 [2024-11-20 20:26:44.775175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.449 [2024-11-20 20:26:44.775201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:9632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:10080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:10120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:10128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:10160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.775715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:10168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:10176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.775824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:10184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:10192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.775928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.775965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:10200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.775987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.776035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:10216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:9664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:9696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:9712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:10224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.450 [2024-11-20 20:26:44.776616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:10240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.776666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:10248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.776714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:10256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.776763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:10264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.776822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.450 [2024-11-20 20:26:44.776870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.450 [2024-11-20 20:26:44.776894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:10280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.776918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.776942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.776965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.776989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:10296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:10304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:10312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:10320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:10328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:10344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:10352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:10360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:9752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:9800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:9856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:9904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:10368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.777900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:10376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.777972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:10384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.777996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.778036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:10392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.778059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.778112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.778137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.778164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.451 [2024-11-20 20:26:44.778189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.778217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:10416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.451 [2024-11-20 20:26:44.778240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.451 [2024-11-20 20:26:44.778267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.778291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:10432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.778344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:10440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:9952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:9968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.778868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:10456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.778927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.778955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:10464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.778978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:10512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:10536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:10544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:10560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:10568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:10576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:10584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:10592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:10600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.452 [2024-11-20 20:26:44.779911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:10608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.452 [2024-11-20 20:26:44.779960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.452 [2024-11-20 20:26:44.779984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:10616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:10624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:10632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:10640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.453 [2024-11-20 20:26:44.780199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:10648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:10656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.453 [2024-11-20 20:26:44.780299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:10664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.453 [2024-11-20 20:26:44.780350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:10672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.453 [2024-11-20 20:26:44.780415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:10680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.453 [2024-11-20 20:26:44.780463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:10688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:10696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:10048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:10064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:10088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:10096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:10104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.453 [2024-11-20 20:26:44.780916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.780940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4b680 is same with the state(5) to be set 00:25:46.453 [2024-11-20 20:26:44.780966] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:46.453 [2024-11-20 20:26:44.780985] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:46.453 [2024-11-20 20:26:44.781003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10136 len:8 PRP1 0x0 PRP2 0x0 00:25:46.453 [2024-11-20 20:26:44.781025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.781129] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d4b680 was disconnected and freed. reset controller. 00:25:46.453 [2024-11-20 20:26:44.781159] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:46.453 [2024-11-20 20:26:44.781209] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.453 [2024-11-20 20:26:44.781238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.781269] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.453 [2024-11-20 20:26:44.781294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.781318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.453 [2024-11-20 20:26:44.781341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.781365] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.453 [2024-11-20 20:26:44.781387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.453 [2024-11-20 20:26:44.781411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:46.453 [2024-11-20 20:26:44.781479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2a870 (9): Bad file descriptor 00:25:46.453 [2024-11-20 20:26:44.784196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:46.453 [2024-11-20 20:26:44.818148] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:46.453 00:25:46.453 Latency(us) 00:25:46.453 [2024-11-20T19:26:51.492Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.453 [2024-11-20T19:26:51.492Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:46.453 Verification LBA range: start 0x0 length 0x4000 00:25:46.453 NVMe0n1 : 15.01 12603.20 49.23 1112.35 0.00 9315.63 643.22 17573.36 00:25:46.453 [2024-11-20T19:26:51.492Z] =================================================================================================================== 00:25:46.453 [2024-11-20T19:26:51.492Z] Total : 12603.20 49.23 1112.35 0.00 9315.63 643.22 17573.36 00:25:46.453 Received shutdown signal, test time was about 15.000000 seconds 00:25:46.453 00:25:46.453 Latency(us) 00:25:46.453 [2024-11-20T19:26:51.492Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.453 [2024-11-20T19:26:51.492Z] =================================================================================================================== 00:25:46.453 [2024-11-20T19:26:51.492Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:46.453 20:26:50 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:46.453 20:26:50 -- host/failover.sh@65 -- # count=3 00:25:46.453 20:26:50 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:46.453 20:26:50 -- host/failover.sh@73 -- # bdevperf_pid=3258714 00:25:46.453 20:26:50 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:46.453 20:26:50 -- host/failover.sh@75 -- # waitforlisten 3258714 /var/tmp/bdevperf.sock 00:25:46.453 20:26:50 -- common/autotest_common.sh@829 -- # '[' -z 3258714 ']' 00:25:46.453 20:26:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:46.453 20:26:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.454 20:26:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:46.454 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:46.454 20:26:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.454 20:26:50 -- common/autotest_common.sh@10 -- # set +x 00:25:46.742 20:26:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.742 20:26:51 -- common/autotest_common.sh@862 -- # return 0 00:25:46.742 20:26:51 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:47.026 [2024-11-20 20:26:51.953397] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:47.026 20:26:51 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:47.284 [2024-11-20 20:26:52.206049] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:47.284 20:26:52 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:47.851 NVMe0n1 00:25:47.851 20:26:52 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.109 00:25:48.109 20:26:53 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.677 00:25:48.677 20:26:53 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:48.677 20:26:53 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:48.935 20:26:53 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.193 20:26:54 -- host/failover.sh@87 -- # sleep 3 00:25:52.486 20:26:57 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:52.486 20:26:57 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:52.486 20:26:57 -- host/failover.sh@90 -- # run_test_pid=3259534 00:25:52.486 20:26:57 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:52.486 20:26:57 -- host/failover.sh@92 -- # wait 3259534 00:25:53.864 0 00:25:53.864 20:26:58 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:53.864 [2024-11-20 20:26:50.737689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:53.864 [2024-11-20 20:26:50.737771] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3258714 ] 00:25:53.864 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.864 [2024-11-20 20:26:50.796493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:53.864 [2024-11-20 20:26:50.901630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:53.864 [2024-11-20 20:26:54.029800] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:53.864 [2024-11-20 20:26:54.029883] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.864 [2024-11-20 20:26:54.029913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.864 [2024-11-20 20:26:54.029951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.864 [2024-11-20 20:26:54.029973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.864 [2024-11-20 20:26:54.029996] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.864 [2024-11-20 20:26:54.030019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.864 [2024-11-20 20:26:54.030042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:53.864 [2024-11-20 20:26:54.030065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:53.864 [2024-11-20 20:26:54.030097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:53.864 [2024-11-20 20:26:54.030150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:53.864 [2024-11-20 20:26:54.030192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x159f870 (9): Bad file descriptor 00:25:53.864 [2024-11-20 20:26:54.040626] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:53.864 Running I/O for 1 seconds... 00:25:53.864 00:25:53.864 Latency(us) 00:25:53.864 [2024-11-20T19:26:58.903Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:53.864 [2024-11-20T19:26:58.903Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:53.864 Verification LBA range: start 0x0 length 0x4000 00:25:53.864 NVMe0n1 : 1.01 12837.56 50.15 0.00 0.00 9920.92 1614.13 15631.55 00:25:53.864 [2024-11-20T19:26:58.903Z] =================================================================================================================== 00:25:53.864 [2024-11-20T19:26:58.903Z] Total : 12837.56 50.15 0.00 0.00 9920.92 1614.13 15631.55 00:25:53.864 20:26:58 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:53.864 20:26:58 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:53.864 20:26:58 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.122 20:26:59 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.122 20:26:59 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:54.384 20:26:59 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.645 20:26:59 -- host/failover.sh@101 -- # sleep 3 00:25:57.930 20:27:02 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:57.930 20:27:02 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:57.930 20:27:02 -- host/failover.sh@108 -- # killprocess 3258714 00:25:57.930 20:27:02 -- common/autotest_common.sh@936 -- # '[' -z 3258714 ']' 00:25:57.930 20:27:02 -- common/autotest_common.sh@940 -- # kill -0 3258714 00:25:57.930 20:27:02 -- common/autotest_common.sh@941 -- # uname 00:25:57.930 20:27:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:57.930 20:27:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3258714 00:25:57.930 20:27:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:57.930 20:27:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:57.930 20:27:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3258714' 00:25:57.930 killing process with pid 3258714 00:25:57.930 20:27:02 -- common/autotest_common.sh@955 -- # kill 3258714 00:25:57.930 20:27:02 -- common/autotest_common.sh@960 -- # wait 3258714 00:25:58.188 20:27:03 -- host/failover.sh@110 -- # sync 00:25:58.188 20:27:03 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:58.446 20:27:03 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:58.446 20:27:03 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:58.446 20:27:03 -- host/failover.sh@116 -- # nvmftestfini 00:25:58.446 20:27:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:58.446 20:27:03 -- nvmf/common.sh@116 -- # sync 00:25:58.446 20:27:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:58.446 20:27:03 -- nvmf/common.sh@119 -- # set +e 00:25:58.446 20:27:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:58.446 20:27:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:58.446 rmmod nvme_tcp 00:25:58.446 rmmod nvme_fabrics 00:25:58.705 rmmod nvme_keyring 00:25:58.705 20:27:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:58.705 20:27:03 -- nvmf/common.sh@123 -- # set -e 00:25:58.705 20:27:03 -- nvmf/common.sh@124 -- # return 0 00:25:58.705 20:27:03 -- nvmf/common.sh@477 -- # '[' -n 3256239 ']' 00:25:58.705 20:27:03 -- nvmf/common.sh@478 -- # killprocess 3256239 00:25:58.705 20:27:03 -- common/autotest_common.sh@936 -- # '[' -z 3256239 ']' 00:25:58.705 20:27:03 -- common/autotest_common.sh@940 -- # kill -0 3256239 00:25:58.705 20:27:03 -- common/autotest_common.sh@941 -- # uname 00:25:58.705 20:27:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.705 20:27:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3256239 00:25:58.705 20:27:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:58.705 20:27:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:58.705 20:27:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3256239' 00:25:58.705 killing process with pid 3256239 00:25:58.705 20:27:03 -- common/autotest_common.sh@955 -- # kill 3256239 00:25:58.705 20:27:03 -- common/autotest_common.sh@960 -- # wait 3256239 00:25:58.965 20:27:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:58.965 20:27:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:58.965 20:27:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:58.965 20:27:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:58.965 20:27:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:58.965 20:27:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.965 20:27:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.965 20:27:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.872 20:27:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:00.872 00:26:00.872 real 0m37.470s 00:26:00.872 user 2m12.293s 00:26:00.872 sys 0m6.278s 00:26:00.872 20:27:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:00.872 20:27:05 -- common/autotest_common.sh@10 -- # set +x 00:26:00.872 ************************************ 00:26:00.872 END TEST nvmf_failover 00:26:00.872 ************************************ 00:26:00.872 20:27:05 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:00.872 20:27:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:00.872 20:27:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:00.872 20:27:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.131 ************************************ 00:26:01.132 START TEST nvmf_discovery 00:26:01.132 ************************************ 00:26:01.132 20:27:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:01.132 * Looking for test storage... 00:26:01.132 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:01.132 20:27:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:01.132 20:27:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:01.132 20:27:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:01.132 20:27:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:01.132 20:27:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:01.132 20:27:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:01.132 20:27:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:01.132 20:27:06 -- scripts/common.sh@335 -- # IFS=.-: 00:26:01.132 20:27:06 -- scripts/common.sh@335 -- # read -ra ver1 00:26:01.132 20:27:06 -- scripts/common.sh@336 -- # IFS=.-: 00:26:01.132 20:27:06 -- scripts/common.sh@336 -- # read -ra ver2 00:26:01.132 20:27:06 -- scripts/common.sh@337 -- # local 'op=<' 00:26:01.132 20:27:06 -- scripts/common.sh@339 -- # ver1_l=2 00:26:01.132 20:27:06 -- scripts/common.sh@340 -- # ver2_l=1 00:26:01.132 20:27:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:01.132 20:27:06 -- scripts/common.sh@343 -- # case "$op" in 00:26:01.132 20:27:06 -- scripts/common.sh@344 -- # : 1 00:26:01.132 20:27:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:01.132 20:27:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:01.132 20:27:06 -- scripts/common.sh@364 -- # decimal 1 00:26:01.132 20:27:06 -- scripts/common.sh@352 -- # local d=1 00:26:01.132 20:27:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:01.132 20:27:06 -- scripts/common.sh@354 -- # echo 1 00:26:01.132 20:27:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:01.132 20:27:06 -- scripts/common.sh@365 -- # decimal 2 00:26:01.132 20:27:06 -- scripts/common.sh@352 -- # local d=2 00:26:01.132 20:27:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:01.132 20:27:06 -- scripts/common.sh@354 -- # echo 2 00:26:01.132 20:27:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:01.132 20:27:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:01.132 20:27:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:01.132 20:27:06 -- scripts/common.sh@367 -- # return 0 00:26:01.132 20:27:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:01.132 20:27:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:01.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.132 --rc genhtml_branch_coverage=1 00:26:01.132 --rc genhtml_function_coverage=1 00:26:01.132 --rc genhtml_legend=1 00:26:01.132 --rc geninfo_all_blocks=1 00:26:01.132 --rc geninfo_unexecuted_blocks=1 00:26:01.132 00:26:01.132 ' 00:26:01.132 20:27:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:01.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.132 --rc genhtml_branch_coverage=1 00:26:01.132 --rc genhtml_function_coverage=1 00:26:01.132 --rc genhtml_legend=1 00:26:01.132 --rc geninfo_all_blocks=1 00:26:01.132 --rc geninfo_unexecuted_blocks=1 00:26:01.132 00:26:01.132 ' 00:26:01.132 20:27:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:01.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.132 --rc genhtml_branch_coverage=1 00:26:01.132 --rc genhtml_function_coverage=1 00:26:01.132 --rc genhtml_legend=1 00:26:01.132 --rc geninfo_all_blocks=1 00:26:01.132 --rc geninfo_unexecuted_blocks=1 00:26:01.132 00:26:01.132 ' 00:26:01.132 20:27:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:01.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.132 --rc genhtml_branch_coverage=1 00:26:01.132 --rc genhtml_function_coverage=1 00:26:01.132 --rc genhtml_legend=1 00:26:01.132 --rc geninfo_all_blocks=1 00:26:01.132 --rc geninfo_unexecuted_blocks=1 00:26:01.132 00:26:01.132 ' 00:26:01.132 20:27:06 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:01.132 20:27:06 -- nvmf/common.sh@7 -- # uname -s 00:26:01.132 20:27:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:01.132 20:27:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:01.132 20:27:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:01.132 20:27:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:01.132 20:27:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:01.132 20:27:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:01.132 20:27:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:01.132 20:27:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:01.132 20:27:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:01.132 20:27:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:01.132 20:27:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.132 20:27:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.132 20:27:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:01.132 20:27:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:01.132 20:27:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:01.132 20:27:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:01.132 20:27:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:01.132 20:27:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:01.132 20:27:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:01.132 20:27:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.132 20:27:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.132 20:27:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.132 20:27:06 -- paths/export.sh@5 -- # export PATH 00:26:01.132 20:27:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.132 20:27:06 -- nvmf/common.sh@46 -- # : 0 00:26:01.132 20:27:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:01.132 20:27:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:01.132 20:27:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:01.132 20:27:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:01.132 20:27:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:01.132 20:27:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:01.132 20:27:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:01.132 20:27:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:01.132 20:27:06 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:01.132 20:27:06 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:01.132 20:27:06 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:01.132 20:27:06 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:01.132 20:27:06 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:01.132 20:27:06 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:01.132 20:27:06 -- host/discovery.sh@25 -- # nvmftestinit 00:26:01.132 20:27:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:01.132 20:27:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:01.132 20:27:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:01.132 20:27:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:01.132 20:27:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:01.132 20:27:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.132 20:27:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.132 20:27:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.132 20:27:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:01.132 20:27:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:01.132 20:27:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:01.132 20:27:06 -- common/autotest_common.sh@10 -- # set +x 00:26:03.034 20:27:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:03.034 20:27:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:03.034 20:27:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:03.034 20:27:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:03.034 20:27:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:03.034 20:27:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:03.034 20:27:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:03.034 20:27:08 -- nvmf/common.sh@294 -- # net_devs=() 00:26:03.034 20:27:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:03.034 20:27:08 -- nvmf/common.sh@295 -- # e810=() 00:26:03.034 20:27:08 -- nvmf/common.sh@295 -- # local -ga e810 00:26:03.034 20:27:08 -- nvmf/common.sh@296 -- # x722=() 00:26:03.034 20:27:08 -- nvmf/common.sh@296 -- # local -ga x722 00:26:03.034 20:27:08 -- nvmf/common.sh@297 -- # mlx=() 00:26:03.034 20:27:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:03.034 20:27:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:03.034 20:27:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:03.034 20:27:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:03.034 20:27:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:03.034 20:27:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.034 20:27:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:03.034 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:03.034 20:27:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.034 20:27:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:03.034 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:03.034 20:27:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:03.034 20:27:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.034 20:27:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.034 20:27:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.034 20:27:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.034 20:27:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:03.034 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:03.034 20:27:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.034 20:27:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.034 20:27:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.034 20:27:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.034 20:27:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.034 20:27:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:03.034 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:03.034 20:27:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.034 20:27:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:03.034 20:27:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:03.034 20:27:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:03.034 20:27:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:03.034 20:27:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:03.034 20:27:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:03.034 20:27:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:03.034 20:27:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:03.034 20:27:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:03.034 20:27:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:03.034 20:27:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:03.034 20:27:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:03.034 20:27:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:03.034 20:27:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:03.034 20:27:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:03.034 20:27:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:03.034 20:27:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:03.293 20:27:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:03.293 20:27:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:03.293 20:27:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:03.293 20:27:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:03.293 20:27:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:03.293 20:27:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:03.293 20:27:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:03.293 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:03.293 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:26:03.293 00:26:03.293 --- 10.0.0.2 ping statistics --- 00:26:03.293 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.293 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:26:03.293 20:27:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:03.293 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:03.293 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:26:03.293 00:26:03.293 --- 10.0.0.1 ping statistics --- 00:26:03.293 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.293 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:26:03.293 20:27:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:03.293 20:27:08 -- nvmf/common.sh@410 -- # return 0 00:26:03.293 20:27:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:03.293 20:27:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:03.293 20:27:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:03.293 20:27:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:03.293 20:27:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:03.293 20:27:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:03.293 20:27:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:03.293 20:27:08 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:03.293 20:27:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:03.293 20:27:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:03.293 20:27:08 -- common/autotest_common.sh@10 -- # set +x 00:26:03.293 20:27:08 -- nvmf/common.sh@469 -- # nvmfpid=3262649 00:26:03.293 20:27:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:03.293 20:27:08 -- nvmf/common.sh@470 -- # waitforlisten 3262649 00:26:03.293 20:27:08 -- common/autotest_common.sh@829 -- # '[' -z 3262649 ']' 00:26:03.293 20:27:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:03.293 20:27:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:03.293 20:27:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:03.293 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:03.293 20:27:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:03.293 20:27:08 -- common/autotest_common.sh@10 -- # set +x 00:26:03.293 [2024-11-20 20:27:08.217182] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.293 [2024-11-20 20:27:08.217265] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:03.293 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.293 [2024-11-20 20:27:08.281510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:03.552 [2024-11-20 20:27:08.395279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:03.552 [2024-11-20 20:27:08.395425] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:03.552 [2024-11-20 20:27:08.395462] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:03.552 [2024-11-20 20:27:08.395483] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:03.552 [2024-11-20 20:27:08.395520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:04.485 20:27:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.485 20:27:09 -- common/autotest_common.sh@862 -- # return 0 00:26:04.485 20:27:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:04.485 20:27:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:04.485 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.485 20:27:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:04.485 20:27:09 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:04.485 20:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.485 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.485 [2024-11-20 20:27:09.215605] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:04.485 20:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.485 20:27:09 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:04.485 20:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.485 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.485 [2024-11-20 20:27:09.223824] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:04.485 20:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.485 20:27:09 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:04.485 20:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.485 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.485 null0 00:26:04.485 20:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.485 20:27:09 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:04.485 20:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.485 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.485 null1 00:26:04.485 20:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.485 20:27:09 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:04.485 20:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.485 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.485 20:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.485 20:27:09 -- host/discovery.sh@45 -- # hostpid=3262950 00:26:04.485 20:27:09 -- host/discovery.sh@46 -- # waitforlisten 3262950 /tmp/host.sock 00:26:04.485 20:27:09 -- common/autotest_common.sh@829 -- # '[' -z 3262950 ']' 00:26:04.485 20:27:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:04.485 20:27:09 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:04.485 20:27:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:04.486 20:27:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:04.486 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:04.486 20:27:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:04.486 20:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:04.486 [2024-11-20 20:27:09.292642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:04.486 [2024-11-20 20:27:09.292713] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3262950 ] 00:26:04.486 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.486 [2024-11-20 20:27:09.354394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:04.486 [2024-11-20 20:27:09.467400] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:04.486 [2024-11-20 20:27:09.467573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:05.422 20:27:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:05.422 20:27:10 -- common/autotest_common.sh@862 -- # return 0 00:26:05.422 20:27:10 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:05.422 20:27:10 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.422 20:27:10 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.422 20:27:10 -- host/discovery.sh@72 -- # notify_id=0 00:26:05.422 20:27:10 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # sort 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # xargs 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.422 20:27:10 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:05.422 20:27:10 -- host/discovery.sh@79 -- # get_bdev_list 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # sort 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # xargs 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.422 20:27:10 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:05.422 20:27:10 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.422 20:27:10 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # sort 00:26:05.422 20:27:10 -- host/discovery.sh@59 -- # xargs 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.422 20:27:10 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:05.422 20:27:10 -- host/discovery.sh@83 -- # get_bdev_list 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.422 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:05.422 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # sort 00:26:05.422 20:27:10 -- host/discovery.sh@55 -- # xargs 00:26:05.422 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:05.681 20:27:10 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # sort 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # xargs 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:05.681 20:27:10 -- host/discovery.sh@87 -- # get_bdev_list 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # sort 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # xargs 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:05.681 20:27:10 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 [2024-11-20 20:27:10.563569] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # sort 00:26:05.681 20:27:10 -- host/discovery.sh@59 -- # xargs 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:05.681 20:27:10 -- host/discovery.sh@93 -- # get_bdev_list 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # sort 00:26:05.681 20:27:10 -- host/discovery.sh@55 -- # xargs 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:05.681 20:27:10 -- host/discovery.sh@94 -- # get_notification_count 00:26:05.681 20:27:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:05.681 20:27:10 -- host/discovery.sh@74 -- # jq '. | length' 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@74 -- # notification_count=0 00:26:05.681 20:27:10 -- host/discovery.sh@75 -- # notify_id=0 00:26:05.681 20:27:10 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:05.681 20:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.681 20:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:05.681 20:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.681 20:27:10 -- host/discovery.sh@100 -- # sleep 1 00:26:06.622 [2024-11-20 20:27:11.355821] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:06.622 [2024-11-20 20:27:11.355859] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:06.622 [2024-11-20 20:27:11.355892] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:06.622 [2024-11-20 20:27:11.486390] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:06.622 [2024-11-20 20:27:11.628519] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:06.622 [2024-11-20 20:27:11.628545] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:06.881 20:27:11 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:06.881 20:27:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:06.881 20:27:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:06.881 20:27:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.881 20:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:06.881 20:27:11 -- host/discovery.sh@59 -- # sort 00:26:06.881 20:27:11 -- host/discovery.sh@59 -- # xargs 00:26:06.881 20:27:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@102 -- # get_bdev_list 00:26:06.881 20:27:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.881 20:27:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.881 20:27:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.881 20:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:06.881 20:27:11 -- host/discovery.sh@55 -- # sort 00:26:06.881 20:27:11 -- host/discovery.sh@55 -- # xargs 00:26:06.881 20:27:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:06.881 20:27:11 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:06.881 20:27:11 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:06.881 20:27:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.881 20:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:06.881 20:27:11 -- host/discovery.sh@63 -- # sort -n 00:26:06.881 20:27:11 -- host/discovery.sh@63 -- # xargs 00:26:06.881 20:27:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@104 -- # get_notification_count 00:26:06.881 20:27:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:06.881 20:27:11 -- host/discovery.sh@74 -- # jq '. | length' 00:26:06.881 20:27:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.881 20:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:06.881 20:27:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@74 -- # notification_count=1 00:26:06.881 20:27:11 -- host/discovery.sh@75 -- # notify_id=1 00:26:06.881 20:27:11 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:06.881 20:27:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.881 20:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:06.881 20:27:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.881 20:27:11 -- host/discovery.sh@109 -- # sleep 1 00:26:08.341 20:27:12 -- host/discovery.sh@110 -- # get_bdev_list 00:26:08.341 20:27:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.341 20:27:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.341 20:27:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:08.341 20:27:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.341 20:27:12 -- host/discovery.sh@55 -- # sort 00:26:08.341 20:27:12 -- host/discovery.sh@55 -- # xargs 00:26:08.341 20:27:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.341 20:27:12 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:08.341 20:27:12 -- host/discovery.sh@111 -- # get_notification_count 00:26:08.341 20:27:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:08.341 20:27:12 -- host/discovery.sh@74 -- # jq '. | length' 00:26:08.341 20:27:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.341 20:27:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.341 20:27:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.341 20:27:12 -- host/discovery.sh@74 -- # notification_count=1 00:26:08.341 20:27:12 -- host/discovery.sh@75 -- # notify_id=2 00:26:08.341 20:27:12 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:08.341 20:27:12 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:08.341 20:27:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.341 20:27:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.341 [2024-11-20 20:27:12.954638] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:08.341 [2024-11-20 20:27:12.954939] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:08.341 [2024-11-20 20:27:12.954997] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:08.341 20:27:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.341 20:27:12 -- host/discovery.sh@117 -- # sleep 1 00:26:08.341 [2024-11-20 20:27:13.083404] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:08.341 [2024-11-20 20:27:13.180989] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:08.341 [2024-11-20 20:27:13.181014] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:08.341 [2024-11-20 20:27:13.181024] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:09.274 20:27:13 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:09.274 20:27:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:09.274 20:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.274 20:27:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:09.274 20:27:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.274 20:27:13 -- host/discovery.sh@59 -- # sort 00:26:09.274 20:27:13 -- host/discovery.sh@59 -- # xargs 00:26:09.274 20:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.274 20:27:13 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@119 -- # get_bdev_list 00:26:09.274 20:27:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.274 20:27:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:09.274 20:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.274 20:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:09.274 20:27:14 -- host/discovery.sh@55 -- # sort 00:26:09.274 20:27:14 -- host/discovery.sh@55 -- # xargs 00:26:09.274 20:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:09.274 20:27:14 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:09.274 20:27:14 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:09.274 20:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.274 20:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:09.274 20:27:14 -- host/discovery.sh@63 -- # sort -n 00:26:09.274 20:27:14 -- host/discovery.sh@63 -- # xargs 00:26:09.274 20:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@121 -- # get_notification_count 00:26:09.274 20:27:14 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:09.274 20:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.274 20:27:14 -- host/discovery.sh@74 -- # jq '. | length' 00:26:09.274 20:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:09.274 20:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@74 -- # notification_count=0 00:26:09.274 20:27:14 -- host/discovery.sh@75 -- # notify_id=2 00:26:09.274 20:27:14 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:09.274 20:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.274 20:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:09.274 [2024-11-20 20:27:14.122263] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:09.274 [2024-11-20 20:27:14.122298] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:09.274 20:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.274 20:27:14 -- host/discovery.sh@127 -- # sleep 1 00:26:09.274 [2024-11-20 20:27:14.131657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.274 [2024-11-20 20:27:14.131696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.274 [2024-11-20 20:27:14.131724] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.274 [2024-11-20 20:27:14.131761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.274 [2024-11-20 20:27:14.131788] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.274 [2024-11-20 20:27:14.131813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.274 [2024-11-20 20:27:14.131841] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.274 [2024-11-20 20:27:14.131867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.274 [2024-11-20 20:27:14.131892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.141661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.151708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.275 [2024-11-20 20:27:14.151945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.152133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.152165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x649810 with addr=10.0.0.2, port=4420 00:26:09.275 [2024-11-20 20:27:14.152193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.152229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.152265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.275 [2024-11-20 20:27:14.152289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.275 [2024-11-20 20:27:14.152314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.275 [2024-11-20 20:27:14.152346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.275 [2024-11-20 20:27:14.161799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.275 [2024-11-20 20:27:14.162001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.162186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.162217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x649810 with addr=10.0.0.2, port=4420 00:26:09.275 [2024-11-20 20:27:14.162244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.162279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.162313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.275 [2024-11-20 20:27:14.162335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.275 [2024-11-20 20:27:14.162374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.275 [2024-11-20 20:27:14.162408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.275 [2024-11-20 20:27:14.171883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.275 [2024-11-20 20:27:14.172125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.172277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.172307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x649810 with addr=10.0.0.2, port=4420 00:26:09.275 [2024-11-20 20:27:14.172335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.172373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.172406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.275 [2024-11-20 20:27:14.172436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.275 [2024-11-20 20:27:14.172458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.275 [2024-11-20 20:27:14.172488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.275 [2024-11-20 20:27:14.181968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.275 [2024-11-20 20:27:14.182181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.182325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.182355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x649810 with addr=10.0.0.2, port=4420 00:26:09.275 [2024-11-20 20:27:14.182381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.182414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.182447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.275 [2024-11-20 20:27:14.182469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.275 [2024-11-20 20:27:14.182492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.275 [2024-11-20 20:27:14.182522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.275 [2024-11-20 20:27:14.192042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.275 [2024-11-20 20:27:14.192283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.192431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.192464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x649810 with addr=10.0.0.2, port=4420 00:26:09.275 [2024-11-20 20:27:14.192494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.192532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.192569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.275 [2024-11-20 20:27:14.192594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.275 [2024-11-20 20:27:14.192619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.275 [2024-11-20 20:27:14.192673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.275 [2024-11-20 20:27:14.202132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.275 [2024-11-20 20:27:14.202291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.202490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.275 [2024-11-20 20:27:14.202523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x649810 with addr=10.0.0.2, port=4420 00:26:09.275 [2024-11-20 20:27:14.202560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x649810 is same with the state(5) to be set 00:26:09.275 [2024-11-20 20:27:14.202598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x649810 (9): Bad file descriptor 00:26:09.275 [2024-11-20 20:27:14.202635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.275 [2024-11-20 20:27:14.202660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.275 [2024-11-20 20:27:14.202686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.275 [2024-11-20 20:27:14.202740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.275 [2024-11-20 20:27:14.208689] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:09.275 [2024-11-20 20:27:14.208721] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:10.212 20:27:15 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:10.212 20:27:15 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:10.212 20:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.212 20:27:15 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:10.212 20:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:10.212 20:27:15 -- host/discovery.sh@59 -- # sort 00:26:10.212 20:27:15 -- host/discovery.sh@59 -- # xargs 00:26:10.212 20:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.212 20:27:15 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:10.212 20:27:15 -- host/discovery.sh@129 -- # get_bdev_list 00:26:10.212 20:27:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.212 20:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.212 20:27:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:10.212 20:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:10.212 20:27:15 -- host/discovery.sh@55 -- # sort 00:26:10.212 20:27:15 -- host/discovery.sh@55 -- # xargs 00:26:10.212 20:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.212 20:27:15 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:10.212 20:27:15 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:10.212 20:27:15 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:10.212 20:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.212 20:27:15 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:10.212 20:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:10.212 20:27:15 -- host/discovery.sh@63 -- # sort -n 00:26:10.212 20:27:15 -- host/discovery.sh@63 -- # xargs 00:26:10.212 20:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.470 20:27:15 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:10.470 20:27:15 -- host/discovery.sh@131 -- # get_notification_count 00:26:10.470 20:27:15 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:10.470 20:27:15 -- host/discovery.sh@74 -- # jq '. | length' 00:26:10.470 20:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.470 20:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:10.470 20:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.470 20:27:15 -- host/discovery.sh@74 -- # notification_count=0 00:26:10.470 20:27:15 -- host/discovery.sh@75 -- # notify_id=2 00:26:10.470 20:27:15 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:10.470 20:27:15 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:10.470 20:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.470 20:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:10.470 20:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.470 20:27:15 -- host/discovery.sh@135 -- # sleep 1 00:26:11.404 20:27:16 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:11.404 20:27:16 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.404 20:27:16 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.404 20:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.404 20:27:16 -- common/autotest_common.sh@10 -- # set +x 00:26:11.404 20:27:16 -- host/discovery.sh@59 -- # sort 00:26:11.404 20:27:16 -- host/discovery.sh@59 -- # xargs 00:26:11.404 20:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.404 20:27:16 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:11.404 20:27:16 -- host/discovery.sh@137 -- # get_bdev_list 00:26:11.404 20:27:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.404 20:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.404 20:27:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.404 20:27:16 -- common/autotest_common.sh@10 -- # set +x 00:26:11.404 20:27:16 -- host/discovery.sh@55 -- # sort 00:26:11.404 20:27:16 -- host/discovery.sh@55 -- # xargs 00:26:11.404 20:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.404 20:27:16 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:11.404 20:27:16 -- host/discovery.sh@138 -- # get_notification_count 00:26:11.404 20:27:16 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:11.404 20:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.404 20:27:16 -- host/discovery.sh@74 -- # jq '. | length' 00:26:11.404 20:27:16 -- common/autotest_common.sh@10 -- # set +x 00:26:11.404 20:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.404 20:27:16 -- host/discovery.sh@74 -- # notification_count=2 00:26:11.404 20:27:16 -- host/discovery.sh@75 -- # notify_id=4 00:26:11.404 20:27:16 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:11.404 20:27:16 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:11.404 20:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.404 20:27:16 -- common/autotest_common.sh@10 -- # set +x 00:26:12.782 [2024-11-20 20:27:17.490757] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:12.782 [2024-11-20 20:27:17.490783] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:12.782 [2024-11-20 20:27:17.490808] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:12.782 [2024-11-20 20:27:17.618228] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:13.040 [2024-11-20 20:27:17.886996] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:13.040 [2024-11-20 20:27:17.887035] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:13.040 20:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.040 20:27:17 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.040 20:27:17 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.040 20:27:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.040 20:27:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.040 20:27:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.040 20:27:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.040 20:27:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.040 20:27:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.040 20:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.040 20:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.041 request: 00:26:13.041 { 00:26:13.041 "name": "nvme", 00:26:13.041 "trtype": "tcp", 00:26:13.041 "traddr": "10.0.0.2", 00:26:13.041 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:13.041 "adrfam": "ipv4", 00:26:13.041 "trsvcid": "8009", 00:26:13.041 "wait_for_attach": true, 00:26:13.041 "method": "bdev_nvme_start_discovery", 00:26:13.041 "req_id": 1 00:26:13.041 } 00:26:13.041 Got JSON-RPC error response 00:26:13.041 response: 00:26:13.041 { 00:26:13.041 "code": -17, 00:26:13.041 "message": "File exists" 00:26:13.041 } 00:26:13.041 20:27:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:13.041 20:27:17 -- common/autotest_common.sh@653 -- # es=1 00:26:13.041 20:27:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:13.041 20:27:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:13.041 20:27:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:13.041 20:27:17 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:13.041 20:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:13.041 20:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # sort 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # xargs 00:26:13.041 20:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.041 20:27:17 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:13.041 20:27:17 -- host/discovery.sh@147 -- # get_bdev_list 00:26:13.041 20:27:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.041 20:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.041 20:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.041 20:27:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.041 20:27:17 -- host/discovery.sh@55 -- # sort 00:26:13.041 20:27:17 -- host/discovery.sh@55 -- # xargs 00:26:13.041 20:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.041 20:27:17 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:13.041 20:27:17 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.041 20:27:17 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.041 20:27:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.041 20:27:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.041 20:27:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.041 20:27:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.041 20:27:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.041 20:27:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.041 20:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.041 20:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.041 request: 00:26:13.041 { 00:26:13.041 "name": "nvme_second", 00:26:13.041 "trtype": "tcp", 00:26:13.041 "traddr": "10.0.0.2", 00:26:13.041 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:13.041 "adrfam": "ipv4", 00:26:13.041 "trsvcid": "8009", 00:26:13.041 "wait_for_attach": true, 00:26:13.041 "method": "bdev_nvme_start_discovery", 00:26:13.041 "req_id": 1 00:26:13.041 } 00:26:13.041 Got JSON-RPC error response 00:26:13.041 response: 00:26:13.041 { 00:26:13.041 "code": -17, 00:26:13.041 "message": "File exists" 00:26:13.041 } 00:26:13.041 20:27:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:13.041 20:27:17 -- common/autotest_common.sh@653 -- # es=1 00:26:13.041 20:27:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:13.041 20:27:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:13.041 20:27:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:13.041 20:27:17 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:13.041 20:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.041 20:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # sort 00:26:13.041 20:27:17 -- host/discovery.sh@67 -- # xargs 00:26:13.041 20:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.041 20:27:18 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:13.041 20:27:18 -- host/discovery.sh@153 -- # get_bdev_list 00:26:13.041 20:27:18 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.041 20:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.041 20:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:13.041 20:27:18 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.041 20:27:18 -- host/discovery.sh@55 -- # sort 00:26:13.041 20:27:18 -- host/discovery.sh@55 -- # xargs 00:26:13.041 20:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.041 20:27:18 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:13.041 20:27:18 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.041 20:27:18 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.041 20:27:18 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.041 20:27:18 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.041 20:27:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.041 20:27:18 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.041 20:27:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.041 20:27:18 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.041 20:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.041 20:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:14.420 [2024-11-20 20:27:19.078329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:14.420 [2024-11-20 20:27:19.078492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:14.420 [2024-11-20 20:27:19.078529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6550a0 with addr=10.0.0.2, port=8010 00:26:14.420 [2024-11-20 20:27:19.078559] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:14.420 [2024-11-20 20:27:19.078584] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:14.420 [2024-11-20 20:27:19.078618] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:15.358 [2024-11-20 20:27:20.080970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.358 [2024-11-20 20:27:20.081198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.358 [2024-11-20 20:27:20.081236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x639d30 with addr=10.0.0.2, port=8010 00:26:15.358 [2024-11-20 20:27:20.081279] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:15.358 [2024-11-20 20:27:20.081305] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:15.358 [2024-11-20 20:27:20.081329] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:16.297 [2024-11-20 20:27:21.083042] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:16.297 request: 00:26:16.297 { 00:26:16.297 "name": "nvme_second", 00:26:16.297 "trtype": "tcp", 00:26:16.297 "traddr": "10.0.0.2", 00:26:16.297 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:16.297 "adrfam": "ipv4", 00:26:16.297 "trsvcid": "8010", 00:26:16.297 "attach_timeout_ms": 3000, 00:26:16.297 "method": "bdev_nvme_start_discovery", 00:26:16.297 "req_id": 1 00:26:16.297 } 00:26:16.297 Got JSON-RPC error response 00:26:16.297 response: 00:26:16.297 { 00:26:16.297 "code": -110, 00:26:16.297 "message": "Connection timed out" 00:26:16.297 } 00:26:16.297 20:27:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:16.297 20:27:21 -- common/autotest_common.sh@653 -- # es=1 00:26:16.297 20:27:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:16.297 20:27:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:16.297 20:27:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:16.297 20:27:21 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:16.297 20:27:21 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:16.297 20:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.297 20:27:21 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:16.297 20:27:21 -- common/autotest_common.sh@10 -- # set +x 00:26:16.297 20:27:21 -- host/discovery.sh@67 -- # sort 00:26:16.297 20:27:21 -- host/discovery.sh@67 -- # xargs 00:26:16.297 20:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.297 20:27:21 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:16.297 20:27:21 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:16.297 20:27:21 -- host/discovery.sh@162 -- # kill 3262950 00:26:16.297 20:27:21 -- host/discovery.sh@163 -- # nvmftestfini 00:26:16.297 20:27:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:16.297 20:27:21 -- nvmf/common.sh@116 -- # sync 00:26:16.297 20:27:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:16.297 20:27:21 -- nvmf/common.sh@119 -- # set +e 00:26:16.297 20:27:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:16.297 20:27:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:16.297 rmmod nvme_tcp 00:26:16.297 rmmod nvme_fabrics 00:26:16.297 rmmod nvme_keyring 00:26:16.297 20:27:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:16.297 20:27:21 -- nvmf/common.sh@123 -- # set -e 00:26:16.297 20:27:21 -- nvmf/common.sh@124 -- # return 0 00:26:16.297 20:27:21 -- nvmf/common.sh@477 -- # '[' -n 3262649 ']' 00:26:16.297 20:27:21 -- nvmf/common.sh@478 -- # killprocess 3262649 00:26:16.297 20:27:21 -- common/autotest_common.sh@936 -- # '[' -z 3262649 ']' 00:26:16.297 20:27:21 -- common/autotest_common.sh@940 -- # kill -0 3262649 00:26:16.297 20:27:21 -- common/autotest_common.sh@941 -- # uname 00:26:16.297 20:27:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:16.297 20:27:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3262649 00:26:16.297 20:27:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:16.297 20:27:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:16.297 20:27:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3262649' 00:26:16.297 killing process with pid 3262649 00:26:16.297 20:27:21 -- common/autotest_common.sh@955 -- # kill 3262649 00:26:16.297 20:27:21 -- common/autotest_common.sh@960 -- # wait 3262649 00:26:16.557 20:27:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:16.557 20:27:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:16.557 20:27:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:16.557 20:27:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:16.557 20:27:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:16.557 20:27:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:16.557 20:27:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:16.557 20:27:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.097 20:27:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:19.097 00:26:19.097 real 0m17.641s 00:26:19.097 user 0m27.498s 00:26:19.097 sys 0m2.849s 00:26:19.097 20:27:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:19.097 20:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:19.097 ************************************ 00:26:19.097 END TEST nvmf_discovery 00:26:19.097 ************************************ 00:26:19.097 20:27:23 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:19.097 20:27:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:19.097 20:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:19.097 20:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:19.097 ************************************ 00:26:19.097 START TEST nvmf_discovery_remove_ifc 00:26:19.097 ************************************ 00:26:19.097 20:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:19.097 * Looking for test storage... 00:26:19.097 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:19.097 20:27:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:19.097 20:27:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:19.097 20:27:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:19.097 20:27:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:19.097 20:27:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:19.097 20:27:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:19.097 20:27:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:19.097 20:27:23 -- scripts/common.sh@335 -- # IFS=.-: 00:26:19.097 20:27:23 -- scripts/common.sh@335 -- # read -ra ver1 00:26:19.097 20:27:23 -- scripts/common.sh@336 -- # IFS=.-: 00:26:19.097 20:27:23 -- scripts/common.sh@336 -- # read -ra ver2 00:26:19.097 20:27:23 -- scripts/common.sh@337 -- # local 'op=<' 00:26:19.097 20:27:23 -- scripts/common.sh@339 -- # ver1_l=2 00:26:19.097 20:27:23 -- scripts/common.sh@340 -- # ver2_l=1 00:26:19.097 20:27:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:19.097 20:27:23 -- scripts/common.sh@343 -- # case "$op" in 00:26:19.097 20:27:23 -- scripts/common.sh@344 -- # : 1 00:26:19.097 20:27:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:19.097 20:27:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:19.097 20:27:23 -- scripts/common.sh@364 -- # decimal 1 00:26:19.097 20:27:23 -- scripts/common.sh@352 -- # local d=1 00:26:19.097 20:27:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:19.097 20:27:23 -- scripts/common.sh@354 -- # echo 1 00:26:19.097 20:27:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:19.097 20:27:23 -- scripts/common.sh@365 -- # decimal 2 00:26:19.097 20:27:23 -- scripts/common.sh@352 -- # local d=2 00:26:19.097 20:27:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:19.097 20:27:23 -- scripts/common.sh@354 -- # echo 2 00:26:19.097 20:27:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:19.097 20:27:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:19.097 20:27:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:19.097 20:27:23 -- scripts/common.sh@367 -- # return 0 00:26:19.097 20:27:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:19.097 20:27:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:19.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.097 --rc genhtml_branch_coverage=1 00:26:19.097 --rc genhtml_function_coverage=1 00:26:19.097 --rc genhtml_legend=1 00:26:19.097 --rc geninfo_all_blocks=1 00:26:19.097 --rc geninfo_unexecuted_blocks=1 00:26:19.097 00:26:19.097 ' 00:26:19.097 20:27:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:19.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.097 --rc genhtml_branch_coverage=1 00:26:19.097 --rc genhtml_function_coverage=1 00:26:19.097 --rc genhtml_legend=1 00:26:19.097 --rc geninfo_all_blocks=1 00:26:19.097 --rc geninfo_unexecuted_blocks=1 00:26:19.097 00:26:19.097 ' 00:26:19.097 20:27:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:19.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.097 --rc genhtml_branch_coverage=1 00:26:19.097 --rc genhtml_function_coverage=1 00:26:19.097 --rc genhtml_legend=1 00:26:19.097 --rc geninfo_all_blocks=1 00:26:19.097 --rc geninfo_unexecuted_blocks=1 00:26:19.097 00:26:19.097 ' 00:26:19.097 20:27:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:19.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.097 --rc genhtml_branch_coverage=1 00:26:19.097 --rc genhtml_function_coverage=1 00:26:19.097 --rc genhtml_legend=1 00:26:19.097 --rc geninfo_all_blocks=1 00:26:19.097 --rc geninfo_unexecuted_blocks=1 00:26:19.097 00:26:19.097 ' 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:19.097 20:27:23 -- nvmf/common.sh@7 -- # uname -s 00:26:19.097 20:27:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:19.097 20:27:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:19.097 20:27:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:19.097 20:27:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:19.097 20:27:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:19.097 20:27:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:19.097 20:27:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:19.097 20:27:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:19.097 20:27:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:19.097 20:27:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:19.097 20:27:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.097 20:27:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.097 20:27:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:19.097 20:27:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:19.097 20:27:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:19.097 20:27:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:19.097 20:27:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:19.097 20:27:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:19.097 20:27:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:19.097 20:27:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.097 20:27:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.097 20:27:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.097 20:27:23 -- paths/export.sh@5 -- # export PATH 00:26:19.097 20:27:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.097 20:27:23 -- nvmf/common.sh@46 -- # : 0 00:26:19.097 20:27:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:19.097 20:27:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:19.097 20:27:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:19.097 20:27:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:19.097 20:27:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:19.097 20:27:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:19.097 20:27:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:19.097 20:27:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:19.097 20:27:23 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:19.097 20:27:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:19.097 20:27:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:19.097 20:27:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:19.097 20:27:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:19.097 20:27:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:19.097 20:27:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:19.098 20:27:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:19.098 20:27:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.098 20:27:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:19.098 20:27:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:19.098 20:27:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:19.098 20:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:21.004 20:27:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:21.004 20:27:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:21.004 20:27:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:21.005 20:27:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:21.005 20:27:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:21.005 20:27:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:21.005 20:27:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:21.005 20:27:25 -- nvmf/common.sh@294 -- # net_devs=() 00:26:21.005 20:27:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:21.005 20:27:25 -- nvmf/common.sh@295 -- # e810=() 00:26:21.005 20:27:25 -- nvmf/common.sh@295 -- # local -ga e810 00:26:21.005 20:27:25 -- nvmf/common.sh@296 -- # x722=() 00:26:21.005 20:27:25 -- nvmf/common.sh@296 -- # local -ga x722 00:26:21.005 20:27:25 -- nvmf/common.sh@297 -- # mlx=() 00:26:21.005 20:27:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:21.005 20:27:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:21.005 20:27:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:21.005 20:27:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:21.005 20:27:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:21.005 20:27:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.005 20:27:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:21.005 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:21.005 20:27:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.005 20:27:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:21.005 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:21.005 20:27:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:21.005 20:27:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.005 20:27:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.005 20:27:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.005 20:27:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.005 20:27:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:21.005 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:21.005 20:27:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.005 20:27:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.005 20:27:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.005 20:27:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.005 20:27:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.005 20:27:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:21.005 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:21.005 20:27:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.005 20:27:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:21.005 20:27:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:21.005 20:27:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:21.005 20:27:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:21.005 20:27:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:21.005 20:27:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:21.005 20:27:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:21.005 20:27:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:21.005 20:27:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:21.005 20:27:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:21.005 20:27:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:21.005 20:27:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:21.005 20:27:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:21.005 20:27:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:21.005 20:27:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:21.005 20:27:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:21.005 20:27:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:21.005 20:27:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:21.266 20:27:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:21.266 20:27:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:21.266 20:27:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:21.266 20:27:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:21.266 20:27:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:21.266 20:27:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:21.266 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:21.266 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.346 ms 00:26:21.266 00:26:21.266 --- 10.0.0.2 ping statistics --- 00:26:21.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.266 rtt min/avg/max/mdev = 0.346/0.346/0.346/0.000 ms 00:26:21.266 20:27:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:21.266 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:21.266 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:26:21.266 00:26:21.266 --- 10.0.0.1 ping statistics --- 00:26:21.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.266 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:26:21.266 20:27:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:21.266 20:27:26 -- nvmf/common.sh@410 -- # return 0 00:26:21.266 20:27:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:21.266 20:27:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:21.266 20:27:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:21.266 20:27:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:21.266 20:27:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:21.266 20:27:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:21.266 20:27:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:21.266 20:27:26 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:21.266 20:27:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:21.266 20:27:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:21.266 20:27:26 -- common/autotest_common.sh@10 -- # set +x 00:26:21.266 20:27:26 -- nvmf/common.sh@469 -- # nvmfpid=3266557 00:26:21.266 20:27:26 -- nvmf/common.sh@470 -- # waitforlisten 3266557 00:26:21.266 20:27:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:21.266 20:27:26 -- common/autotest_common.sh@829 -- # '[' -z 3266557 ']' 00:26:21.266 20:27:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:21.266 20:27:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.266 20:27:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:21.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:21.266 20:27:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.266 20:27:26 -- common/autotest_common.sh@10 -- # set +x 00:26:21.266 [2024-11-20 20:27:26.169722] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.266 [2024-11-20 20:27:26.169819] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:21.266 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.266 [2024-11-20 20:27:26.234185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:21.527 [2024-11-20 20:27:26.343391] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:21.527 [2024-11-20 20:27:26.343541] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:21.527 [2024-11-20 20:27:26.343566] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:21.527 [2024-11-20 20:27:26.343585] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:21.527 [2024-11-20 20:27:26.343622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:22.094 20:27:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.094 20:27:27 -- common/autotest_common.sh@862 -- # return 0 00:26:22.094 20:27:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:22.094 20:27:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:22.353 20:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:22.353 20:27:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:22.353 20:27:27 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:22.353 20:27:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.353 20:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:22.353 [2024-11-20 20:27:27.164097] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:22.353 [2024-11-20 20:27:27.172319] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:22.353 null0 00:26:22.353 [2024-11-20 20:27:27.204235] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:22.353 20:27:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.353 20:27:27 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3266714 00:26:22.353 20:27:27 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:22.353 20:27:27 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3266714 /tmp/host.sock 00:26:22.353 20:27:27 -- common/autotest_common.sh@829 -- # '[' -z 3266714 ']' 00:26:22.353 20:27:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:22.353 20:27:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:22.353 20:27:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:22.353 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:22.353 20:27:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:22.353 20:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:22.353 [2024-11-20 20:27:27.264726] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:22.353 [2024-11-20 20:27:27.264803] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3266714 ] 00:26:22.353 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.353 [2024-11-20 20:27:27.327626] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:22.646 [2024-11-20 20:27:27.441354] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:22.646 [2024-11-20 20:27:27.441525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:22.646 20:27:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.646 20:27:27 -- common/autotest_common.sh@862 -- # return 0 00:26:22.646 20:27:27 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:22.646 20:27:27 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:22.646 20:27:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.646 20:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:22.646 20:27:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.646 20:27:27 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:22.646 20:27:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.646 20:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:22.646 20:27:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.646 20:27:27 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:22.646 20:27:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.646 20:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:24.052 [2024-11-20 20:27:28.651766] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:24.052 [2024-11-20 20:27:28.651800] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:24.052 [2024-11-20 20:27:28.651827] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:24.052 [2024-11-20 20:27:28.779259] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:24.052 [2024-11-20 20:27:29.003463] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:24.052 [2024-11-20 20:27:29.003520] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:24.052 [2024-11-20 20:27:29.003562] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:24.052 [2024-11-20 20:27:29.003587] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:24.052 [2024-11-20 20:27:29.003614] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:24.052 20:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.052 20:27:29 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:24.052 20:27:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:24.053 20:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:24.053 20:27:29 -- common/autotest_common.sh@10 -- # set +x 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:24.053 [2024-11-20 20:27:29.010609] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xa4dd40 was disconnected and freed. delete nvme_qpair. 00:26:24.053 20:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:24.053 20:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:24.053 20:27:29 -- common/autotest_common.sh@10 -- # set +x 00:26:24.053 20:27:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:24.313 20:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.313 20:27:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:24.313 20:27:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.252 20:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.252 20:27:30 -- common/autotest_common.sh@10 -- # set +x 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.252 20:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:25.252 20:27:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:26.188 20:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.188 20:27:31 -- common/autotest_common.sh@10 -- # set +x 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:26.188 20:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:26.188 20:27:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:27.567 20:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:27.567 20:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:27.567 20:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:27.567 20:27:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:28.506 20:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.506 20:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:28.506 20:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:28.506 20:27:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.438 20:27:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.438 20:27:34 -- common/autotest_common.sh@10 -- # set +x 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.438 20:27:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:29.438 20:27:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.438 [2024-11-20 20:27:34.444605] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:29.438 [2024-11-20 20:27:34.444678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.438 [2024-11-20 20:27:34.444714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.438 [2024-11-20 20:27:34.444744] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.438 [2024-11-20 20:27:34.444770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.438 [2024-11-20 20:27:34.444796] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.438 [2024-11-20 20:27:34.444820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.438 [2024-11-20 20:27:34.444846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.438 [2024-11-20 20:27:34.444872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.438 [2024-11-20 20:27:34.444897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.438 [2024-11-20 20:27:34.444921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.438 [2024-11-20 20:27:34.444945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa14430 is same with the state(5) to be set 00:26:29.438 [2024-11-20 20:27:34.454624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa14430 (9): Bad file descriptor 00:26:29.438 [2024-11-20 20:27:34.464673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:30.377 20:27:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:30.377 20:27:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.377 20:27:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:30.377 20:27:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.377 20:27:35 -- common/autotest_common.sh@10 -- # set +x 00:26:30.377 20:27:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:30.377 20:27:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:30.637 [2024-11-20 20:27:35.487200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:31.570 [2024-11-20 20:27:36.511141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:31.570 [2024-11-20 20:27:36.511207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa14430 with addr=10.0.0.2, port=4420 00:26:31.570 [2024-11-20 20:27:36.511246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa14430 is same with the state(5) to be set 00:26:31.570 [2024-11-20 20:27:36.511298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:31.570 [2024-11-20 20:27:36.511327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:31.570 [2024-11-20 20:27:36.511352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:31.570 [2024-11-20 20:27:36.511379] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:31.570 [2024-11-20 20:27:36.511891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa14430 (9): Bad file descriptor 00:26:31.570 [2024-11-20 20:27:36.511949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:31.570 [2024-11-20 20:27:36.512003] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:31.570 [2024-11-20 20:27:36.512057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.570 [2024-11-20 20:27:36.512114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.570 [2024-11-20 20:27:36.512148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.570 [2024-11-20 20:27:36.512175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.570 [2024-11-20 20:27:36.512204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.570 [2024-11-20 20:27:36.512230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.570 [2024-11-20 20:27:36.512257] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.570 [2024-11-20 20:27:36.512283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.570 [2024-11-20 20:27:36.512308] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.570 [2024-11-20 20:27:36.512335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.570 [2024-11-20 20:27:36.512358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:31.570 [2024-11-20 20:27:36.512425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa14840 (9): Bad file descriptor 00:26:31.570 [2024-11-20 20:27:36.513425] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:31.570 [2024-11-20 20:27:36.513463] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:31.570 20:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.570 20:27:36 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:31.570 20:27:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:32.504 20:27:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.504 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.504 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.504 20:27:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.504 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.504 20:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:32.504 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.504 20:27:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.763 20:27:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.763 20:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.763 20:27:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:32.763 20:27:37 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:33.697 [2024-11-20 20:27:38.567746] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:33.697 [2024-11-20 20:27:38.567787] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:33.697 [2024-11-20 20:27:38.567814] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:33.697 20:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:33.697 20:27:38 -- common/autotest_common.sh@10 -- # set +x 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:33.697 20:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.697 [2024-11-20 20:27:38.694238] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:33.697 20:27:38 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:33.955 [2024-11-20 20:27:38.750202] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:33.955 [2024-11-20 20:27:38.750259] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:33.955 [2024-11-20 20:27:38.750291] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:33.955 [2024-11-20 20:27:38.750311] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:33.955 [2024-11-20 20:27:38.750322] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:33.955 [2024-11-20 20:27:38.796810] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xa22ef0 was disconnected and freed. delete nvme_qpair. 00:26:34.887 20:27:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.887 20:27:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.887 20:27:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.887 20:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.887 20:27:39 -- common/autotest_common.sh@10 -- # set +x 00:26:34.887 20:27:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.887 20:27:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.888 20:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.888 20:27:39 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:34.888 20:27:39 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:34.888 20:27:39 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3266714 00:26:34.888 20:27:39 -- common/autotest_common.sh@936 -- # '[' -z 3266714 ']' 00:26:34.888 20:27:39 -- common/autotest_common.sh@940 -- # kill -0 3266714 00:26:34.888 20:27:39 -- common/autotest_common.sh@941 -- # uname 00:26:34.888 20:27:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:34.888 20:27:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266714 00:26:34.888 20:27:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:34.888 20:27:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:34.888 20:27:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266714' 00:26:34.888 killing process with pid 3266714 00:26:34.888 20:27:39 -- common/autotest_common.sh@955 -- # kill 3266714 00:26:34.888 20:27:39 -- common/autotest_common.sh@960 -- # wait 3266714 00:26:35.145 20:27:40 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:35.145 20:27:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:35.145 20:27:40 -- nvmf/common.sh@116 -- # sync 00:26:35.145 20:27:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:35.145 20:27:40 -- nvmf/common.sh@119 -- # set +e 00:26:35.145 20:27:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:35.145 20:27:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:35.145 rmmod nvme_tcp 00:26:35.145 rmmod nvme_fabrics 00:26:35.145 rmmod nvme_keyring 00:26:35.145 20:27:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:35.145 20:27:40 -- nvmf/common.sh@123 -- # set -e 00:26:35.145 20:27:40 -- nvmf/common.sh@124 -- # return 0 00:26:35.145 20:27:40 -- nvmf/common.sh@477 -- # '[' -n 3266557 ']' 00:26:35.145 20:27:40 -- nvmf/common.sh@478 -- # killprocess 3266557 00:26:35.145 20:27:40 -- common/autotest_common.sh@936 -- # '[' -z 3266557 ']' 00:26:35.145 20:27:40 -- common/autotest_common.sh@940 -- # kill -0 3266557 00:26:35.146 20:27:40 -- common/autotest_common.sh@941 -- # uname 00:26:35.146 20:27:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:35.146 20:27:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266557 00:26:35.146 20:27:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:35.146 20:27:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:35.146 20:27:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266557' 00:26:35.146 killing process with pid 3266557 00:26:35.146 20:27:40 -- common/autotest_common.sh@955 -- # kill 3266557 00:26:35.146 20:27:40 -- common/autotest_common.sh@960 -- # wait 3266557 00:26:35.404 20:27:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:35.404 20:27:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:35.404 20:27:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:35.404 20:27:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:35.404 20:27:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:35.404 20:27:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:35.404 20:27:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:35.404 20:27:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.940 20:27:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:37.940 00:26:37.940 real 0m18.855s 00:26:37.940 user 0m25.937s 00:26:37.940 sys 0m3.059s 00:26:37.940 20:27:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:37.940 20:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:37.940 ************************************ 00:26:37.940 END TEST nvmf_discovery_remove_ifc 00:26:37.940 ************************************ 00:26:37.940 20:27:42 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:37.940 20:27:42 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:37.940 20:27:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:37.940 20:27:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:37.940 20:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:37.940 ************************************ 00:26:37.940 START TEST nvmf_digest 00:26:37.940 ************************************ 00:26:37.940 20:27:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:37.940 * Looking for test storage... 00:26:37.940 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:37.940 20:27:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:37.940 20:27:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:37.940 20:27:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:37.940 20:27:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:37.940 20:27:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:37.940 20:27:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:37.940 20:27:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:37.940 20:27:42 -- scripts/common.sh@335 -- # IFS=.-: 00:26:37.940 20:27:42 -- scripts/common.sh@335 -- # read -ra ver1 00:26:37.940 20:27:42 -- scripts/common.sh@336 -- # IFS=.-: 00:26:37.940 20:27:42 -- scripts/common.sh@336 -- # read -ra ver2 00:26:37.940 20:27:42 -- scripts/common.sh@337 -- # local 'op=<' 00:26:37.940 20:27:42 -- scripts/common.sh@339 -- # ver1_l=2 00:26:37.940 20:27:42 -- scripts/common.sh@340 -- # ver2_l=1 00:26:37.940 20:27:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:37.940 20:27:42 -- scripts/common.sh@343 -- # case "$op" in 00:26:37.940 20:27:42 -- scripts/common.sh@344 -- # : 1 00:26:37.940 20:27:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:37.940 20:27:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:37.940 20:27:42 -- scripts/common.sh@364 -- # decimal 1 00:26:37.940 20:27:42 -- scripts/common.sh@352 -- # local d=1 00:26:37.940 20:27:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:37.940 20:27:42 -- scripts/common.sh@354 -- # echo 1 00:26:37.940 20:27:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:37.940 20:27:42 -- scripts/common.sh@365 -- # decimal 2 00:26:37.940 20:27:42 -- scripts/common.sh@352 -- # local d=2 00:26:37.940 20:27:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:37.940 20:27:42 -- scripts/common.sh@354 -- # echo 2 00:26:37.940 20:27:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:37.940 20:27:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:37.940 20:27:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:37.940 20:27:42 -- scripts/common.sh@367 -- # return 0 00:26:37.940 20:27:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:37.940 20:27:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:37.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.940 --rc genhtml_branch_coverage=1 00:26:37.940 --rc genhtml_function_coverage=1 00:26:37.940 --rc genhtml_legend=1 00:26:37.940 --rc geninfo_all_blocks=1 00:26:37.940 --rc geninfo_unexecuted_blocks=1 00:26:37.940 00:26:37.940 ' 00:26:37.940 20:27:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:37.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.940 --rc genhtml_branch_coverage=1 00:26:37.940 --rc genhtml_function_coverage=1 00:26:37.940 --rc genhtml_legend=1 00:26:37.940 --rc geninfo_all_blocks=1 00:26:37.940 --rc geninfo_unexecuted_blocks=1 00:26:37.940 00:26:37.940 ' 00:26:37.940 20:27:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:37.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.940 --rc genhtml_branch_coverage=1 00:26:37.940 --rc genhtml_function_coverage=1 00:26:37.940 --rc genhtml_legend=1 00:26:37.940 --rc geninfo_all_blocks=1 00:26:37.940 --rc geninfo_unexecuted_blocks=1 00:26:37.940 00:26:37.940 ' 00:26:37.940 20:27:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:37.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.940 --rc genhtml_branch_coverage=1 00:26:37.940 --rc genhtml_function_coverage=1 00:26:37.940 --rc genhtml_legend=1 00:26:37.940 --rc geninfo_all_blocks=1 00:26:37.940 --rc geninfo_unexecuted_blocks=1 00:26:37.940 00:26:37.940 ' 00:26:37.940 20:27:42 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:37.940 20:27:42 -- nvmf/common.sh@7 -- # uname -s 00:26:37.940 20:27:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:37.940 20:27:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:37.940 20:27:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:37.940 20:27:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:37.940 20:27:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:37.940 20:27:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:37.940 20:27:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:37.940 20:27:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:37.940 20:27:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:37.940 20:27:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:37.940 20:27:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.940 20:27:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.940 20:27:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:37.940 20:27:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:37.940 20:27:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:37.940 20:27:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:37.940 20:27:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:37.940 20:27:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:37.940 20:27:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:37.940 20:27:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.940 20:27:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.941 20:27:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.941 20:27:42 -- paths/export.sh@5 -- # export PATH 00:26:37.941 20:27:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.941 20:27:42 -- nvmf/common.sh@46 -- # : 0 00:26:37.941 20:27:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:37.941 20:27:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:37.941 20:27:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:37.941 20:27:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:37.941 20:27:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:37.941 20:27:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:37.941 20:27:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:37.941 20:27:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:37.941 20:27:42 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:37.941 20:27:42 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:37.941 20:27:42 -- host/digest.sh@16 -- # runtime=2 00:26:37.941 20:27:42 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:37.941 20:27:42 -- host/digest.sh@132 -- # nvmftestinit 00:26:37.941 20:27:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:37.941 20:27:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:37.941 20:27:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:37.941 20:27:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:37.941 20:27:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:37.941 20:27:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.941 20:27:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.941 20:27:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.941 20:27:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:37.941 20:27:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:37.941 20:27:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:37.941 20:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:39.844 20:27:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:39.844 20:27:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:39.844 20:27:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:39.844 20:27:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:39.844 20:27:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:39.844 20:27:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:39.844 20:27:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:39.844 20:27:44 -- nvmf/common.sh@294 -- # net_devs=() 00:26:39.844 20:27:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:39.844 20:27:44 -- nvmf/common.sh@295 -- # e810=() 00:26:39.844 20:27:44 -- nvmf/common.sh@295 -- # local -ga e810 00:26:39.844 20:27:44 -- nvmf/common.sh@296 -- # x722=() 00:26:39.844 20:27:44 -- nvmf/common.sh@296 -- # local -ga x722 00:26:39.844 20:27:44 -- nvmf/common.sh@297 -- # mlx=() 00:26:39.844 20:27:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:39.844 20:27:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:39.844 20:27:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:39.844 20:27:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:39.844 20:27:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:39.844 20:27:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.844 20:27:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:39.844 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:39.844 20:27:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.844 20:27:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:39.844 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:39.844 20:27:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:39.844 20:27:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:39.844 20:27:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.844 20:27:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.844 20:27:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.844 20:27:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.844 20:27:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:39.844 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:39.844 20:27:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.845 20:27:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.845 20:27:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.845 20:27:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.845 20:27:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.845 20:27:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:39.845 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:39.845 20:27:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.845 20:27:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:39.845 20:27:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:39.845 20:27:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:39.845 20:27:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:39.845 20:27:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:39.845 20:27:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:39.845 20:27:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:39.845 20:27:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:39.845 20:27:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:39.845 20:27:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:39.845 20:27:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:39.845 20:27:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:39.845 20:27:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:39.845 20:27:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:39.845 20:27:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:39.845 20:27:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:39.845 20:27:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:39.845 20:27:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:39.845 20:27:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:39.845 20:27:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:39.845 20:27:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:39.845 20:27:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:39.845 20:27:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:39.845 20:27:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:39.845 20:27:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:39.845 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:39.845 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:26:39.845 00:26:39.845 --- 10.0.0.2 ping statistics --- 00:26:39.845 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.845 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:26:39.845 20:27:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:39.845 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:39.845 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:26:39.845 00:26:39.845 --- 10.0.0.1 ping statistics --- 00:26:39.845 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.845 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:26:39.845 20:27:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:39.845 20:27:44 -- nvmf/common.sh@410 -- # return 0 00:26:39.845 20:27:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:39.845 20:27:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:39.845 20:27:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:39.845 20:27:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:39.845 20:27:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:39.845 20:27:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:39.845 20:27:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:39.845 20:27:44 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:39.845 20:27:44 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:39.845 20:27:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:39.845 20:27:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:39.845 20:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:39.845 ************************************ 00:26:39.845 START TEST nvmf_digest_clean 00:26:39.845 ************************************ 00:26:39.845 20:27:44 -- common/autotest_common.sh@1114 -- # run_digest 00:26:39.845 20:27:44 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:39.845 20:27:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:39.845 20:27:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:39.845 20:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:39.845 20:27:44 -- nvmf/common.sh@469 -- # nvmfpid=3270360 00:26:39.845 20:27:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:39.845 20:27:44 -- nvmf/common.sh@470 -- # waitforlisten 3270360 00:26:39.845 20:27:44 -- common/autotest_common.sh@829 -- # '[' -z 3270360 ']' 00:26:39.845 20:27:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:39.845 20:27:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:39.845 20:27:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:39.845 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:39.845 20:27:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:39.845 20:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:39.845 [2024-11-20 20:27:44.867603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:39.845 [2024-11-20 20:27:44.867678] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:40.104 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.104 [2024-11-20 20:27:44.934833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.104 [2024-11-20 20:27:45.047720] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:40.104 [2024-11-20 20:27:45.047904] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:40.104 [2024-11-20 20:27:45.047935] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:40.104 [2024-11-20 20:27:45.047958] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:40.104 [2024-11-20 20:27:45.048000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.104 20:27:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.104 20:27:45 -- common/autotest_common.sh@862 -- # return 0 00:26:40.104 20:27:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:40.104 20:27:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:40.104 20:27:45 -- common/autotest_common.sh@10 -- # set +x 00:26:40.104 20:27:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:40.104 20:27:45 -- host/digest.sh@120 -- # common_target_config 00:26:40.104 20:27:45 -- host/digest.sh@43 -- # rpc_cmd 00:26:40.104 20:27:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.104 20:27:45 -- common/autotest_common.sh@10 -- # set +x 00:26:40.362 null0 00:26:40.362 [2024-11-20 20:27:45.215649] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:40.362 [2024-11-20 20:27:45.239877] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:40.362 20:27:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.362 20:27:45 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:40.362 20:27:45 -- host/digest.sh@77 -- # local rw bs qd 00:26:40.362 20:27:45 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:40.362 20:27:45 -- host/digest.sh@80 -- # rw=randread 00:26:40.362 20:27:45 -- host/digest.sh@80 -- # bs=4096 00:26:40.362 20:27:45 -- host/digest.sh@80 -- # qd=128 00:26:40.362 20:27:45 -- host/digest.sh@82 -- # bperfpid=3270388 00:26:40.363 20:27:45 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:40.363 20:27:45 -- host/digest.sh@83 -- # waitforlisten 3270388 /var/tmp/bperf.sock 00:26:40.363 20:27:45 -- common/autotest_common.sh@829 -- # '[' -z 3270388 ']' 00:26:40.363 20:27:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:40.363 20:27:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:40.363 20:27:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:40.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:40.363 20:27:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:40.363 20:27:45 -- common/autotest_common.sh@10 -- # set +x 00:26:40.363 [2024-11-20 20:27:45.280383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:40.363 [2024-11-20 20:27:45.280458] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3270388 ] 00:26:40.363 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.363 [2024-11-20 20:27:45.341688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.621 [2024-11-20 20:27:45.455446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:40.621 20:27:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.621 20:27:45 -- common/autotest_common.sh@862 -- # return 0 00:26:40.621 20:27:45 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:40.621 20:27:45 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:40.621 20:27:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:40.880 20:27:45 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:40.880 20:27:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:41.138 nvme0n1 00:26:41.138 20:27:46 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:41.138 20:27:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:41.396 Running I/O for 2 seconds... 00:26:43.296 00:26:43.296 Latency(us) 00:26:43.296 [2024-11-20T19:27:48.335Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.296 [2024-11-20T19:27:48.335Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:43.296 nvme0n1 : 2.05 16156.12 63.11 0.00 0.00 7758.41 3470.98 48351.00 00:26:43.296 [2024-11-20T19:27:48.335Z] =================================================================================================================== 00:26:43.296 [2024-11-20T19:27:48.335Z] Total : 16156.12 63.11 0.00 0.00 7758.41 3470.98 48351.00 00:26:43.296 0 00:26:43.554 20:27:48 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:43.554 20:27:48 -- host/digest.sh@92 -- # get_accel_stats 00:26:43.554 20:27:48 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:43.554 20:27:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:43.554 20:27:48 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:43.554 | select(.opcode=="crc32c") 00:26:43.554 | "\(.module_name) \(.executed)"' 00:26:43.812 20:27:48 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:43.812 20:27:48 -- host/digest.sh@93 -- # exp_module=software 00:26:43.812 20:27:48 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:43.812 20:27:48 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:43.812 20:27:48 -- host/digest.sh@97 -- # killprocess 3270388 00:26:43.812 20:27:48 -- common/autotest_common.sh@936 -- # '[' -z 3270388 ']' 00:26:43.812 20:27:48 -- common/autotest_common.sh@940 -- # kill -0 3270388 00:26:43.812 20:27:48 -- common/autotest_common.sh@941 -- # uname 00:26:43.812 20:27:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:43.812 20:27:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3270388 00:26:43.812 20:27:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:43.812 20:27:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:43.812 20:27:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3270388' 00:26:43.812 killing process with pid 3270388 00:26:43.812 20:27:48 -- common/autotest_common.sh@955 -- # kill 3270388 00:26:43.812 Received shutdown signal, test time was about 2.000000 seconds 00:26:43.812 00:26:43.812 Latency(us) 00:26:43.812 [2024-11-20T19:27:48.851Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.812 [2024-11-20T19:27:48.851Z] =================================================================================================================== 00:26:43.812 [2024-11-20T19:27:48.851Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:43.812 20:27:48 -- common/autotest_common.sh@960 -- # wait 3270388 00:26:44.070 20:27:48 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:44.070 20:27:48 -- host/digest.sh@77 -- # local rw bs qd 00:26:44.070 20:27:48 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:44.070 20:27:48 -- host/digest.sh@80 -- # rw=randread 00:26:44.070 20:27:48 -- host/digest.sh@80 -- # bs=131072 00:26:44.070 20:27:48 -- host/digest.sh@80 -- # qd=16 00:26:44.070 20:27:48 -- host/digest.sh@82 -- # bperfpid=3270807 00:26:44.070 20:27:48 -- host/digest.sh@83 -- # waitforlisten 3270807 /var/tmp/bperf.sock 00:26:44.070 20:27:48 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:44.070 20:27:48 -- common/autotest_common.sh@829 -- # '[' -z 3270807 ']' 00:26:44.070 20:27:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:44.070 20:27:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:44.070 20:27:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:44.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:44.070 20:27:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:44.070 20:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:44.070 [2024-11-20 20:27:48.990303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:44.070 [2024-11-20 20:27:48.990387] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3270807 ] 00:26:44.070 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:44.070 Zero copy mechanism will not be used. 00:26:44.070 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.070 [2024-11-20 20:27:49.050528] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:44.327 [2024-11-20 20:27:49.162210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:44.327 20:27:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:44.327 20:27:49 -- common/autotest_common.sh@862 -- # return 0 00:26:44.327 20:27:49 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:44.327 20:27:49 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:44.327 20:27:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:44.584 20:27:49 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:44.584 20:27:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:45.150 nvme0n1 00:26:45.150 20:27:50 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:45.150 20:27:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:45.150 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.150 Zero copy mechanism will not be used. 00:26:45.150 Running I/O for 2 seconds... 00:26:47.678 00:26:47.678 Latency(us) 00:26:47.678 [2024-11-20T19:27:52.717Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.678 [2024-11-20T19:27:52.717Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:47.678 nvme0n1 : 2.00 5243.20 655.40 0.00 0.00 3047.49 831.34 12087.75 00:26:47.678 [2024-11-20T19:27:52.717Z] =================================================================================================================== 00:26:47.678 [2024-11-20T19:27:52.717Z] Total : 5243.20 655.40 0.00 0.00 3047.49 831.34 12087.75 00:26:47.678 0 00:26:47.678 20:27:52 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:47.679 20:27:52 -- host/digest.sh@92 -- # get_accel_stats 00:26:47.679 20:27:52 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:47.679 20:27:52 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:47.679 | select(.opcode=="crc32c") 00:26:47.679 | "\(.module_name) \(.executed)"' 00:26:47.679 20:27:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:47.679 20:27:52 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:47.679 20:27:52 -- host/digest.sh@93 -- # exp_module=software 00:26:47.679 20:27:52 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:47.679 20:27:52 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:47.679 20:27:52 -- host/digest.sh@97 -- # killprocess 3270807 00:26:47.679 20:27:52 -- common/autotest_common.sh@936 -- # '[' -z 3270807 ']' 00:26:47.679 20:27:52 -- common/autotest_common.sh@940 -- # kill -0 3270807 00:26:47.679 20:27:52 -- common/autotest_common.sh@941 -- # uname 00:26:47.679 20:27:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:47.679 20:27:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3270807 00:26:47.679 20:27:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:47.679 20:27:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:47.679 20:27:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3270807' 00:26:47.679 killing process with pid 3270807 00:26:47.679 20:27:52 -- common/autotest_common.sh@955 -- # kill 3270807 00:26:47.679 Received shutdown signal, test time was about 2.000000 seconds 00:26:47.679 00:26:47.679 Latency(us) 00:26:47.679 [2024-11-20T19:27:52.718Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.679 [2024-11-20T19:27:52.718Z] =================================================================================================================== 00:26:47.679 [2024-11-20T19:27:52.718Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:47.679 20:27:52 -- common/autotest_common.sh@960 -- # wait 3270807 00:26:47.937 20:27:52 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:47.937 20:27:52 -- host/digest.sh@77 -- # local rw bs qd 00:26:47.937 20:27:52 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:47.937 20:27:52 -- host/digest.sh@80 -- # rw=randwrite 00:26:47.937 20:27:52 -- host/digest.sh@80 -- # bs=4096 00:26:47.937 20:27:52 -- host/digest.sh@80 -- # qd=128 00:26:47.937 20:27:52 -- host/digest.sh@82 -- # bperfpid=3271351 00:26:47.937 20:27:52 -- host/digest.sh@83 -- # waitforlisten 3271351 /var/tmp/bperf.sock 00:26:47.937 20:27:52 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:47.937 20:27:52 -- common/autotest_common.sh@829 -- # '[' -z 3271351 ']' 00:26:47.937 20:27:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:47.937 20:27:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:47.937 20:27:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:47.937 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:47.937 20:27:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:47.937 20:27:52 -- common/autotest_common.sh@10 -- # set +x 00:26:47.937 [2024-11-20 20:27:52.758172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:47.937 [2024-11-20 20:27:52.758248] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271351 ] 00:26:47.937 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.937 [2024-11-20 20:27:52.814398] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:47.937 [2024-11-20 20:27:52.917386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:48.195 20:27:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:48.195 20:27:52 -- common/autotest_common.sh@862 -- # return 0 00:26:48.195 20:27:52 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:48.195 20:27:52 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:48.195 20:27:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:48.453 20:27:53 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.453 20:27:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.710 nvme0n1 00:26:48.968 20:27:53 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:48.968 20:27:53 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:48.968 Running I/O for 2 seconds... 00:26:50.867 00:26:50.867 Latency(us) 00:26:50.867 [2024-11-20T19:27:55.906Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:50.867 [2024-11-20T19:27:55.906Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:50.867 nvme0n1 : 2.01 20063.34 78.37 0.00 0.00 6364.84 2791.35 10194.49 00:26:50.867 [2024-11-20T19:27:55.906Z] =================================================================================================================== 00:26:50.867 [2024-11-20T19:27:55.906Z] Total : 20063.34 78.37 0.00 0.00 6364.84 2791.35 10194.49 00:26:50.867 0 00:26:50.867 20:27:55 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:50.868 20:27:55 -- host/digest.sh@92 -- # get_accel_stats 00:26:50.868 20:27:55 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:50.868 20:27:55 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:50.868 | select(.opcode=="crc32c") 00:26:50.868 | "\(.module_name) \(.executed)"' 00:26:50.868 20:27:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:51.433 20:27:56 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:51.433 20:27:56 -- host/digest.sh@93 -- # exp_module=software 00:26:51.433 20:27:56 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:51.433 20:27:56 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:51.433 20:27:56 -- host/digest.sh@97 -- # killprocess 3271351 00:26:51.433 20:27:56 -- common/autotest_common.sh@936 -- # '[' -z 3271351 ']' 00:26:51.433 20:27:56 -- common/autotest_common.sh@940 -- # kill -0 3271351 00:26:51.433 20:27:56 -- common/autotest_common.sh@941 -- # uname 00:26:51.433 20:27:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.433 20:27:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3271351 00:26:51.433 20:27:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:51.433 20:27:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:51.433 20:27:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3271351' 00:26:51.433 killing process with pid 3271351 00:26:51.433 20:27:56 -- common/autotest_common.sh@955 -- # kill 3271351 00:26:51.433 Received shutdown signal, test time was about 2.000000 seconds 00:26:51.433 00:26:51.433 Latency(us) 00:26:51.433 [2024-11-20T19:27:56.472Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.433 [2024-11-20T19:27:56.472Z] =================================================================================================================== 00:26:51.434 [2024-11-20T19:27:56.473Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:51.434 20:27:56 -- common/autotest_common.sh@960 -- # wait 3271351 00:26:51.692 20:27:56 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:51.692 20:27:56 -- host/digest.sh@77 -- # local rw bs qd 00:26:51.692 20:27:56 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:51.692 20:27:56 -- host/digest.sh@80 -- # rw=randwrite 00:26:51.692 20:27:56 -- host/digest.sh@80 -- # bs=131072 00:26:51.692 20:27:56 -- host/digest.sh@80 -- # qd=16 00:26:51.692 20:27:56 -- host/digest.sh@82 -- # bperfpid=3271775 00:26:51.692 20:27:56 -- host/digest.sh@83 -- # waitforlisten 3271775 /var/tmp/bperf.sock 00:26:51.692 20:27:56 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:51.692 20:27:56 -- common/autotest_common.sh@829 -- # '[' -z 3271775 ']' 00:26:51.692 20:27:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:51.692 20:27:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:51.692 20:27:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:51.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:51.692 20:27:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:51.692 20:27:56 -- common/autotest_common.sh@10 -- # set +x 00:26:51.692 [2024-11-20 20:27:56.524759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:51.692 [2024-11-20 20:27:56.524840] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271775 ] 00:26:51.692 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:51.692 Zero copy mechanism will not be used. 00:26:51.692 EAL: No free 2048 kB hugepages reported on node 1 00:26:51.692 [2024-11-20 20:27:56.582179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:51.692 [2024-11-20 20:27:56.688409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:51.951 20:27:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:51.951 20:27:56 -- common/autotest_common.sh@862 -- # return 0 00:26:51.951 20:27:56 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:51.951 20:27:56 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:51.951 20:27:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:52.209 20:27:57 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.209 20:27:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.780 nvme0n1 00:26:52.780 20:27:57 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:52.780 20:27:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:52.780 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:52.780 Zero copy mechanism will not be used. 00:26:52.780 Running I/O for 2 seconds... 00:26:55.312 00:26:55.312 Latency(us) 00:26:55.312 [2024-11-20T19:28:00.351Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.312 [2024-11-20T19:28:00.351Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:55.312 nvme0n1 : 2.00 6815.32 851.92 0.00 0.00 2340.55 1856.85 7573.05 00:26:55.312 [2024-11-20T19:28:00.351Z] =================================================================================================================== 00:26:55.312 [2024-11-20T19:28:00.351Z] Total : 6815.32 851.92 0.00 0.00 2340.55 1856.85 7573.05 00:26:55.312 0 00:26:55.312 20:27:59 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:55.312 20:27:59 -- host/digest.sh@92 -- # get_accel_stats 00:26:55.312 20:27:59 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:55.312 20:27:59 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:55.312 | select(.opcode=="crc32c") 00:26:55.312 | "\(.module_name) \(.executed)"' 00:26:55.312 20:27:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:55.312 20:28:00 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:55.312 20:28:00 -- host/digest.sh@93 -- # exp_module=software 00:26:55.312 20:28:00 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:55.312 20:28:00 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:55.312 20:28:00 -- host/digest.sh@97 -- # killprocess 3271775 00:26:55.312 20:28:00 -- common/autotest_common.sh@936 -- # '[' -z 3271775 ']' 00:26:55.312 20:28:00 -- common/autotest_common.sh@940 -- # kill -0 3271775 00:26:55.312 20:28:00 -- common/autotest_common.sh@941 -- # uname 00:26:55.312 20:28:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.312 20:28:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3271775 00:26:55.312 20:28:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:55.312 20:28:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:55.312 20:28:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3271775' 00:26:55.312 killing process with pid 3271775 00:26:55.312 20:28:00 -- common/autotest_common.sh@955 -- # kill 3271775 00:26:55.312 Received shutdown signal, test time was about 2.000000 seconds 00:26:55.312 00:26:55.312 Latency(us) 00:26:55.312 [2024-11-20T19:28:00.351Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.312 [2024-11-20T19:28:00.351Z] =================================================================================================================== 00:26:55.312 [2024-11-20T19:28:00.351Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:55.312 20:28:00 -- common/autotest_common.sh@960 -- # wait 3271775 00:26:55.312 20:28:00 -- host/digest.sh@126 -- # killprocess 3270360 00:26:55.312 20:28:00 -- common/autotest_common.sh@936 -- # '[' -z 3270360 ']' 00:26:55.312 20:28:00 -- common/autotest_common.sh@940 -- # kill -0 3270360 00:26:55.312 20:28:00 -- common/autotest_common.sh@941 -- # uname 00:26:55.312 20:28:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.312 20:28:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3270360 00:26:55.571 20:28:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:55.571 20:28:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:55.571 20:28:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3270360' 00:26:55.571 killing process with pid 3270360 00:26:55.571 20:28:00 -- common/autotest_common.sh@955 -- # kill 3270360 00:26:55.571 20:28:00 -- common/autotest_common.sh@960 -- # wait 3270360 00:26:55.830 00:26:55.830 real 0m15.803s 00:26:55.830 user 0m30.991s 00:26:55.830 sys 0m4.498s 00:26:55.830 20:28:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:55.830 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:55.830 ************************************ 00:26:55.830 END TEST nvmf_digest_clean 00:26:55.830 ************************************ 00:26:55.830 20:28:00 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:55.830 20:28:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:55.830 20:28:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:55.830 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:55.830 ************************************ 00:26:55.830 START TEST nvmf_digest_error 00:26:55.830 ************************************ 00:26:55.830 20:28:00 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:55.830 20:28:00 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:55.830 20:28:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:55.830 20:28:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:55.830 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:55.830 20:28:00 -- nvmf/common.sh@469 -- # nvmfpid=3272344 00:26:55.830 20:28:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:55.830 20:28:00 -- nvmf/common.sh@470 -- # waitforlisten 3272344 00:26:55.830 20:28:00 -- common/autotest_common.sh@829 -- # '[' -z 3272344 ']' 00:26:55.830 20:28:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:55.830 20:28:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:55.830 20:28:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:55.830 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:55.830 20:28:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:55.830 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:55.830 [2024-11-20 20:28:00.695657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:55.830 [2024-11-20 20:28:00.695736] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:55.830 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.830 [2024-11-20 20:28:00.757961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:55.830 [2024-11-20 20:28:00.861243] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:55.830 [2024-11-20 20:28:00.861400] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:55.830 [2024-11-20 20:28:00.861426] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:55.830 [2024-11-20 20:28:00.861444] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:55.831 [2024-11-20 20:28:00.861479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:56.089 20:28:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:56.089 20:28:00 -- common/autotest_common.sh@862 -- # return 0 00:26:56.089 20:28:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:56.089 20:28:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:56.089 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:56.089 20:28:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:56.089 20:28:00 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:56.089 20:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:56.089 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:56.089 [2024-11-20 20:28:00.942172] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:56.089 20:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:56.089 20:28:00 -- host/digest.sh@104 -- # common_target_config 00:26:56.089 20:28:00 -- host/digest.sh@43 -- # rpc_cmd 00:26:56.089 20:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:56.089 20:28:00 -- common/autotest_common.sh@10 -- # set +x 00:26:56.089 null0 00:26:56.089 [2024-11-20 20:28:01.059290] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:56.089 [2024-11-20 20:28:01.083556] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:56.089 20:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:56.089 20:28:01 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:56.089 20:28:01 -- host/digest.sh@54 -- # local rw bs qd 00:26:56.089 20:28:01 -- host/digest.sh@56 -- # rw=randread 00:26:56.089 20:28:01 -- host/digest.sh@56 -- # bs=4096 00:26:56.089 20:28:01 -- host/digest.sh@56 -- # qd=128 00:26:56.089 20:28:01 -- host/digest.sh@58 -- # bperfpid=3272364 00:26:56.089 20:28:01 -- host/digest.sh@60 -- # waitforlisten 3272364 /var/tmp/bperf.sock 00:26:56.090 20:28:01 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:56.090 20:28:01 -- common/autotest_common.sh@829 -- # '[' -z 3272364 ']' 00:26:56.090 20:28:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:56.090 20:28:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.090 20:28:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:56.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:56.090 20:28:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.090 20:28:01 -- common/autotest_common.sh@10 -- # set +x 00:26:56.349 [2024-11-20 20:28:01.127445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.349 [2024-11-20 20:28:01.127504] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272364 ] 00:26:56.349 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.349 [2024-11-20 20:28:01.188864] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.349 [2024-11-20 20:28:01.302953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.345 20:28:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.345 20:28:02 -- common/autotest_common.sh@862 -- # return 0 00:26:57.345 20:28:02 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:57.345 20:28:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:57.620 20:28:02 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:57.620 20:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.620 20:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:57.620 20:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.620 20:28:02 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.620 20:28:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.878 nvme0n1 00:26:57.878 20:28:02 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:57.878 20:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.878 20:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:57.878 20:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.878 20:28:02 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:57.878 20:28:02 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:58.136 Running I/O for 2 seconds... 00:26:58.136 [2024-11-20 20:28:02.979423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.136 [2024-11-20 20:28:02.979476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22290 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.136 [2024-11-20 20:28:02.979500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.136 [2024-11-20 20:28:02.996480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.136 [2024-11-20 20:28:02.996519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:23805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.136 [2024-11-20 20:28:02.996538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.136 [2024-11-20 20:28:03.013563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.136 [2024-11-20 20:28:03.013600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:4050 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.136 [2024-11-20 20:28:03.013619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.030616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.030650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:6758 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.030669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.047628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.047664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:23837 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.047683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.064761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.064796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8955 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.064815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.075825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.075860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:22910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.075879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.091849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.091884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:21526 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.091903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.109326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.109354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17165 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.109370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.126169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.126197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:23767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.126212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.143278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.143307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:15262 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.143323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.137 [2024-11-20 20:28:03.161045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.137 [2024-11-20 20:28:03.161088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:13273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.137 [2024-11-20 20:28:03.161123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.177958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.177992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.178011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.193579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.193627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:20442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.193647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.204884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.204919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:3584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.204937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.222262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.222290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:20334 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.222306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.239957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.239992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:12779 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.240018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.257118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.257163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9141 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.257180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.274298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.274328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8810 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.274343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.291085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.291130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.291146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.307940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.307975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.307994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.324986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.325020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16530 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.325039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.341783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.341816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:24201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.341835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.358553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.358588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.358607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.375178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.375206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:24506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.375221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.391918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.391953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.391971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.408721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.408755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20993 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.408774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.396 [2024-11-20 20:28:03.425306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.396 [2024-11-20 20:28:03.425333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:14351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.396 [2024-11-20 20:28:03.425348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.442477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.442512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:17497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.442532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.459678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.459713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:18448 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.459732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.476388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.476435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:98 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.476455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.493739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.493774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:19218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.493792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.510993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.511030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.511049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.527795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.527831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:22317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.527856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.545015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.545051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:23343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.545078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.562116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.562162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:13355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.562178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.578647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.578681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.578700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.595536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.595572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.595591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.612170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.612199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:20441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.612215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.629212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.629240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:4022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.629255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.645942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.645970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:21337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.645985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.662728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.662763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:24479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.662781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.656 [2024-11-20 20:28:03.680000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.656 [2024-11-20 20:28:03.680041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:25025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.656 [2024-11-20 20:28:03.680061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.697012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.697047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:3970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.697066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.713909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.713945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:7237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.713963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.730666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.730700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:4622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.730718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.747255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.747283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:22585 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.747298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.764092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.764136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24779 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.764152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.780454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.780489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:2114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.780508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.796926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.796961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:1733 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.796980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.813874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.813918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.813938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.830723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.830759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:25151 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.830777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.847770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.847805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22988 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.847824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.915 [2024-11-20 20:28:03.864520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.915 [2024-11-20 20:28:03.864547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.915 [2024-11-20 20:28:03.864562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.916 [2024-11-20 20:28:03.881122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.916 [2024-11-20 20:28:03.881150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:13263 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.916 [2024-11-20 20:28:03.881165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.916 [2024-11-20 20:28:03.898034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.916 [2024-11-20 20:28:03.898079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:18941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.916 [2024-11-20 20:28:03.898100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.916 [2024-11-20 20:28:03.914931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.916 [2024-11-20 20:28:03.914966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:20043 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.916 [2024-11-20 20:28:03.914984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.916 [2024-11-20 20:28:03.931809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.916 [2024-11-20 20:28:03.931844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:12298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.916 [2024-11-20 20:28:03.931863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.916 [2024-11-20 20:28:03.948721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:58.916 [2024-11-20 20:28:03.948756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23871 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.916 [2024-11-20 20:28:03.948775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:03.965910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:03.965944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:23440 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:03.965970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:03.983157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:03.983186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:21530 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:03.983201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.000512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.000546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:3380 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.000565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.017540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.017577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:7142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.017596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.035417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.035452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:15863 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.035471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.052013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.052047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:15488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.052065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.075672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.075707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:15836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.075726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.092748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.092776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18628 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.092791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.109607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.109641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17823 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.109660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.126302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.126335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:13754 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.126351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.143319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.143347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:2916 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.143379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.159576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.159611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:14539 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.159630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.176445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.176478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:13926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.176497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.193577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.193611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:21742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.193630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.174 [2024-11-20 20:28:04.209706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.174 [2024-11-20 20:28:04.209740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:15781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.174 [2024-11-20 20:28:04.209759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.226238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.226265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:23260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.226281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.243016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.243051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:20889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.243079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.259854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.259889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17464 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.259907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.276796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.276832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:17634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.276851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.293690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.293726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:10696 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.293744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.310864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.310899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13302 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.310917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.327539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.327573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:7328 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.327593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.344332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.344360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:6098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.344394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.361298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.361326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:4691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.361342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.378143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.378170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:1963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.378186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.395086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.395135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:1057 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.395151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.411972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.412007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:17818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.412033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.428695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.428729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.428748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.445661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.445695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:6739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.445714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.433 [2024-11-20 20:28:04.462437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.433 [2024-11-20 20:28:04.462483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:23459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.433 [2024-11-20 20:28:04.462502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.691 [2024-11-20 20:28:04.479809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.691 [2024-11-20 20:28:04.479844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.691 [2024-11-20 20:28:04.479863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.691 [2024-11-20 20:28:04.496767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.691 [2024-11-20 20:28:04.496802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.691 [2024-11-20 20:28:04.496821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.691 [2024-11-20 20:28:04.513530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.691 [2024-11-20 20:28:04.513566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:15102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.691 [2024-11-20 20:28:04.513585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.691 [2024-11-20 20:28:04.530523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.691 [2024-11-20 20:28:04.530559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:2305 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.691 [2024-11-20 20:28:04.530579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.547613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.547643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:3192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.547658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.564753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.564789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:8257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.564809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.582128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.582159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:20522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.582175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.598899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.598934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.598954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.615962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.615998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16393 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.616018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.632986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.633022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:1935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.633041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.649893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.649929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:3522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.649949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.666861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.666897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:7523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.666916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.684052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.684096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:1896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.684129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.701329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.701358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5971 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.701397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.692 [2024-11-20 20:28:04.718189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.692 [2024-11-20 20:28:04.718218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:7973 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.692 [2024-11-20 20:28:04.718234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.735153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.735183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25290 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.735199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.752195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.752225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7658 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.752240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.769212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.769242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23021 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.769258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.785959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.785995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:16672 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.786014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.802898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.802934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:8915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.802953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.820040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.820083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20309 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.820119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.836980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.837016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:15791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.837035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.853921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.853973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:13296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.853994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.871015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.871050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16902 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.871079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.888279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.888308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:2527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.888324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.905146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.905175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:2778 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.905191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.922095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.922144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:19781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.922160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.939226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.939255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:3549 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.939270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.951 [2024-11-20 20:28:04.956154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x947bb0) 00:26:59.951 [2024-11-20 20:28:04.956183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.951 [2024-11-20 20:28:04.956198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.209 00:27:00.209 Latency(us) 00:27:00.209 [2024-11-20T19:28:05.248Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.209 [2024-11-20T19:28:05.248Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:00.209 nvme0n1 : 2.05 14774.05 57.71 0.00 0.00 8486.07 3859.34 57477.50 00:27:00.209 [2024-11-20T19:28:05.248Z] =================================================================================================================== 00:27:00.209 [2024-11-20T19:28:05.248Z] Total : 14774.05 57.71 0.00 0.00 8486.07 3859.34 57477.50 00:27:00.209 0 00:27:00.209 20:28:05 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:00.209 20:28:05 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:00.209 20:28:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:00.209 20:28:05 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:00.209 | .driver_specific 00:27:00.209 | .nvme_error 00:27:00.209 | .status_code 00:27:00.209 | .command_transient_transport_error' 00:27:00.468 20:28:05 -- host/digest.sh@71 -- # (( 118 > 0 )) 00:27:00.468 20:28:05 -- host/digest.sh@73 -- # killprocess 3272364 00:27:00.468 20:28:05 -- common/autotest_common.sh@936 -- # '[' -z 3272364 ']' 00:27:00.468 20:28:05 -- common/autotest_common.sh@940 -- # kill -0 3272364 00:27:00.468 20:28:05 -- common/autotest_common.sh@941 -- # uname 00:27:00.468 20:28:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.468 20:28:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3272364 00:27:00.468 20:28:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:00.468 20:28:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:00.468 20:28:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3272364' 00:27:00.468 killing process with pid 3272364 00:27:00.468 20:28:05 -- common/autotest_common.sh@955 -- # kill 3272364 00:27:00.468 Received shutdown signal, test time was about 2.000000 seconds 00:27:00.468 00:27:00.468 Latency(us) 00:27:00.468 [2024-11-20T19:28:05.507Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.468 [2024-11-20T19:28:05.507Z] =================================================================================================================== 00:27:00.468 [2024-11-20T19:28:05.507Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:00.468 20:28:05 -- common/autotest_common.sh@960 -- # wait 3272364 00:27:00.726 20:28:05 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:00.726 20:28:05 -- host/digest.sh@54 -- # local rw bs qd 00:27:00.726 20:28:05 -- host/digest.sh@56 -- # rw=randread 00:27:00.726 20:28:05 -- host/digest.sh@56 -- # bs=131072 00:27:00.726 20:28:05 -- host/digest.sh@56 -- # qd=16 00:27:00.726 20:28:05 -- host/digest.sh@58 -- # bperfpid=3272926 00:27:00.726 20:28:05 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:00.726 20:28:05 -- host/digest.sh@60 -- # waitforlisten 3272926 /var/tmp/bperf.sock 00:27:00.726 20:28:05 -- common/autotest_common.sh@829 -- # '[' -z 3272926 ']' 00:27:00.726 20:28:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.726 20:28:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.726 20:28:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.726 20:28:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.726 20:28:05 -- common/autotest_common.sh@10 -- # set +x 00:27:00.726 [2024-11-20 20:28:05.650475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.726 [2024-11-20 20:28:05.650547] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272926 ] 00:27:00.726 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.726 Zero copy mechanism will not be used. 00:27:00.726 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.726 [2024-11-20 20:28:05.725138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.985 [2024-11-20 20:28:05.869443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:01.243 20:28:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:01.243 20:28:06 -- common/autotest_common.sh@862 -- # return 0 00:27:01.243 20:28:06 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:01.243 20:28:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:01.501 20:28:06 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:01.501 20:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.501 20:28:06 -- common/autotest_common.sh@10 -- # set +x 00:27:01.501 20:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.501 20:28:06 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.501 20:28:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.759 nvme0n1 00:27:01.759 20:28:06 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:01.759 20:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.759 20:28:06 -- common/autotest_common.sh@10 -- # set +x 00:27:01.759 20:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.759 20:28:06 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:01.759 20:28:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:02.017 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:02.017 Zero copy mechanism will not be used. 00:27:02.017 Running I/O for 2 seconds... 00:27:02.017 [2024-11-20 20:28:06.876674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.017 [2024-11-20 20:28:06.876735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.017 [2024-11-20 20:28:06.876759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.017 [2024-11-20 20:28:06.882869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.017 [2024-11-20 20:28:06.882908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.017 [2024-11-20 20:28:06.882928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.017 [2024-11-20 20:28:06.888522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.017 [2024-11-20 20:28:06.888558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.017 [2024-11-20 20:28:06.888577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.894736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.894771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.894792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.902135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.902182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.902199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.908903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.908938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.908959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.916532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.916567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.916601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.923879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.923914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.923933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.932184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.932215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.932231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.938663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.938707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.938730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.944920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.944955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.944974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.950629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.950664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.950683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.957278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.957324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.957343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.965185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.965217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.965235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.973697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.973733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.973752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.981422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.981464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.981484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.988767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.988804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.988823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:06.995865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:06.995901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:06.995920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:07.003279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:07.003312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:07.003330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:07.010305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:07.010335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:07.010351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:07.017161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:07.017213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:07.017230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:07.022805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.018 [2024-11-20 20:28:07.022839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.018 [2024-11-20 20:28:07.022858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.018 [2024-11-20 20:28:07.028499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.019 [2024-11-20 20:28:07.028544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.019 [2024-11-20 20:28:07.028566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.019 [2024-11-20 20:28:07.033687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.019 [2024-11-20 20:28:07.033721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.019 [2024-11-20 20:28:07.033740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.019 [2024-11-20 20:28:07.038592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.019 [2024-11-20 20:28:07.038629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.019 [2024-11-20 20:28:07.038648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.019 [2024-11-20 20:28:07.043374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.019 [2024-11-20 20:28:07.043408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.019 [2024-11-20 20:28:07.043428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.019 [2024-11-20 20:28:07.048682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.019 [2024-11-20 20:28:07.048717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.019 [2024-11-20 20:28:07.048735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.278 [2024-11-20 20:28:07.054643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.278 [2024-11-20 20:28:07.054678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.278 [2024-11-20 20:28:07.054696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.278 [2024-11-20 20:28:07.060811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.278 [2024-11-20 20:28:07.060844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.278 [2024-11-20 20:28:07.060863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.278 [2024-11-20 20:28:07.066362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.278 [2024-11-20 20:28:07.066413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.278 [2024-11-20 20:28:07.066441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.278 [2024-11-20 20:28:07.071845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.278 [2024-11-20 20:28:07.071887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.071907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.076961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.076995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.077015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.081892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.081932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.081953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.086604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.086637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.086656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.092067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.092128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.092146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.098177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.098208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.098224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.104276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.104307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.104324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.110611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.110645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.110665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.116791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.116825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.116843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.122777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.122811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.122829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.128697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.128730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.128748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.134646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.134680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.134698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.140650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.140685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.140704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.146555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.146590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.146609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.152581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.152615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.152634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.158559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.158593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.158612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.164562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.164595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.164613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.170503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.170537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.170556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.176588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.176621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.176639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.182735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.182774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.182799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.188593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.188627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.188645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.194698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.194731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.194751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.200620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.200655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.200674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.206574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.206608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.206627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.212523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.212556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.279 [2024-11-20 20:28:07.212575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.279 [2024-11-20 20:28:07.218689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.279 [2024-11-20 20:28:07.218724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.218743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.224661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.224695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.224713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.230557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.230591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.230610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.236509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.236549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.236569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.242440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.242474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.242493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.248375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.248408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.248426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.254242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.254272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.254288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.260244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.260274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.260291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.266443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.266477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.266496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.272350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.272398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.272417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.278587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.278622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.278646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.284493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.284527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.284546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.290442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.290476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.290495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.296633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.296673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.296692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.302629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.302667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.302686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.308623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.308658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.308677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.280 [2024-11-20 20:28:07.314614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.280 [2024-11-20 20:28:07.314650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.280 [2024-11-20 20:28:07.314668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.320505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.320539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.320558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.326481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.326515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.326533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.332499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.332533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.332552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.338458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.338496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.338521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.344439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.344473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.344491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.350547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.350587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.350606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.356448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.356482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.356501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.362402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.362451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.362471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.368362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.368407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.368427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.374225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.374256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.374272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.380292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.380323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.380339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.386330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.386378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.386397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.392290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.392326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.392344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.398309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.398349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.398366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.404381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.404417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.404437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.410241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.410272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.410288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.540 [2024-11-20 20:28:07.416238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.540 [2024-11-20 20:28:07.416269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.540 [2024-11-20 20:28:07.416286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.422388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.422436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.422455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.428386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.428420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.428439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.434602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.434636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.434655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.440595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.440629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.440654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.446638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.446671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.446690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.452613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.452647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.452666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.458799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.458834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.458853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.464738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.464772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.464790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.470673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.470707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.470727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.476759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.476793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.476811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.482945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.482980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.483003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.489216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.489248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.489264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.495358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.495412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.495433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.501499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.501534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.501554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.507435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.507469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.507488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.513354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.513398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.513417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.519349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.519380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.519411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.525193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.525224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.525242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.530296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.530326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.530343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.535299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.535330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.535347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.538749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.538782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.538801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.544163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.544197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.544214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.549832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.549867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.541 [2024-11-20 20:28:07.549886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.541 [2024-11-20 20:28:07.555711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.541 [2024-11-20 20:28:07.555745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.542 [2024-11-20 20:28:07.555765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.542 [2024-11-20 20:28:07.561846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.542 [2024-11-20 20:28:07.561880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.542 [2024-11-20 20:28:07.561899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.542 [2024-11-20 20:28:07.567848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.542 [2024-11-20 20:28:07.567882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.542 [2024-11-20 20:28:07.567901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.542 [2024-11-20 20:28:07.573708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.542 [2024-11-20 20:28:07.573741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.542 [2024-11-20 20:28:07.573760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.801 [2024-11-20 20:28:07.579799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.801 [2024-11-20 20:28:07.579845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.801 [2024-11-20 20:28:07.579862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.801 [2024-11-20 20:28:07.585715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.801 [2024-11-20 20:28:07.585749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.801 [2024-11-20 20:28:07.585769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.801 [2024-11-20 20:28:07.591608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.801 [2024-11-20 20:28:07.591641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.801 [2024-11-20 20:28:07.591666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.801 [2024-11-20 20:28:07.597457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.801 [2024-11-20 20:28:07.597491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.597510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.603292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.603321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.603337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.609355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.609385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.609416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.615526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.615559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.615577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.621511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.621544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.621563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.627684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.627718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.627737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.633714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.633748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.633768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.639578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.639610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.639626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.645693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.645735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.645756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.651859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.651892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.651911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.657851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.657884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.657902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.663929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.663961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.663980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.669998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.670030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.670049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.675888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.675920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.675939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.681943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.681975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.681994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.687790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.687823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.687841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.693884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.693917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.693936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.699854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.699887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.699906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.705964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.705998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.706016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.711921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.711955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.711973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.718155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.718185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.718203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.724365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.724413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.724431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.730488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.730521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.730540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.736568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.802 [2024-11-20 20:28:07.736601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.802 [2024-11-20 20:28:07.736619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.802 [2024-11-20 20:28:07.742536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.742570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.742588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.748531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.748562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.748587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.754576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.754608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.754626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.760567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.760599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.760618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.766487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.766520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.766539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.772433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.772466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.772485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.778454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.778493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.778513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.784737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.784772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.784791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.790648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.790682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.790700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.796557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.796591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.796610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.802451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.802492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.802511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.808503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.808536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.808554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.814566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.814598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.814616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.820604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.820636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.820655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.826588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.826621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.826640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.803 [2024-11-20 20:28:07.832690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:02.803 [2024-11-20 20:28:07.832724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.803 [2024-11-20 20:28:07.832743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.838586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.838620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.838639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.844848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.844881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.844900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.850992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.851024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.851043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.856891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.856924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.856942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.862913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.862946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.862965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.869050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.869100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.869147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.874954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.874987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.875006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.880980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.881012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.881031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.886991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.887025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.887043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.892954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.892987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.893005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.898980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.899014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.899032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.904898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.904935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.904955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.911019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.911052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.911081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.916926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.064 [2024-11-20 20:28:07.916959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.064 [2024-11-20 20:28:07.916977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.064 [2024-11-20 20:28:07.922931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.922963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.922981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.928863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.928895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.928914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.934931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.934964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.934982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.940879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.940912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.940930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.946968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.947001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.947020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.952951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.952984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.953003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.959009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.959042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.959060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.964870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.964903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.964921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.970936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.970968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.970986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.976985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.977017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.977036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.983123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.983152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.983168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.988976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.989008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.989026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:07.994832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:07.994864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:07.994883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.000850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.000883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.000902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.006937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.006971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.006996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.012710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.012744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.012762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.018545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.018579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.018597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.024587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.024621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.024639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.030661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.030693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.030711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.036656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.036690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.036708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.065 [2024-11-20 20:28:08.042555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.065 [2024-11-20 20:28:08.042589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.065 [2024-11-20 20:28:08.042607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.048532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.048565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.048583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.054541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.054574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.054592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.060513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.060554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.060574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.066514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.066547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.066565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.072568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.072601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.072620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.078525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.078558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.078576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.084655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.084688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.084707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.090800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.090833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.090851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.066 [2024-11-20 20:28:08.096929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.066 [2024-11-20 20:28:08.096963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.066 [2024-11-20 20:28:08.096981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.102920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.102954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.102973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.108877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.108910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.108928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.114745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.114780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.114799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.120708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.120742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.120761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.126729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.126762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.126781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.132686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.132719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.132737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.138664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.138698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.138716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.326 [2024-11-20 20:28:08.144655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.326 [2024-11-20 20:28:08.144689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.326 [2024-11-20 20:28:08.144708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.150660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.150694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.150713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.157600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.157636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.157659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.162844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.162888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.162913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.168849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.168884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.168903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.174768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.174801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.174821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.180850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.180883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.180902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.186688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.186721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.186739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.192760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.192793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.192812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.198697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.198730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.198748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.204690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.204723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.204741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.210642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.210675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.210693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.216634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.216667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.216686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.222568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.222601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.222620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.228711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.228745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.228764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.234637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.234671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.234689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.240689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.240723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.240741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.246751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.246784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.246804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.252573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.252606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.252624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.258547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.258581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.258599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.264659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.264693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.264718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.270647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.270681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.270699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.276739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.276772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.327 [2024-11-20 20:28:08.276791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.327 [2024-11-20 20:28:08.282585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.327 [2024-11-20 20:28:08.282618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.282636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.288619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.288652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.288670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.294435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.294468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.294487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.300537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.300570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.300589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.306574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.306607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.306626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.312578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.312611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.312631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.318580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.318619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.318638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.324590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.324623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.324642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.330559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.330591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.330609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.336559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.336593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.336611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.342542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.342575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.342593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.348451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.348484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.348503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.354516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.354549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.354568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.328 [2024-11-20 20:28:08.360639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.328 [2024-11-20 20:28:08.360672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.328 [2024-11-20 20:28:08.360690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.588 [2024-11-20 20:28:08.366700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.366735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.366754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.372616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.372649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.372667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.378607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.378640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.378659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.384700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.384733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.384753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.390823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.390857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.390876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.396716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.396749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.396768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.402732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.402765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.402784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.408791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.408825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.408843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.414774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.414807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.414826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.420670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.420712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.420732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.426619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.426653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.426672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.432796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.432830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.432848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.438845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.438878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.438897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.444996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.445030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.445048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.451128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.451158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.451175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.456945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.456979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.456998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.462857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.462892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.462910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.468620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.468655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.468674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.474616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.474647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.474663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.480649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.480683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.480701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.589 [2024-11-20 20:28:08.486828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.589 [2024-11-20 20:28:08.486863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.589 [2024-11-20 20:28:08.486882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.492837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.492871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.492891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.498930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.498962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.498980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.504931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.504965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.504983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.510934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.510974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.510994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.516894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.516928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.516947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.522892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.522926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.522951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.528941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.528976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.528996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.534900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.534934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.534953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.540917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.540951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.540969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.546860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.546893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.546911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.552792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.552826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.552845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.558834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.558868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.558888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.564814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.564848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.564868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.570734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.570768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.570786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.576775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.576815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.576835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.582738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.582771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.582790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.588753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.588785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.588804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.594698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.594731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.594749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.600677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.600722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.600741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.606570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.606603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.606621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.612603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.612636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.612654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.590 [2024-11-20 20:28:08.618615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.590 [2024-11-20 20:28:08.618649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.590 [2024-11-20 20:28:08.618667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.625041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.625085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.625107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.630932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.630965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.630983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.636960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.636993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.637012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.643046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.643091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.643119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.648865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.648898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.648917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.654882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.654916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.654935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.660778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.660810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.660829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.666679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.666712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.666732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.672620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.672654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.672672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.678722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.678762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.678781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.684814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.684847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.684865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.690959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.690993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.691012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.696937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.696971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.696989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.702935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.702969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.702987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.852 [2024-11-20 20:28:08.708922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.852 [2024-11-20 20:28:08.708955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.852 [2024-11-20 20:28:08.708974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.714849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.714882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.714900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.720874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.720906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.720925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.726910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.726943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.726961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.732751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.732785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.732803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.738767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.738799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.738818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.744982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.745016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.745035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.750994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.751027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.751046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.757420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.757454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.757474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.763492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.763525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.763544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.769527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.769560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.769579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.775661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.775695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.775714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.781609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.781642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.781668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.787518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.787551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.787569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.793718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.793751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.793770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.799624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.799658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.799677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.805799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.805833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.805853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.811875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.811908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.811926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.817999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.818031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.818049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.824155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.824184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.824200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.830034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.830078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.830122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.836063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.836123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.836141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.842197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.842227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.842244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.848146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.848175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.848191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.854180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.854209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.854225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.853 [2024-11-20 20:28:08.860382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.853 [2024-11-20 20:28:08.860431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.853 [2024-11-20 20:28:08.860449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.854 [2024-11-20 20:28:08.866280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12b3cd0) 00:27:03.854 [2024-11-20 20:28:08.866310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.854 [2024-11-20 20:28:08.866327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.854 00:27:03.854 Latency(us) 00:27:03.854 [2024-11-20T19:28:08.893Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.854 [2024-11-20T19:28:08.893Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:03.854 nvme0n1 : 2.00 5133.67 641.71 0.00 0.00 3112.45 928.43 10971.21 00:27:03.854 [2024-11-20T19:28:08.893Z] =================================================================================================================== 00:27:03.854 [2024-11-20T19:28:08.893Z] Total : 5133.67 641.71 0.00 0.00 3112.45 928.43 10971.21 00:27:03.854 0 00:27:03.854 20:28:08 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:03.854 20:28:08 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:03.854 20:28:08 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:03.854 | .driver_specific 00:27:03.854 | .nvme_error 00:27:03.854 | .status_code 00:27:03.854 | .command_transient_transport_error' 00:27:03.854 20:28:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:04.113 20:28:09 -- host/digest.sh@71 -- # (( 331 > 0 )) 00:27:04.113 20:28:09 -- host/digest.sh@73 -- # killprocess 3272926 00:27:04.113 20:28:09 -- common/autotest_common.sh@936 -- # '[' -z 3272926 ']' 00:27:04.113 20:28:09 -- common/autotest_common.sh@940 -- # kill -0 3272926 00:27:04.113 20:28:09 -- common/autotest_common.sh@941 -- # uname 00:27:04.371 20:28:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:04.371 20:28:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3272926 00:27:04.371 20:28:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:04.371 20:28:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:04.371 20:28:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3272926' 00:27:04.371 killing process with pid 3272926 00:27:04.371 20:28:09 -- common/autotest_common.sh@955 -- # kill 3272926 00:27:04.371 Received shutdown signal, test time was about 2.000000 seconds 00:27:04.371 00:27:04.371 Latency(us) 00:27:04.371 [2024-11-20T19:28:09.410Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.371 [2024-11-20T19:28:09.410Z] =================================================================================================================== 00:27:04.371 [2024-11-20T19:28:09.410Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:04.371 20:28:09 -- common/autotest_common.sh@960 -- # wait 3272926 00:27:04.630 20:28:09 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:04.630 20:28:09 -- host/digest.sh@54 -- # local rw bs qd 00:27:04.630 20:28:09 -- host/digest.sh@56 -- # rw=randwrite 00:27:04.630 20:28:09 -- host/digest.sh@56 -- # bs=4096 00:27:04.630 20:28:09 -- host/digest.sh@56 -- # qd=128 00:27:04.630 20:28:09 -- host/digest.sh@58 -- # bperfpid=3273350 00:27:04.630 20:28:09 -- host/digest.sh@60 -- # waitforlisten 3273350 /var/tmp/bperf.sock 00:27:04.630 20:28:09 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:04.630 20:28:09 -- common/autotest_common.sh@829 -- # '[' -z 3273350 ']' 00:27:04.630 20:28:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:04.630 20:28:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:04.630 20:28:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:04.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:04.630 20:28:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:04.630 20:28:09 -- common/autotest_common.sh@10 -- # set +x 00:27:04.630 [2024-11-20 20:28:09.495241] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:04.630 [2024-11-20 20:28:09.495316] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273350 ] 00:27:04.630 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.630 [2024-11-20 20:28:09.552341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.630 [2024-11-20 20:28:09.661838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:05.560 20:28:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:05.560 20:28:10 -- common/autotest_common.sh@862 -- # return 0 00:27:05.560 20:28:10 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.560 20:28:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.817 20:28:10 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:05.817 20:28:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:05.817 20:28:10 -- common/autotest_common.sh@10 -- # set +x 00:27:05.817 20:28:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:05.817 20:28:10 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:05.817 20:28:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.075 nvme0n1 00:27:06.075 20:28:11 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:06.075 20:28:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.075 20:28:11 -- common/autotest_common.sh@10 -- # set +x 00:27:06.075 20:28:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.075 20:28:11 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:06.075 20:28:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:06.333 Running I/O for 2 seconds... 00:27:06.333 [2024-11-20 20:28:11.195551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eea00 00:27:06.333 [2024-11-20 20:28:11.196966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:16785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.197012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.208657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ea680 00:27:06.333 [2024-11-20 20:28:11.209490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.209523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.222554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ec840 00:27:06.333 [2024-11-20 20:28:11.223902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:11317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.223936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.233436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f4f40 00:27:06.333 [2024-11-20 20:28:11.233806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:13098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.233839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.245856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f2948 00:27:06.333 [2024-11-20 20:28:11.246160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:16047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.246209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.260164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f7100 00:27:06.333 [2024-11-20 20:28:11.261975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7645 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.262019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.272483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190df118 00:27:06.333 [2024-11-20 20:28:11.274346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.274375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.284827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ee5c8 00:27:06.333 [2024-11-20 20:28:11.286714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:16361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.286744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:06.333 [2024-11-20 20:28:11.297127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e5ec8 00:27:06.333 [2024-11-20 20:28:11.298977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:9116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.333 [2024-11-20 20:28:11.299007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:06.334 [2024-11-20 20:28:11.308188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f7100 00:27:06.334 [2024-11-20 20:28:11.309231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:12255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.334 [2024-11-20 20:28:11.309258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:06.334 [2024-11-20 20:28:11.320450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f7100 00:27:06.334 [2024-11-20 20:28:11.321914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:1245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.334 [2024-11-20 20:28:11.321947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:06.334 [2024-11-20 20:28:11.332701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f7100 00:27:06.334 [2024-11-20 20:28:11.334262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:20167 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.334 [2024-11-20 20:28:11.334289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:06.334 [2024-11-20 20:28:11.344891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f0ff8 00:27:06.334 [2024-11-20 20:28:11.346540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.334 [2024-11-20 20:28:11.346574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:06.334 [2024-11-20 20:28:11.357255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f4298 00:27:06.334 [2024-11-20 20:28:11.358966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.334 [2024-11-20 20:28:11.358999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:06.334 [2024-11-20 20:28:11.368844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eb760 00:27:06.334 [2024-11-20 20:28:11.369011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:7343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.334 [2024-11-20 20:28:11.369043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:27:06.592 [2024-11-20 20:28:11.381376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f6458 00:27:06.592 [2024-11-20 20:28:11.381731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:24835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.592 [2024-11-20 20:28:11.381764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:06.592 [2024-11-20 20:28:11.395773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e12d8 00:27:06.592 [2024-11-20 20:28:11.397572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:13883 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.592 [2024-11-20 20:28:11.397612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.592 [2024-11-20 20:28:11.408037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ed4e8 00:27:06.592 [2024-11-20 20:28:11.409861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.592 [2024-11-20 20:28:11.409894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:06.592 [2024-11-20 20:28:11.420298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f57b0 00:27:06.592 [2024-11-20 20:28:11.422130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:9524 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.592 [2024-11-20 20:28:11.422163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:06.592 [2024-11-20 20:28:11.432588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ec408 00:27:06.593 [2024-11-20 20:28:11.434461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:13643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.434494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.444848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eaab8 00:27:06.593 [2024-11-20 20:28:11.446723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:5103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.446752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.456856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f5be8 00:27:06.593 [2024-11-20 20:28:11.457857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.457890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.469251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f0788 00:27:06.593 [2024-11-20 20:28:11.470807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:11163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.470855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.481510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fef90 00:27:06.593 [2024-11-20 20:28:11.482530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:20922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.482567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.493700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190de038 00:27:06.593 [2024-11-20 20:28:11.495411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:14713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.495444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.506901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e12d8 00:27:06.593 [2024-11-20 20:28:11.508738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.508768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.517794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eb328 00:27:06.593 [2024-11-20 20:28:11.518769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:23303 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.518802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.529938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f6cc8 00:27:06.593 [2024-11-20 20:28:11.531357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:6624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.531402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.542814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190df550 00:27:06.593 [2024-11-20 20:28:11.544745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:14643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.544778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.553850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eaab8 00:27:06.593 [2024-11-20 20:28:11.554861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.554895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.566206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190de038 00:27:06.593 [2024-11-20 20:28:11.567231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:4745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.567259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.578504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e5a90 00:27:06.593 [2024-11-20 20:28:11.579555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:23739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.579605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.590730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190feb58 00:27:06.593 [2024-11-20 20:28:11.591801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:3173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.591853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0038 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.603415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e1b48 00:27:06.593 [2024-11-20 20:28:11.604132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:17229 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.604177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:06.593 [2024-11-20 20:28:11.615723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e5ec8 00:27:06.593 [2024-11-20 20:28:11.616171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:4897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.593 [2024-11-20 20:28:11.616213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.629510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f1ca0 00:27:06.852 [2024-11-20 20:28:11.630777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:12982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.630810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.642646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f4b08 00:27:06.852 [2024-11-20 20:28:11.644024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.644066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.653326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fbcf0 00:27:06.852 [2024-11-20 20:28:11.654537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:1689 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.654569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.665884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f5378 00:27:06.852 [2024-11-20 20:28:11.666660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:451 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.666693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.677904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e1710 00:27:06.852 [2024-11-20 20:28:11.679568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:21425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.679601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.690451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e23b8 00:27:06.852 [2024-11-20 20:28:11.691344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.691370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.702587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ed0b0 00:27:06.852 [2024-11-20 20:28:11.704283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.704313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:06.852 [2024-11-20 20:28:11.714683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f2948 00:27:06.852 [2024-11-20 20:28:11.715743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:24911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.852 [2024-11-20 20:28:11.715782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.728043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e49b0 00:27:06.853 [2024-11-20 20:28:11.728539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19703 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.728571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.740602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e3060 00:27:06.853 [2024-11-20 20:28:11.741305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:2493 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.741333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.752311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e73e0 00:27:06.853 [2024-11-20 20:28:11.753232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:17213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.753261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.764997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f3e60 00:27:06.853 [2024-11-20 20:28:11.765520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:23703 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.765553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.777497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e23b8 00:27:06.853 [2024-11-20 20:28:11.777970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.778002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.789879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190edd58 00:27:06.853 [2024-11-20 20:28:11.790338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.790367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.802085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f6020 00:27:06.853 [2024-11-20 20:28:11.802485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:9105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.802523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.814469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e8d30 00:27:06.853 [2024-11-20 20:28:11.814899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.814931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.826604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190dfdc0 00:27:06.853 [2024-11-20 20:28:11.827128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:24782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.827157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.838910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e1f80 00:27:06.853 [2024-11-20 20:28:11.839499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:14108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.839542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.851110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fbcf0 00:27:06.853 [2024-11-20 20:28:11.852614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:2715 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.852644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.863415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e8d30 00:27:06.853 [2024-11-20 20:28:11.864623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:9552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.864656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:06.853 [2024-11-20 20:28:11.877203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:06.853 [2024-11-20 20:28:11.877901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:4906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.853 [2024-11-20 20:28:11.877932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:07.113 [2024-11-20 20:28:11.889930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eaef0 00:27:07.113 [2024-11-20 20:28:11.891290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.113 [2024-11-20 20:28:11.891320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:07.113 [2024-11-20 20:28:11.900247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e01f8 00:27:07.113 [2024-11-20 20:28:11.900525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:14836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.900557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0035 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.913005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fe720 00:27:07.114 [2024-11-20 20:28:11.913988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:7701 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.914021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.925374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f20d8 00:27:07.114 [2024-11-20 20:28:11.927000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:20840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.927034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.937781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e5a90 00:27:07.114 [2024-11-20 20:28:11.939154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.939181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.950254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e6b70 00:27:07.114 [2024-11-20 20:28:11.950839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:11166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.950871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.963743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e5a90 00:27:07.114 [2024-11-20 20:28:11.964502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:8508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.964533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.975097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e9e10 00:27:07.114 [2024-11-20 20:28:11.976622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.976655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:11.988347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.114 [2024-11-20 20:28:11.989191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:11.989218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.000493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f8a50 00:27:07.114 [2024-11-20 20:28:12.001248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:15378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.001276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.012700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190eee38 00:27:07.114 [2024-11-20 20:28:12.013440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:6981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.013473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.024911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f81e0 00:27:07.114 [2024-11-20 20:28:12.025590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:8433 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.025627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.037244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190dece0 00:27:07.114 [2024-11-20 20:28:12.037902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:8649 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.037942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.049404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ebfd0 00:27:07.114 [2024-11-20 20:28:12.050162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.050192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.061587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fcdd0 00:27:07.114 [2024-11-20 20:28:12.062354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:14500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.062387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.073750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ef6a8 00:27:07.114 [2024-11-20 20:28:12.074563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:4487 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.074595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.085826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f2948 00:27:07.114 [2024-11-20 20:28:12.087642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6844 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.087674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.098174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f9b30 00:27:07.114 [2024-11-20 20:28:12.099584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:858 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.099617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.110615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e1b48 00:27:07.114 [2024-11-20 20:28:12.112083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:11192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.112119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.123167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0ea0 00:27:07.114 [2024-11-20 20:28:12.124600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:3221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.124633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.134879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f2d80 00:27:07.114 [2024-11-20 20:28:12.136081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:21296 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.136110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:07.114 [2024-11-20 20:28:12.147442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fbcf0 00:27:07.114 [2024-11-20 20:28:12.148346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:1352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.114 [2024-11-20 20:28:12.148379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.160983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fa7d8 00:27:07.375 [2024-11-20 20:28:12.162521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:22230 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.162553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.173618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fd208 00:27:07.375 [2024-11-20 20:28:12.174863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:7769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.174895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.186224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fd208 00:27:07.375 [2024-11-20 20:28:12.187715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:22446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.187748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.199353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fcdd0 00:27:07.375 [2024-11-20 20:28:12.201317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.201347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.210130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f3a28 00:27:07.375 [2024-11-20 20:28:12.211515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:7740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.211548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.222822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f3e60 00:27:07.375 [2024-11-20 20:28:12.224318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:22656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.224352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.235272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f3e60 00:27:07.375 [2024-11-20 20:28:12.236840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:6577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.236873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.247568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e99d8 00:27:07.375 [2024-11-20 20:28:12.248731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:3782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.248764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.258768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e88f8 00:27:07.375 [2024-11-20 20:28:12.260028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:13853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.260061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.274138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e7818 00:27:07.375 [2024-11-20 20:28:12.275246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:12328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.275273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.285006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190f7da8 00:27:07.375 [2024-11-20 20:28:12.286348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:19873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.286398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.297406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e1f80 00:27:07.375 [2024-11-20 20:28:12.298501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:8720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.298534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.309319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190ec840 00:27:07.375 [2024-11-20 20:28:12.311290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.311332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.320207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e8088 00:27:07.375 [2024-11-20 20:28:12.321062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:2014 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.321105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.333386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e8088 00:27:07.375 [2024-11-20 20:28:12.334821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:3287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.375 [2024-11-20 20:28:12.334850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:07.375 [2024-11-20 20:28:12.345861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0ea0 00:27:07.376 [2024-11-20 20:28:12.346795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.376 [2024-11-20 20:28:12.346827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.376 [2024-11-20 20:28:12.358146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190fe2e8 00:27:07.376 [2024-11-20 20:28:12.358751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:8133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.376 [2024-11-20 20:28:12.358783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.376 [2024-11-20 20:28:12.370535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.376 [2024-11-20 20:28:12.371651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:4512 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.376 [2024-11-20 20:28:12.371684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.376 [2024-11-20 20:28:12.384325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.376 [2024-11-20 20:28:12.384611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:18335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.376 [2024-11-20 20:28:12.384643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.376 [2024-11-20 20:28:12.398004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.376 [2024-11-20 20:28:12.398343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:3927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.376 [2024-11-20 20:28:12.398390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.376 [2024-11-20 20:28:12.411649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.411922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:16288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.411957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.425364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.425648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:24795 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.425680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.439161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.439450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:5937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.439482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.452869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.453163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19886 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.453207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.466630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.466907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:18459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.466939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.480501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.480778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:19565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.480817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.494145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.494493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:13239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.494525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.507879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.508191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:12662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.508220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.521568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.521845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:11033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.521876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.535291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.535577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:3234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.535608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.548922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.549221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:10825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.549250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.562672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.562952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.562983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.576333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.576621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:2667 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.576653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.590019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.590292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:13627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.590335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.603681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.603963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3826 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.603994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.617478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.617759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:10456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.617790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.631182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.631536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:7634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.631568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.644911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.645215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:4961 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.645244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.658602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.636 [2024-11-20 20:28:12.658881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:15020 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.636 [2024-11-20 20:28:12.658913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.636 [2024-11-20 20:28:12.672283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.672575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:20560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.672609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.685967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.686265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.686294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.699666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.699945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.699978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.713463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.713742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1375 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.713775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.727083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.727452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:12524 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.727480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.740868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.741179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:24982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.741208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.754624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.754904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:24643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.754936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.768409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.768689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.768721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.782177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.782490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:13235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.782522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.795949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.796230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:19751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.796258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.809637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.809911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:23177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.809943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.823310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.823586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:18951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.823617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.837062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.837450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:26 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.897 [2024-11-20 20:28:12.837489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.897 [2024-11-20 20:28:12.850860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.897 [2024-11-20 20:28:12.851158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:11058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.851187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.898 [2024-11-20 20:28:12.864544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.898 [2024-11-20 20:28:12.864795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:16756 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.864826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.898 [2024-11-20 20:28:12.878302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.898 [2024-11-20 20:28:12.878582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:17536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.878614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.898 [2024-11-20 20:28:12.891977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.898 [2024-11-20 20:28:12.892289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:8712 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.892318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.898 [2024-11-20 20:28:12.905736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.898 [2024-11-20 20:28:12.906015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:14122 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.906048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.898 [2024-11-20 20:28:12.919511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.898 [2024-11-20 20:28:12.919788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:8034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.919820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:07.898 [2024-11-20 20:28:12.933169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:07.898 [2024-11-20 20:28:12.933454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:24312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.898 [2024-11-20 20:28:12.933486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.156 [2024-11-20 20:28:12.946786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.156 [2024-11-20 20:28:12.947030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:17361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.156 [2024-11-20 20:28:12.947062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.156 [2024-11-20 20:28:12.960337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.156 [2024-11-20 20:28:12.960649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:5745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.156 [2024-11-20 20:28:12.960680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.156 [2024-11-20 20:28:12.973877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.156 [2024-11-20 20:28:12.974144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.156 [2024-11-20 20:28:12.974172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.156 [2024-11-20 20:28:12.987504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.156 [2024-11-20 20:28:12.987784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.156 [2024-11-20 20:28:12.987816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.156 [2024-11-20 20:28:13.001195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.001465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:17467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.001491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.014781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.015063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.015119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.028325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.028624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:8939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.028656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.042095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.042372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:21822 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.042401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.055846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.056144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:10364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.056188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.069510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.069786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:9759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.069817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.083186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.083452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:3186 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.083484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.096840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.097145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:270 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.097187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.110576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.110853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:21049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.110885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.124299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.124597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:4346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.124629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.137996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.138270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:3281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.138312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.151736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.151987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:7395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.152018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.165437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.165716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:7559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.165747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 [2024-11-20 20:28:13.179124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111ad0) with pdu=0x2000190e0630 00:27:08.157 [2024-11-20 20:28:13.179491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:17417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.157 [2024-11-20 20:28:13.179523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.157 00:27:08.157 Latency(us) 00:27:08.157 [2024-11-20T19:28:13.196Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.157 [2024-11-20T19:28:13.196Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:08.157 nvme0n1 : 2.01 19783.68 77.28 0.00 0.00 6456.03 2609.30 15534.46 00:27:08.157 [2024-11-20T19:28:13.196Z] =================================================================================================================== 00:27:08.157 [2024-11-20T19:28:13.196Z] Total : 19783.68 77.28 0.00 0.00 6456.03 2609.30 15534.46 00:27:08.157 0 00:27:08.414 20:28:13 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:08.414 20:28:13 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:08.414 20:28:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:08.414 20:28:13 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:08.414 | .driver_specific 00:27:08.414 | .nvme_error 00:27:08.414 | .status_code 00:27:08.414 | .command_transient_transport_error' 00:27:08.414 20:28:13 -- host/digest.sh@71 -- # (( 155 > 0 )) 00:27:08.414 20:28:13 -- host/digest.sh@73 -- # killprocess 3273350 00:27:08.414 20:28:13 -- common/autotest_common.sh@936 -- # '[' -z 3273350 ']' 00:27:08.414 20:28:13 -- common/autotest_common.sh@940 -- # kill -0 3273350 00:27:08.414 20:28:13 -- common/autotest_common.sh@941 -- # uname 00:27:08.671 20:28:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:08.671 20:28:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3273350 00:27:08.671 20:28:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:08.671 20:28:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:08.671 20:28:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3273350' 00:27:08.671 killing process with pid 3273350 00:27:08.671 20:28:13 -- common/autotest_common.sh@955 -- # kill 3273350 00:27:08.671 Received shutdown signal, test time was about 2.000000 seconds 00:27:08.671 00:27:08.671 Latency(us) 00:27:08.671 [2024-11-20T19:28:13.710Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.671 [2024-11-20T19:28:13.710Z] =================================================================================================================== 00:27:08.671 [2024-11-20T19:28:13.710Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:08.671 20:28:13 -- common/autotest_common.sh@960 -- # wait 3273350 00:27:08.929 20:28:13 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:08.929 20:28:13 -- host/digest.sh@54 -- # local rw bs qd 00:27:08.929 20:28:13 -- host/digest.sh@56 -- # rw=randwrite 00:27:08.929 20:28:13 -- host/digest.sh@56 -- # bs=131072 00:27:08.929 20:28:13 -- host/digest.sh@56 -- # qd=16 00:27:08.929 20:28:13 -- host/digest.sh@58 -- # bperfpid=3273900 00:27:08.929 20:28:13 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:08.929 20:28:13 -- host/digest.sh@60 -- # waitforlisten 3273900 /var/tmp/bperf.sock 00:27:08.929 20:28:13 -- common/autotest_common.sh@829 -- # '[' -z 3273900 ']' 00:27:08.929 20:28:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:08.929 20:28:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.929 20:28:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:08.929 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:08.929 20:28:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.929 20:28:13 -- common/autotest_common.sh@10 -- # set +x 00:27:08.929 [2024-11-20 20:28:13.777189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:08.929 [2024-11-20 20:28:13.777262] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273900 ] 00:27:08.929 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:08.929 Zero copy mechanism will not be used. 00:27:08.929 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.929 [2024-11-20 20:28:13.837649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.929 [2024-11-20 20:28:13.951010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:09.865 20:28:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:09.865 20:28:14 -- common/autotest_common.sh@862 -- # return 0 00:27:09.865 20:28:14 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:09.865 20:28:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.123 20:28:15 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:10.123 20:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.123 20:28:15 -- common/autotest_common.sh@10 -- # set +x 00:27:10.123 20:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.123 20:28:15 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.123 20:28:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.694 nvme0n1 00:27:10.694 20:28:15 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:10.694 20:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.694 20:28:15 -- common/autotest_common.sh@10 -- # set +x 00:27:10.694 20:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.694 20:28:15 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:10.694 20:28:15 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:10.694 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:10.694 Zero copy mechanism will not be used. 00:27:10.694 Running I/O for 2 seconds... 00:27:10.694 [2024-11-20 20:28:15.687646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.694 [2024-11-20 20:28:15.688011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.694 [2024-11-20 20:28:15.688052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.694 [2024-11-20 20:28:15.693919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.694 [2024-11-20 20:28:15.694180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.694 [2024-11-20 20:28:15.694213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.694 [2024-11-20 20:28:15.700298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.694 [2024-11-20 20:28:15.700551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.694 [2024-11-20 20:28:15.700592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.694 [2024-11-20 20:28:15.707287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.694 [2024-11-20 20:28:15.707453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.694 [2024-11-20 20:28:15.707482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.694 [2024-11-20 20:28:15.714483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.695 [2024-11-20 20:28:15.714720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.695 [2024-11-20 20:28:15.714758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.695 [2024-11-20 20:28:15.721594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.695 [2024-11-20 20:28:15.721834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.695 [2024-11-20 20:28:15.721867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.695 [2024-11-20 20:28:15.728869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.695 [2024-11-20 20:28:15.729117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.695 [2024-11-20 20:28:15.729164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.956 [2024-11-20 20:28:15.736517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.736840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.736873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.743689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.743896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.743925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.750937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.751140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.751172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.758157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.758298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.758327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.765171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.765399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.765431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.772202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.772355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.772401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.779162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.779324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.779352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.785541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.785866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.785899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.792367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.792694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.792727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.799518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.799736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.799769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.805982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.806148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.806179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.811626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.811819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.811856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.817795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.818028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.818061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.824467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.824591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.824623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.831380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.831493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.831525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.838143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.838304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.838338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.844913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.845078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.845118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.851748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.851927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.851960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.858865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.859039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.859080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.866441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.866600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.866632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.873340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.873566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.873602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.879560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.879728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.879764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.884518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.884702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.884735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.889306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.889455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.889495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.894453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.894632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.894671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.899657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.899823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.957 [2024-11-20 20:28:15.899856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.957 [2024-11-20 20:28:15.905311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.957 [2024-11-20 20:28:15.905497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.905531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.909859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.909981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.910020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.914397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.914569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.914605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.919260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.919479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.919515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.925836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.926118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.926155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.932147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.932402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.932434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.938186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.938401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.938434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.944426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.944610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.944643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.950699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.950783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.950815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.956917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.957087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.957120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.963244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.963332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.963359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.969467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.969602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.969636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.975630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.975768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.975796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.981927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.982211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.982239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.958 [2024-11-20 20:28:15.988584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:10.958 [2024-11-20 20:28:15.988832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.958 [2024-11-20 20:28:15.988876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:15.995694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:15.995835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:15.995867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.002008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.002158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.002186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.008310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.008441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.008489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.014717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.014815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.014851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.020931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.021165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.021194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.027059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.027294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.027323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.033257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.033507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.033540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.039464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.039682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.039716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.045922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.046011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.046037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.052251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.052368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.052415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.058691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.058810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.058842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.064884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.064990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.065021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.071185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.071300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.071328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.077610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.077760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.077793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.083833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.084162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.084191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.090120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.090336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.090378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.096350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.096565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.096593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.102346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.102499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.102538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.107956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.108055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.108102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.113969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.114065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.114102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.119586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.119684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.119716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.125330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.125544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.125583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.130875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.131042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.220 [2024-11-20 20:28:16.131084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.220 [2024-11-20 20:28:16.135529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.220 [2024-11-20 20:28:16.135777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.135812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.140020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.140185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.140216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.144530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.144671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.144707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.149092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.149269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.149298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.153613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.153785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.153821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.158025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.158201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.158230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.162550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.162752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.162785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.167034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.167241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.167275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.171631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.171892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.171926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.176169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.176331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.176361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.180627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.180798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.180831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.185101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.185281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.185316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.189618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.189748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.189780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.194034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.194191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.194221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.198708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.198874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.198908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.203323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.203519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.203553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.207910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.208180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.208209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.212484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.212664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.212697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.217110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.217289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.217318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.221500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.221672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.221705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.226028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.226180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.226215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.230415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.230555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.230587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.235017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.235202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.235232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.239549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.239723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.239756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.244209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.244479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.244512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.248676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.248883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.248915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.221 [2024-11-20 20:28:16.253270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.221 [2024-11-20 20:28:16.253456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.221 [2024-11-20 20:28:16.253489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.483 [2024-11-20 20:28:16.257760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.483 [2024-11-20 20:28:16.257928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.483 [2024-11-20 20:28:16.257961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.483 [2024-11-20 20:28:16.262283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.483 [2024-11-20 20:28:16.262418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.483 [2024-11-20 20:28:16.262456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.483 [2024-11-20 20:28:16.266863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.483 [2024-11-20 20:28:16.267001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.267033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.271340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.271520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.271552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.276018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.276211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.276240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.280681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.280932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.280965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.285192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.285349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.285401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.289782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.289954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.289989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.294290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.294468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.294501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.298745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.298893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.298924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.303171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.303252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.303278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.307639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.307787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.307817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.312154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.312345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.312375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.316788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.317027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.317056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.321308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.321482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.321522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.325866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.326066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.326125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.330862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.331110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.331142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.336659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.336843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.336882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.342851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.343009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.343041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.350197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.350457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.350496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.356764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.356973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.357006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.363911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.364220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.364249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.370801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.371037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.371081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.377997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.378157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.378190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.385300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.385530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.385558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.392616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.392795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.392831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.399717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.399879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.399911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.407269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.407500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.407538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.414429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.484 [2024-11-20 20:28:16.414710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.484 [2024-11-20 20:28:16.414751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.484 [2024-11-20 20:28:16.421314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.421602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.421634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.428244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.428480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.428512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.435764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.435927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.435959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.442767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.442914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.442942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.449771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.449907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.449940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.455040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.455209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.455240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.459677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.459879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.459917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.464413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.464631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.464679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.469268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.469502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.469536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.475166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.475393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.475427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.481617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.481760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.481792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.488879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.488974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.489005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.495397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.495588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.495624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.502249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.502396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.502439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.508917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.509215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.509249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.485 [2024-11-20 20:28:16.515714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.485 [2024-11-20 20:28:16.516001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.485 [2024-11-20 20:28:16.516034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.521080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.521326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.521360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.525774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.525953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.525990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.530769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.530976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.531011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.536725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.536820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.536850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.542755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.542937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.542974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.549265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.549446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.549480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.554472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.554596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.554633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.559801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.560030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.560063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.564845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.565079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.565113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.569330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.569493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.569527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.573794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.573921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.573953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.578302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.578435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.578479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.582830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.582988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.583022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.587372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.587502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.587538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.591926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.592150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.592178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.596658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.596860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.596896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.602348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.602576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.602611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.746 [2024-11-20 20:28:16.606882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.746 [2024-11-20 20:28:16.607032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.746 [2024-11-20 20:28:16.607090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.611434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.611607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.611643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.615936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.616090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.616145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.620533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.620700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.620735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.624998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.625190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.625220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.629653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.629857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.629890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.634245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.634454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.634483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.638619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.638834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.638866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.643159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.643287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.643316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.647460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.647646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.647679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.651930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.652115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.652145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.656531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.656675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.656707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.661107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.661258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.661295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.665560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.665758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.665791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.670230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.670472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.670505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.674808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.675024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.675057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.679284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.679433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.679466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.683764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.683924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.683960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.688296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.688440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.688471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.692967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.693137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.693169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.697534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.697672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.697705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.702180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.702339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.702383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.706699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.706889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.706920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.711194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.711416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.711449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.715718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.715857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.715890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.720287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.720475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.720509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.724791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.724932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.724973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.747 [2024-11-20 20:28:16.729312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.747 [2024-11-20 20:28:16.729505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.747 [2024-11-20 20:28:16.729539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.733853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.734016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.734054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.738511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.738676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.738714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.743187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.743418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.743451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.747823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.748027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.748059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.752306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.752465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.752498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.756855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.757021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.757054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.761352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.761494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.761526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.765791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.765938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.765970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.770311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.770500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.770532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.774813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.774981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.775013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.748 [2024-11-20 20:28:16.779472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:11.748 [2024-11-20 20:28:16.779685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.748 [2024-11-20 20:28:16.779719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.007 [2024-11-20 20:28:16.784163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.007 [2024-11-20 20:28:16.784352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.007 [2024-11-20 20:28:16.784404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.788682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.788822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.788855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.793105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.793287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.793315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.798030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.798171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.798201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.803212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.803342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.803378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.808001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.808160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.808195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.814693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.815001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.815036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.821618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.821851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.821883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.828946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.829164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.829196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.836042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.836306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.836340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.843335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.843544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.843576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.850421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.850589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.850626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.857579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.857769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.857802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.864616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.864758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.864790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.872165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.872460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.872497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.879256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.879467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.879500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.886627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.886918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.886954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.893986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.894189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.894217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.900809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.900898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.900927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.907147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.907341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.907374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.914287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.914424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.914454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.920523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.920749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.920788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.927258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.927478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.927510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.933735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.933962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.933994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.940275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.940511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.940544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.946629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.946777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.946805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.953420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.953564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.008 [2024-11-20 20:28:16.953596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.008 [2024-11-20 20:28:16.959957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.008 [2024-11-20 20:28:16.960157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.960186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:16.966650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:16.966860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.966892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:16.973207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:16.973458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.973491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:16.979661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:16.979869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.979907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:16.986357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:16.986666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.986698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:16.992704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:16.992910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.992942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:16.999444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:16.999687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:16.999719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:17.006242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:17.006507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:17.006540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:17.013117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:17.013276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:17.013305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:17.019581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:17.019761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:17.019793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:17.026653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:17.026839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:17.026876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:17.033707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:17.034005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:17.034037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.009 [2024-11-20 20:28:17.040065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.009 [2024-11-20 20:28:17.040317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.009 [2024-11-20 20:28:17.040347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.044904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.045063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.045110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.049548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.049725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.049757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.054211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.054359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.054406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.058792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.058982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.059014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.064099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.064269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.064313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.070484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.070693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.070733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.076477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.076786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.076818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.082976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.083255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.083285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.088013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.088201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.088232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.092538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.092661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.092700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.098012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.098134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.098169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.102885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.102997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.103029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.107384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.107538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.107571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.112021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.112174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.112203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.116683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.116911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.116949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.269 [2024-11-20 20:28:17.121310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.269 [2024-11-20 20:28:17.121552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.269 [2024-11-20 20:28:17.121584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.125842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.126004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.126048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.130368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.130524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.130557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.134821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.134955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.134989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.139288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.139478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.139510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.143776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.143881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.143909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.148259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.148409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.148441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.152986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.153212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.153242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.157619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.157844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.157876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.162215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.162412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.162444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.166704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.166856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.166889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.171165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.171281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.171312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.175656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.175795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.175836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.180104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.180271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.180299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.184669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.184838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.184876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.189225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.189335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.189383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.193995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.194229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.194259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.198568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.198748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.198786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.203081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.203215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.203244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.207524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.207662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.207693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.212024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.212190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.212227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.216530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.216653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.216685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.221129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.221282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.221310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.225830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.226058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.226101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.230484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.230691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.230727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.235037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.235236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.235264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.239492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.239644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.239676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.270 [2024-11-20 20:28:17.243958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.270 [2024-11-20 20:28:17.244144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.270 [2024-11-20 20:28:17.244177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.248531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.248674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.248708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.253022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.253170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.253198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.257601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.257734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.257766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.262254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.262501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.262533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.266810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.267006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.267039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.271392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.271562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.271596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.275933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.276079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.276111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.280412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.280556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.280587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.284908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.285060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.285117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.289343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.289506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.289537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.293908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.294086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.294121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.298530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.298759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.298794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.271 [2024-11-20 20:28:17.303221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.271 [2024-11-20 20:28:17.303437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.271 [2024-11-20 20:28:17.303469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.307868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.308048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.308091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.312359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.312481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.312513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.316838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.316979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.317016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.321434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.321604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.321643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.325913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.326132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.326161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.330462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.330595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.330630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.335058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.335290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.335318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.339742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.339955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.339994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.344354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.344548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.344581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.348855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.348998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.349037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.353325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.353471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.353507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.357792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.357976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.358008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.362293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.362468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.362500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.366829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.367008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.367041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.371572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.371807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.371841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.376285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.376526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.376559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.380882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.381056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.381101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.531 [2024-11-20 20:28:17.385437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.531 [2024-11-20 20:28:17.385569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.531 [2024-11-20 20:28:17.385605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.389863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.389979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.390007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.394314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.394438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.394467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.398841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.398985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.399016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.403331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.403469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.403502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.407931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.408183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.408212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.412576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.412813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.412846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.417195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.417359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.417405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.421670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.421813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.421845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.426148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.426266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.426294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.430635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.430783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.430815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.435096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.435242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.435270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.439669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.439804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.439843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.444364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.444607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.444640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.448995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.449230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.449278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.453652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.453929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.453976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.458175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.458389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.458432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.462790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.462925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.462960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.467348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.467531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.467571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.472171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.472292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.472322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.476402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.476552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.476580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.480877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.481143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.481173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.485574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.485798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.485832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.490959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.491102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.491154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.495999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.496136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.496166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.500482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.500630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.500657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.504679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.532 [2024-11-20 20:28:17.504785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.532 [2024-11-20 20:28:17.504812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.532 [2024-11-20 20:28:17.508970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.509127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.509156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.513646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.513813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.513841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.518604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.518792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.518820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.523740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.523978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.524005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.529515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.529697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.529725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.534302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.534495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.534523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.539304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.539451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.539485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.544319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.544471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.544498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.549197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.549357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.549384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.553984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.554126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.554156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.558852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.559039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.559093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.533 [2024-11-20 20:28:17.563897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.533 [2024-11-20 20:28:17.564184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.533 [2024-11-20 20:28:17.564219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.793 [2024-11-20 20:28:17.570319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.793 [2024-11-20 20:28:17.570520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.793 [2024-11-20 20:28:17.570550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.793 [2024-11-20 20:28:17.575346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.793 [2024-11-20 20:28:17.575534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.793 [2024-11-20 20:28:17.575566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.793 [2024-11-20 20:28:17.580333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.793 [2024-11-20 20:28:17.580462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.793 [2024-11-20 20:28:17.580492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.793 [2024-11-20 20:28:17.585840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.793 [2024-11-20 20:28:17.586000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.793 [2024-11-20 20:28:17.586032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.793 [2024-11-20 20:28:17.591032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.793 [2024-11-20 20:28:17.591186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.591214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.595604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.595744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.595776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.600370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.600614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.600645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.605145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.605343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.605373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.609745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.609928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.609961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.614329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.614480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.614516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.618872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.619014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.619047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.623377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.623573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.623607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.627955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.628106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.628160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.632570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.632748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.632781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.637286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.637541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.637578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.641931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.642179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.642210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.646567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.646760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.646799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.651158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.651286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.651322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.655606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.655777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.655809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.660193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.660323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.660350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.664614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.664738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.664770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.669179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.669306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.669334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.673885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.674057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.674101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.678561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.678777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.678810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.794 [2024-11-20 20:28:17.683191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2111fb0) with pdu=0x2000190fef90 00:27:12.794 [2024-11-20 20:28:17.683367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.794 [2024-11-20 20:28:17.683424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.794 00:27:12.794 Latency(us) 00:27:12.794 [2024-11-20T19:28:17.833Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:12.794 [2024-11-20T19:28:17.833Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:12.794 nvme0n1 : 2.00 5834.98 729.37 0.00 0.00 2734.58 1941.81 7718.68 00:27:12.794 [2024-11-20T19:28:17.833Z] =================================================================================================================== 00:27:12.794 [2024-11-20T19:28:17.833Z] Total : 5834.98 729.37 0.00 0.00 2734.58 1941.81 7718.68 00:27:12.794 0 00:27:12.794 20:28:17 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:12.794 20:28:17 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:12.794 20:28:17 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:12.794 | .driver_specific 00:27:12.794 | .nvme_error 00:27:12.794 | .status_code 00:27:12.794 | .command_transient_transport_error' 00:27:12.794 20:28:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:13.055 20:28:17 -- host/digest.sh@71 -- # (( 376 > 0 )) 00:27:13.055 20:28:17 -- host/digest.sh@73 -- # killprocess 3273900 00:27:13.055 20:28:17 -- common/autotest_common.sh@936 -- # '[' -z 3273900 ']' 00:27:13.055 20:28:17 -- common/autotest_common.sh@940 -- # kill -0 3273900 00:27:13.055 20:28:17 -- common/autotest_common.sh@941 -- # uname 00:27:13.055 20:28:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.055 20:28:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3273900 00:27:13.055 20:28:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:13.055 20:28:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:13.055 20:28:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3273900' 00:27:13.055 killing process with pid 3273900 00:27:13.055 20:28:18 -- common/autotest_common.sh@955 -- # kill 3273900 00:27:13.055 Received shutdown signal, test time was about 2.000000 seconds 00:27:13.055 00:27:13.055 Latency(us) 00:27:13.055 [2024-11-20T19:28:18.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.055 [2024-11-20T19:28:18.094Z] =================================================================================================================== 00:27:13.055 [2024-11-20T19:28:18.094Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:13.055 20:28:18 -- common/autotest_common.sh@960 -- # wait 3273900 00:27:13.315 20:28:18 -- host/digest.sh@115 -- # killprocess 3272344 00:27:13.315 20:28:18 -- common/autotest_common.sh@936 -- # '[' -z 3272344 ']' 00:27:13.315 20:28:18 -- common/autotest_common.sh@940 -- # kill -0 3272344 00:27:13.315 20:28:18 -- common/autotest_common.sh@941 -- # uname 00:27:13.315 20:28:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.315 20:28:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3272344 00:27:13.315 20:28:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:13.315 20:28:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:13.315 20:28:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3272344' 00:27:13.315 killing process with pid 3272344 00:27:13.315 20:28:18 -- common/autotest_common.sh@955 -- # kill 3272344 00:27:13.315 20:28:18 -- common/autotest_common.sh@960 -- # wait 3272344 00:27:13.575 00:27:13.575 real 0m17.958s 00:27:13.575 user 0m36.617s 00:27:13.575 sys 0m4.384s 00:27:13.575 20:28:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:13.575 20:28:18 -- common/autotest_common.sh@10 -- # set +x 00:27:13.575 ************************************ 00:27:13.575 END TEST nvmf_digest_error 00:27:13.575 ************************************ 00:27:13.834 20:28:18 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:13.834 20:28:18 -- host/digest.sh@139 -- # nvmftestfini 00:27:13.834 20:28:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:13.834 20:28:18 -- nvmf/common.sh@116 -- # sync 00:27:13.834 20:28:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:13.834 20:28:18 -- nvmf/common.sh@119 -- # set +e 00:27:13.834 20:28:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:13.834 20:28:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:13.834 rmmod nvme_tcp 00:27:13.834 rmmod nvme_fabrics 00:27:13.834 rmmod nvme_keyring 00:27:13.834 20:28:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:13.834 20:28:18 -- nvmf/common.sh@123 -- # set -e 00:27:13.834 20:28:18 -- nvmf/common.sh@124 -- # return 0 00:27:13.834 20:28:18 -- nvmf/common.sh@477 -- # '[' -n 3272344 ']' 00:27:13.834 20:28:18 -- nvmf/common.sh@478 -- # killprocess 3272344 00:27:13.834 20:28:18 -- common/autotest_common.sh@936 -- # '[' -z 3272344 ']' 00:27:13.834 20:28:18 -- common/autotest_common.sh@940 -- # kill -0 3272344 00:27:13.834 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3272344) - No such process 00:27:13.834 20:28:18 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3272344 is not found' 00:27:13.834 Process with pid 3272344 is not found 00:27:13.834 20:28:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:13.834 20:28:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:13.834 20:28:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:13.834 20:28:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:13.834 20:28:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:13.834 20:28:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:13.834 20:28:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:13.834 20:28:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.739 20:28:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:15.739 00:27:15.739 real 0m38.275s 00:27:15.739 user 1m8.528s 00:27:15.739 sys 0m10.459s 00:27:15.739 20:28:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:15.739 20:28:20 -- common/autotest_common.sh@10 -- # set +x 00:27:15.739 ************************************ 00:27:15.739 END TEST nvmf_digest 00:27:15.739 ************************************ 00:27:15.739 20:28:20 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:15.739 20:28:20 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:15.739 20:28:20 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:15.739 20:28:20 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:15.739 20:28:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:15.739 20:28:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:15.739 20:28:20 -- common/autotest_common.sh@10 -- # set +x 00:27:15.739 ************************************ 00:27:15.739 START TEST nvmf_bdevperf 00:27:15.739 ************************************ 00:27:15.739 20:28:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:15.998 * Looking for test storage... 00:27:15.998 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:15.998 20:28:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:15.998 20:28:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:15.998 20:28:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:15.999 20:28:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:15.999 20:28:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:15.999 20:28:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:15.999 20:28:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:15.999 20:28:20 -- scripts/common.sh@335 -- # IFS=.-: 00:27:15.999 20:28:20 -- scripts/common.sh@335 -- # read -ra ver1 00:27:15.999 20:28:20 -- scripts/common.sh@336 -- # IFS=.-: 00:27:15.999 20:28:20 -- scripts/common.sh@336 -- # read -ra ver2 00:27:15.999 20:28:20 -- scripts/common.sh@337 -- # local 'op=<' 00:27:15.999 20:28:20 -- scripts/common.sh@339 -- # ver1_l=2 00:27:15.999 20:28:20 -- scripts/common.sh@340 -- # ver2_l=1 00:27:15.999 20:28:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:15.999 20:28:20 -- scripts/common.sh@343 -- # case "$op" in 00:27:15.999 20:28:20 -- scripts/common.sh@344 -- # : 1 00:27:15.999 20:28:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:15.999 20:28:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:15.999 20:28:20 -- scripts/common.sh@364 -- # decimal 1 00:27:15.999 20:28:20 -- scripts/common.sh@352 -- # local d=1 00:27:15.999 20:28:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:15.999 20:28:20 -- scripts/common.sh@354 -- # echo 1 00:27:15.999 20:28:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:15.999 20:28:20 -- scripts/common.sh@365 -- # decimal 2 00:27:15.999 20:28:20 -- scripts/common.sh@352 -- # local d=2 00:27:15.999 20:28:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:15.999 20:28:20 -- scripts/common.sh@354 -- # echo 2 00:27:15.999 20:28:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:15.999 20:28:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:15.999 20:28:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:15.999 20:28:20 -- scripts/common.sh@367 -- # return 0 00:27:15.999 20:28:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:15.999 20:28:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:15.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.999 --rc genhtml_branch_coverage=1 00:27:15.999 --rc genhtml_function_coverage=1 00:27:15.999 --rc genhtml_legend=1 00:27:15.999 --rc geninfo_all_blocks=1 00:27:15.999 --rc geninfo_unexecuted_blocks=1 00:27:15.999 00:27:15.999 ' 00:27:15.999 20:28:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:15.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.999 --rc genhtml_branch_coverage=1 00:27:15.999 --rc genhtml_function_coverage=1 00:27:15.999 --rc genhtml_legend=1 00:27:15.999 --rc geninfo_all_blocks=1 00:27:15.999 --rc geninfo_unexecuted_blocks=1 00:27:15.999 00:27:15.999 ' 00:27:15.999 20:28:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:15.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.999 --rc genhtml_branch_coverage=1 00:27:15.999 --rc genhtml_function_coverage=1 00:27:15.999 --rc genhtml_legend=1 00:27:15.999 --rc geninfo_all_blocks=1 00:27:15.999 --rc geninfo_unexecuted_blocks=1 00:27:15.999 00:27:15.999 ' 00:27:15.999 20:28:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:15.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.999 --rc genhtml_branch_coverage=1 00:27:15.999 --rc genhtml_function_coverage=1 00:27:15.999 --rc genhtml_legend=1 00:27:15.999 --rc geninfo_all_blocks=1 00:27:15.999 --rc geninfo_unexecuted_blocks=1 00:27:15.999 00:27:15.999 ' 00:27:15.999 20:28:20 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:15.999 20:28:20 -- nvmf/common.sh@7 -- # uname -s 00:27:15.999 20:28:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:15.999 20:28:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:15.999 20:28:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:15.999 20:28:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:15.999 20:28:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:15.999 20:28:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:15.999 20:28:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:15.999 20:28:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:15.999 20:28:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:15.999 20:28:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:15.999 20:28:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.999 20:28:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.999 20:28:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:15.999 20:28:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:15.999 20:28:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:15.999 20:28:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:15.999 20:28:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:15.999 20:28:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:15.999 20:28:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:15.999 20:28:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.999 20:28:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.999 20:28:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.999 20:28:20 -- paths/export.sh@5 -- # export PATH 00:27:15.999 20:28:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.999 20:28:20 -- nvmf/common.sh@46 -- # : 0 00:27:15.999 20:28:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:15.999 20:28:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:15.999 20:28:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:15.999 20:28:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:15.999 20:28:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:15.999 20:28:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:15.999 20:28:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:15.999 20:28:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:15.999 20:28:20 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:15.999 20:28:20 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:15.999 20:28:20 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:15.999 20:28:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:15.999 20:28:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:15.999 20:28:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:15.999 20:28:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:15.999 20:28:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:15.999 20:28:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.999 20:28:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.999 20:28:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.999 20:28:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:15.999 20:28:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:15.999 20:28:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:15.999 20:28:20 -- common/autotest_common.sh@10 -- # set +x 00:27:17.905 20:28:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:17.905 20:28:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:17.905 20:28:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:17.905 20:28:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:17.905 20:28:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:17.905 20:28:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:17.905 20:28:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:17.905 20:28:22 -- nvmf/common.sh@294 -- # net_devs=() 00:27:17.905 20:28:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:17.905 20:28:22 -- nvmf/common.sh@295 -- # e810=() 00:27:17.905 20:28:22 -- nvmf/common.sh@295 -- # local -ga e810 00:27:17.905 20:28:22 -- nvmf/common.sh@296 -- # x722=() 00:27:17.905 20:28:22 -- nvmf/common.sh@296 -- # local -ga x722 00:27:17.905 20:28:22 -- nvmf/common.sh@297 -- # mlx=() 00:27:17.905 20:28:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:17.905 20:28:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:17.905 20:28:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:17.905 20:28:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:17.905 20:28:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:17.905 20:28:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:17.905 20:28:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:17.905 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:17.905 20:28:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:17.905 20:28:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:17.905 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:17.905 20:28:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:17.905 20:28:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:17.905 20:28:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:17.905 20:28:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:17.905 20:28:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:17.905 20:28:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:17.905 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:17.905 20:28:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:17.905 20:28:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:17.905 20:28:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:17.905 20:28:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:17.905 20:28:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:17.905 20:28:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:17.905 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:17.905 20:28:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:17.905 20:28:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:17.905 20:28:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:17.905 20:28:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:17.905 20:28:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:17.905 20:28:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:17.905 20:28:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:17.905 20:28:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:17.905 20:28:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:17.905 20:28:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:17.905 20:28:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:17.905 20:28:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:17.905 20:28:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:17.905 20:28:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:17.905 20:28:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:17.905 20:28:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:17.905 20:28:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:18.164 20:28:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:18.164 20:28:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:18.164 20:28:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:18.164 20:28:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:18.164 20:28:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:18.164 20:28:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:18.164 20:28:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:18.164 20:28:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:18.164 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:18.164 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:27:18.164 00:27:18.164 --- 10.0.0.2 ping statistics --- 00:27:18.164 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.164 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:27:18.164 20:28:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:18.164 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:18.164 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:27:18.164 00:27:18.164 --- 10.0.0.1 ping statistics --- 00:27:18.164 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.164 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:27:18.164 20:28:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:18.164 20:28:23 -- nvmf/common.sh@410 -- # return 0 00:27:18.164 20:28:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:18.164 20:28:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:18.164 20:28:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:18.164 20:28:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:18.164 20:28:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:18.164 20:28:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:18.164 20:28:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:18.164 20:28:23 -- host/bdevperf.sh@25 -- # tgt_init 00:27:18.164 20:28:23 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:18.164 20:28:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:18.164 20:28:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:18.164 20:28:23 -- common/autotest_common.sh@10 -- # set +x 00:27:18.164 20:28:23 -- nvmf/common.sh@469 -- # nvmfpid=3276418 00:27:18.164 20:28:23 -- nvmf/common.sh@470 -- # waitforlisten 3276418 00:27:18.164 20:28:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:18.164 20:28:23 -- common/autotest_common.sh@829 -- # '[' -z 3276418 ']' 00:27:18.164 20:28:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.164 20:28:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.164 20:28:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.164 20:28:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.164 20:28:23 -- common/autotest_common.sh@10 -- # set +x 00:27:18.164 [2024-11-20 20:28:23.173098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.164 [2024-11-20 20:28:23.173186] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.424 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.424 [2024-11-20 20:28:23.247706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:18.424 [2024-11-20 20:28:23.363451] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:18.424 [2024-11-20 20:28:23.363619] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.424 [2024-11-20 20:28:23.363639] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.424 [2024-11-20 20:28:23.363653] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.424 [2024-11-20 20:28:23.363776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:18.424 [2024-11-20 20:28:23.363929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:18.424 [2024-11-20 20:28:23.363932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:19.362 20:28:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.362 20:28:24 -- common/autotest_common.sh@862 -- # return 0 00:27:19.362 20:28:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:19.362 20:28:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:19.362 20:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:19.362 20:28:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:19.362 20:28:24 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:19.362 20:28:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.362 20:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:19.362 [2024-11-20 20:28:24.202606] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:19.362 20:28:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.362 20:28:24 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:19.362 20:28:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.362 20:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:19.362 Malloc0 00:27:19.362 20:28:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.362 20:28:24 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:19.362 20:28:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.362 20:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:19.362 20:28:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.362 20:28:24 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:19.362 20:28:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.362 20:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:19.362 20:28:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.362 20:28:24 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:19.362 20:28:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.362 20:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:19.362 [2024-11-20 20:28:24.275769] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:19.362 20:28:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.362 20:28:24 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:19.362 20:28:24 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:19.362 20:28:24 -- nvmf/common.sh@520 -- # config=() 00:27:19.362 20:28:24 -- nvmf/common.sh@520 -- # local subsystem config 00:27:19.362 20:28:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:19.362 20:28:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:19.362 { 00:27:19.362 "params": { 00:27:19.362 "name": "Nvme$subsystem", 00:27:19.362 "trtype": "$TEST_TRANSPORT", 00:27:19.362 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:19.362 "adrfam": "ipv4", 00:27:19.362 "trsvcid": "$NVMF_PORT", 00:27:19.362 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:19.362 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:19.362 "hdgst": ${hdgst:-false}, 00:27:19.362 "ddgst": ${ddgst:-false} 00:27:19.362 }, 00:27:19.362 "method": "bdev_nvme_attach_controller" 00:27:19.362 } 00:27:19.362 EOF 00:27:19.362 )") 00:27:19.362 20:28:24 -- nvmf/common.sh@542 -- # cat 00:27:19.362 20:28:24 -- nvmf/common.sh@544 -- # jq . 00:27:19.362 20:28:24 -- nvmf/common.sh@545 -- # IFS=, 00:27:19.362 20:28:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:19.362 "params": { 00:27:19.362 "name": "Nvme1", 00:27:19.362 "trtype": "tcp", 00:27:19.362 "traddr": "10.0.0.2", 00:27:19.362 "adrfam": "ipv4", 00:27:19.362 "trsvcid": "4420", 00:27:19.362 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:19.362 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:19.362 "hdgst": false, 00:27:19.362 "ddgst": false 00:27:19.362 }, 00:27:19.362 "method": "bdev_nvme_attach_controller" 00:27:19.362 }' 00:27:19.362 [2024-11-20 20:28:24.318394] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.362 [2024-11-20 20:28:24.318500] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276595 ] 00:27:19.362 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.362 [2024-11-20 20:28:24.381035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:19.620 [2024-11-20 20:28:24.488977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:19.880 Running I/O for 1 seconds... 00:27:20.819 00:27:20.819 Latency(us) 00:27:20.819 [2024-11-20T19:28:25.858Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:20.819 [2024-11-20T19:28:25.858Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:20.819 Verification LBA range: start 0x0 length 0x4000 00:27:20.819 Nvme1n1 : 1.01 12796.24 49.99 0.00 0.00 9952.21 1092.27 17767.54 00:27:20.819 [2024-11-20T19:28:25.858Z] =================================================================================================================== 00:27:20.819 [2024-11-20T19:28:25.858Z] Total : 12796.24 49.99 0.00 0.00 9952.21 1092.27 17767.54 00:27:21.078 20:28:26 -- host/bdevperf.sh@30 -- # bdevperfpid=3276847 00:27:21.078 20:28:26 -- host/bdevperf.sh@32 -- # sleep 3 00:27:21.078 20:28:26 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:21.078 20:28:26 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:21.078 20:28:26 -- nvmf/common.sh@520 -- # config=() 00:27:21.078 20:28:26 -- nvmf/common.sh@520 -- # local subsystem config 00:27:21.078 20:28:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:21.078 20:28:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:21.078 { 00:27:21.078 "params": { 00:27:21.078 "name": "Nvme$subsystem", 00:27:21.078 "trtype": "$TEST_TRANSPORT", 00:27:21.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:21.078 "adrfam": "ipv4", 00:27:21.078 "trsvcid": "$NVMF_PORT", 00:27:21.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:21.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:21.078 "hdgst": ${hdgst:-false}, 00:27:21.078 "ddgst": ${ddgst:-false} 00:27:21.078 }, 00:27:21.078 "method": "bdev_nvme_attach_controller" 00:27:21.078 } 00:27:21.078 EOF 00:27:21.078 )") 00:27:21.078 20:28:26 -- nvmf/common.sh@542 -- # cat 00:27:21.078 20:28:26 -- nvmf/common.sh@544 -- # jq . 00:27:21.078 20:28:26 -- nvmf/common.sh@545 -- # IFS=, 00:27:21.078 20:28:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:21.078 "params": { 00:27:21.078 "name": "Nvme1", 00:27:21.078 "trtype": "tcp", 00:27:21.078 "traddr": "10.0.0.2", 00:27:21.078 "adrfam": "ipv4", 00:27:21.078 "trsvcid": "4420", 00:27:21.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:21.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:21.078 "hdgst": false, 00:27:21.078 "ddgst": false 00:27:21.078 }, 00:27:21.078 "method": "bdev_nvme_attach_controller" 00:27:21.078 }' 00:27:21.336 [2024-11-20 20:28:26.119969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.336 [2024-11-20 20:28:26.120045] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276847 ] 00:27:21.336 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.336 [2024-11-20 20:28:26.179137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.336 [2024-11-20 20:28:26.283168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:21.594 Running I/O for 15 seconds... 00:27:24.138 20:28:29 -- host/bdevperf.sh@33 -- # kill -9 3276418 00:27:24.138 20:28:29 -- host/bdevperf.sh@35 -- # sleep 3 00:27:24.138 [2024-11-20 20:28:29.095204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:94488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:94504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:93944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:93952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:93968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:93976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:93984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:93992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:94032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:94064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:94520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:94528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.095951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:94552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.095976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:94560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:94600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:94608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:94616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:94632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:94656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:94664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:94672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:94680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:94696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.138 [2024-11-20 20:28:29.096587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:94704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.138 [2024-11-20 20:28:29.096644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:94712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:94720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:94728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.138 [2024-11-20 20:28:29.096841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:94736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.138 [2024-11-20 20:28:29.096867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.096898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:94744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.096923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.096955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:94752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.096982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:94760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:94768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.097131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:94072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:94104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:94112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:94128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:94152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:94176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:94184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:94216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:94776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:94784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:94792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.097761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:94800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:94808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.097883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:94816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.097939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.097968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:94824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.097995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:94832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:94840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:94848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:94856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:94864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:94872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:94880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.098434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:94888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:94896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:94904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.098608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:94912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:94920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.139 [2024-11-20 20:28:29.098723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:94224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.098779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:94232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.098837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:94240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.098894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:94280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.098951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.098981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:94304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.099006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.099037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:94320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.099062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.099105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:94336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.099148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.099173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:94344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.099199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.139 [2024-11-20 20:28:29.099225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:94928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.139 [2024-11-20 20:28:29.099250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:94936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.099301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:94944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.099376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:94952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:94960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:94968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.099546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:94976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:94984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.099657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:94992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:95000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:95008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:95016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.099883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:95024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.099940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.099967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:95032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.099996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:95040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:95048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:95056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:95064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:95072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:95080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:95088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:95096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:95104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:95112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:95120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:95128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:95136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:95144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:95152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.100908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:95160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.100966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.100994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:95168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.101022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:95176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.140 [2024-11-20 20:28:29.101089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:94352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:94368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:94384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:94392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:94408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:94416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:94424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:94448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.140 [2024-11-20 20:28:29.101552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.140 [2024-11-20 20:28:29.101590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:94456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:94464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:94472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:94480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:94496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:94512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:94536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.101962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.101990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:94544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:95184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:95192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:95200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:95208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:95216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.141 [2024-11-20 20:28:29.102342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:94568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:94576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:94584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:94592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:94624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:94640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:94648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.141 [2024-11-20 20:28:29.102749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1149740 is same with the state(5) to be set 00:27:24.141 [2024-11-20 20:28:29.102814] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:24.141 [2024-11-20 20:28:29.102837] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:24.141 [2024-11-20 20:28:29.102858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:94688 len:8 PRP1 0x0 PRP2 0x0 00:27:24.141 [2024-11-20 20:28:29.102884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.102977] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1149740 was disconnected and freed. reset controller. 00:27:24.141 [2024-11-20 20:28:29.103389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.141 [2024-11-20 20:28:29.103425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.103453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.141 [2024-11-20 20:28:29.103480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.103505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.141 [2024-11-20 20:28:29.103538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.103566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.141 [2024-11-20 20:28:29.103592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.141 [2024-11-20 20:28:29.103617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.141 [2024-11-20 20:28:29.106727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.141 [2024-11-20 20:28:29.106782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.141 [2024-11-20 20:28:29.107383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-20 20:28:29.107590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-20 20:28:29.107629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.141 [2024-11-20 20:28:29.107660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.141 [2024-11-20 20:28:29.107926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.141 [2024-11-20 20:28:29.108164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.141 [2024-11-20 20:28:29.108205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.141 [2024-11-20 20:28:29.108237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.141 [2024-11-20 20:28:29.111102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.141 [2024-11-20 20:28:29.119351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.141 [2024-11-20 20:28:29.119698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-20 20:28:29.119873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-20 20:28:29.119904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.141 [2024-11-20 20:28:29.119932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.141 [2024-11-20 20:28:29.120182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.141 [2024-11-20 20:28:29.120364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.141 [2024-11-20 20:28:29.120391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.141 [2024-11-20 20:28:29.120416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.141 [2024-11-20 20:28:29.122813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.141 [2024-11-20 20:28:29.131857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.141 [2024-11-20 20:28:29.132274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-20 20:28:29.132517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-20 20:28:29.132551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.141 [2024-11-20 20:28:29.132582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.141 [2024-11-20 20:28:29.132777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.141 [2024-11-20 20:28:29.132961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.141 [2024-11-20 20:28:29.132988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.141 [2024-11-20 20:28:29.133013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.141 [2024-11-20 20:28:29.135444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.142 [2024-11-20 20:28:29.144388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.142 [2024-11-20 20:28:29.144780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-20 20:28:29.144989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-20 20:28:29.145023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.142 [2024-11-20 20:28:29.145052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.142 [2024-11-20 20:28:29.145278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.142 [2024-11-20 20:28:29.145512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.142 [2024-11-20 20:28:29.145539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.142 [2024-11-20 20:28:29.145564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.142 [2024-11-20 20:28:29.147926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.142 [2024-11-20 20:28:29.157016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.142 [2024-11-20 20:28:29.157398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-20 20:28:29.157657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-20 20:28:29.157709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.142 [2024-11-20 20:28:29.157738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.142 [2024-11-20 20:28:29.157951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.142 [2024-11-20 20:28:29.158192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.142 [2024-11-20 20:28:29.158219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.142 [2024-11-20 20:28:29.158244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.142 [2024-11-20 20:28:29.160646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.142 [2024-11-20 20:28:29.169353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.142 [2024-11-20 20:28:29.169727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-20 20:28:29.169910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-20 20:28:29.169940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.142 [2024-11-20 20:28:29.169966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.142 [2024-11-20 20:28:29.170134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.142 [2024-11-20 20:28:29.170375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.142 [2024-11-20 20:28:29.170408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.142 [2024-11-20 20:28:29.170434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.172779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.181801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.182174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.182335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.182369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.182397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.182626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.182820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.182847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.182871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.185383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.194439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.194796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.194963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.194997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.195026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.195269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.195464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.195491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.195515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.197985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.207003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.207391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.207547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.207591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.207617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.207895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.208120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.208147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.208181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.210707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.219508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.219958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.220113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.220148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.220178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.220373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.220565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.220592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.220617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.223004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.231938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.232315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.232525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.232601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.232632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.232842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.233036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.233063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.233102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.235623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.244591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.244927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.245089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.245124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.245154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.245382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.245560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.245587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.245611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.247964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.257241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.257592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.257855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.257912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.257942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.258186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.258361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.258388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.258412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.260686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.269726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.270086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.270277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.270307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.403 [2024-11-20 20:28:29.270333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.403 [2024-11-20 20:28:29.270559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.403 [2024-11-20 20:28:29.270746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.403 [2024-11-20 20:28:29.270772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.403 [2024-11-20 20:28:29.270798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.403 [2024-11-20 20:28:29.273171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.403 [2024-11-20 20:28:29.282115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.403 [2024-11-20 20:28:29.282492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.403 [2024-11-20 20:28:29.282698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.282742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.282768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.282965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.283155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.283182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.283208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.285574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.294551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.294918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.295110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.295141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.295168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.295389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.295547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.295574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.295600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.297943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.307231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.307637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.307795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.307829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.307858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.308050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.308237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.308264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.308289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.310648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.319847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.320187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.320345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.320378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.320408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.320620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.320797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.320824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.320849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.323055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.332448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.332814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.332997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.333030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.333060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.333303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.333514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.333541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.333566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.335910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.344890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.345265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.345415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.345451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.345482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.345710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.345941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.345968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.345993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.348375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.357595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.357971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.358116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.358147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.358175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.358331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.358501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.358528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.358553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.360827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.370432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.370802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.370987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.371021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.371051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.371291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.371485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.371512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.371537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.374010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.383140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.383526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.383677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.383722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.383748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.383987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.404 [2024-11-20 20:28:29.384265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.404 [2024-11-20 20:28:29.384293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.404 [2024-11-20 20:28:29.384318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.404 [2024-11-20 20:28:29.386739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.404 [2024-11-20 20:28:29.395873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.404 [2024-11-20 20:28:29.396222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.396457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.404 [2024-11-20 20:28:29.396524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.404 [2024-11-20 20:28:29.396553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.404 [2024-11-20 20:28:29.396746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.405 [2024-11-20 20:28:29.396923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.405 [2024-11-20 20:28:29.396949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.405 [2024-11-20 20:28:29.396974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.405 [2024-11-20 20:28:29.399407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.405 [2024-11-20 20:28:29.408638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.405 [2024-11-20 20:28:29.408974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.405 [2024-11-20 20:28:29.409214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.405 [2024-11-20 20:28:29.409268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.405 [2024-11-20 20:28:29.409306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.405 [2024-11-20 20:28:29.409496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.405 [2024-11-20 20:28:29.409710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.405 [2024-11-20 20:28:29.409737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.405 [2024-11-20 20:28:29.409762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.405 [2024-11-20 20:28:29.412149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.405 [2024-11-20 20:28:29.421260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.405 [2024-11-20 20:28:29.421715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.405 [2024-11-20 20:28:29.421863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.405 [2024-11-20 20:28:29.421893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.405 [2024-11-20 20:28:29.421921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.405 [2024-11-20 20:28:29.422183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.405 [2024-11-20 20:28:29.422379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.405 [2024-11-20 20:28:29.422406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.405 [2024-11-20 20:28:29.422431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.405 [2024-11-20 20:28:29.424936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.405 [2024-11-20 20:28:29.433773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.405 [2024-11-20 20:28:29.434123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.405 [2024-11-20 20:28:29.434304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.405 [2024-11-20 20:28:29.434338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.405 [2024-11-20 20:28:29.434368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.405 [2024-11-20 20:28:29.434559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.405 [2024-11-20 20:28:29.434739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.405 [2024-11-20 20:28:29.434766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.405 [2024-11-20 20:28:29.434790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.405 [2024-11-20 20:28:29.437435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.446421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.446801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.446950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.447000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.447030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.447281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.447441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.447467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.447492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.449890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.459005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.459363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.459537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.459567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.459595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.459880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.460122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.460149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.460174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.462481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.471648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.472135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.472291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.472325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.472355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.472586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.472816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.472843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.472870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.475233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.484251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.484555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.484742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.484775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.484805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.485051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.485265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.485292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.485318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.487445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.496827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.497193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.497379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.497412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.497442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.497653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.497882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.497910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.497936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.500369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.509410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.509865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.510020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.510054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.510095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.510329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.510524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.510552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.510577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.512844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.522099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.522459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.522676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.522731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.522761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.522988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.523197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.523231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.523257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.525599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.534561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.534954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.535130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.535164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.665 [2024-11-20 20:28:29.535194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.665 [2024-11-20 20:28:29.535441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.665 [2024-11-20 20:28:29.535636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.665 [2024-11-20 20:28:29.535663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.665 [2024-11-20 20:28:29.535688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.665 [2024-11-20 20:28:29.537925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.665 [2024-11-20 20:28:29.547212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.665 [2024-11-20 20:28:29.547548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.547838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.665 [2024-11-20 20:28:29.547871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.547901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.548123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.548335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.548362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.548388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.550826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.559689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.560094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.560254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.560288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.560317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.560529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.560706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.560733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.560767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.563315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.572460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.572794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.572947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.572980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.573010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.573213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.573407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.573434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.573461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.575968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.584982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.585290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.585470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.585503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.585533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.585746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.585959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.585986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.586012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.588405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.597673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.598042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.598185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.598220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.598250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.598444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.598637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.598664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.598690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.601118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.610339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.610653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.610860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.610890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.610932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.611193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.611352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.611379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.611404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.613695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.622932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.623320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.623498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.623532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.623562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.623752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.623946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.623973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.623999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.626533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.635534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.635858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.636036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.636080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.636112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.636321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.636514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.636542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.636567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.638982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.647977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.648325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.648475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.648506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.648547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.648796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.649026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.666 [2024-11-20 20:28:29.649053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.666 [2024-11-20 20:28:29.649092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.666 [2024-11-20 20:28:29.651435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.666 [2024-11-20 20:28:29.660599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.666 [2024-11-20 20:28:29.660939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.661108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.666 [2024-11-20 20:28:29.661143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.666 [2024-11-20 20:28:29.661172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.666 [2024-11-20 20:28:29.661299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.666 [2024-11-20 20:28:29.661516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.667 [2024-11-20 20:28:29.661542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.667 [2024-11-20 20:28:29.661567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.667 [2024-11-20 20:28:29.664081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.667 [2024-11-20 20:28:29.673274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.667 [2024-11-20 20:28:29.673591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.667 [2024-11-20 20:28:29.673716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.667 [2024-11-20 20:28:29.673747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.667 [2024-11-20 20:28:29.673773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.667 [2024-11-20 20:28:29.673935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.667 [2024-11-20 20:28:29.674149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.667 [2024-11-20 20:28:29.674176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.667 [2024-11-20 20:28:29.674201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.667 [2024-11-20 20:28:29.676419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.667 [2024-11-20 20:28:29.685970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.667 [2024-11-20 20:28:29.686308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.667 [2024-11-20 20:28:29.686484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.667 [2024-11-20 20:28:29.686518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.667 [2024-11-20 20:28:29.686548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.667 [2024-11-20 20:28:29.686774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.667 [2024-11-20 20:28:29.686987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.667 [2024-11-20 20:28:29.687014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.667 [2024-11-20 20:28:29.687039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.667 [2024-11-20 20:28:29.689411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.667 [2024-11-20 20:28:29.698538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.667 [2024-11-20 20:28:29.698903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.667 [2024-11-20 20:28:29.699201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.667 [2024-11-20 20:28:29.699271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.667 [2024-11-20 20:28:29.699301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.667 [2024-11-20 20:28:29.699511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.667 [2024-11-20 20:28:29.699633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.667 [2024-11-20 20:28:29.699661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.667 [2024-11-20 20:28:29.699686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.926 [2024-11-20 20:28:29.701848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.926 [2024-11-20 20:28:29.711173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.926 [2024-11-20 20:28:29.711599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.926 [2024-11-20 20:28:29.711804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.926 [2024-11-20 20:28:29.711838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.926 [2024-11-20 20:28:29.711868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.926 [2024-11-20 20:28:29.712039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.712264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.712291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.712316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.714752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.723604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.723934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.724152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.724225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.724254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.724426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.724587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.724613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.724639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.726927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.736145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.736486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.736639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.736684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.736711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.736959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.737183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.737210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.737235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.739615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.748901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.749237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.749407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.749437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.749477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.749684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.749857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.749883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.749908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.752349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.761430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.761803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.761973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.762004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.762037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.762307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.762493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.762520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.762546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.764963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.773894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.774186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.774333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.774367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.774397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.774640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.774798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.774825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.774850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.777328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.786401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.786792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.786973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.787007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.787037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.787298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.787529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.787556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.787580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.790014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.798778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.799138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.799305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.799335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.799361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.799616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.799813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.799839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.799863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.802141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.811348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.811676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.811859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.811892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.811921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.812161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.812356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.812383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.927 [2024-11-20 20:28:29.812408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.927 [2024-11-20 20:28:29.814768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.927 [2024-11-20 20:28:29.824127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.927 [2024-11-20 20:28:29.824507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.824657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.927 [2024-11-20 20:28:29.824690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.927 [2024-11-20 20:28:29.824719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.927 [2024-11-20 20:28:29.824983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.927 [2024-11-20 20:28:29.825206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.927 [2024-11-20 20:28:29.825233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.825258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.827670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.836572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.836903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.837057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.837100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.837129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.837361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.837526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.837553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.837579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.839795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.849039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.849494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.849648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.849681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.849712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.849905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.850064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.850101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.850128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.852489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.861743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.862134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.862301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.862330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.862357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.862571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.862766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.862793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.862819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.865385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.874275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.874661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.874827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.874861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.874892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.875155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.875305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.875327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.875348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.877748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.886882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.887290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.887457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.887491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.887521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.887731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.887926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.887952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.887977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.890359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.899640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.899962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.900132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.900163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.900189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.900383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.900594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.900621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.900645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.903114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.911939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.912264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.912407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.912437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.912465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.912717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.912886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.912907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.912933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.915369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.924576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.924913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.925106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.925137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.925163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.925335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.925544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.925571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.925595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.927836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.937181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.937537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.937724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.928 [2024-11-20 20:28:29.937757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.928 [2024-11-20 20:28:29.937787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.928 [2024-11-20 20:28:29.937978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.928 [2024-11-20 20:28:29.938176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.928 [2024-11-20 20:28:29.938201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.928 [2024-11-20 20:28:29.938223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.928 [2024-11-20 20:28:29.940708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.928 [2024-11-20 20:28:29.949770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.928 [2024-11-20 20:28:29.950129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.929 [2024-11-20 20:28:29.950255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.929 [2024-11-20 20:28:29.950285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:24.929 [2024-11-20 20:28:29.950313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:24.929 [2024-11-20 20:28:29.950556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:24.929 [2024-11-20 20:28:29.950668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.929 [2024-11-20 20:28:29.950689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.929 [2024-11-20 20:28:29.950715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.929 [2024-11-20 20:28:29.952820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.929 [2024-11-20 20:28:29.962243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.929 [2024-11-20 20:28:29.962550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.214 [2024-11-20 20:28:29.962702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:29.962733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:29.962761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:29.962999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:29.963227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:29.963252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:29.963275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:29.965743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:29.974756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:29.975114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:29.975235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:29.975265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:29.975292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:29.975486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:29.975661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:29.975688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:29.975712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:29.977993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:29.987289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:29.987638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:29.987793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:29.987826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:29.987857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:29.988067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:29.988224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:29.988248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:29.988271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:29.990730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:29.999683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.000039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.000194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.000226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:30.000253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:30.000487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:30.000700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:30.000727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:30.000752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:30.003308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:30.012084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.012416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.012618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.012653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:30.012683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:30.012857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:30.013038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:30.013086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:30.013129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:30.015563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:30.024502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.024811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.024978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.025009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:30.025036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:30.025228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:30.025400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:30.025423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:30.025455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:30.027737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:30.037147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.037568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.037749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.037783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:30.037813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:30.037986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:30.038202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:30.038227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:30.038250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:30.040584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:30.049600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.050047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.050200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.050231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:30.050259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:30.050467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:30.050649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:30.050676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:30.050703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:30.053161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:30.062116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.062512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.062711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.062761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.215 [2024-11-20 20:28:30.062792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.215 [2024-11-20 20:28:30.063002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.215 [2024-11-20 20:28:30.063243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.215 [2024-11-20 20:28:30.063271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.215 [2024-11-20 20:28:30.063296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.215 [2024-11-20 20:28:30.065722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.215 [2024-11-20 20:28:30.074632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.215 [2024-11-20 20:28:30.074972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.215 [2024-11-20 20:28:30.075135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.075170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.075200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.075428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.075623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.075650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.075674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.078096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.087238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.087664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.087861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.087894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.087925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.088189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.088421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.088443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.088482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.090954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.099823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.100266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.100494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.100529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.100558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.100829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.101004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.101031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.101057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.103410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.112597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.112954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.113083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.113114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.113148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.113336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.113547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.113574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.113600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.115808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.125056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.125461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.125644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.125678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.125708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.125918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.126106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.126134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.126159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.128561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.137579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.137941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.138066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.138108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.138137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.138370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.138528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.138555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.138580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.141023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.150429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.150932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.151143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.151174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.151200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.151467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.151665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.151692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.151718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.154157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.163285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.163606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.163813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.163867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.163898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.164129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.164306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.164329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.164350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.166857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.175938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.176303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.176436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.176470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.176500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.176671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.216 [2024-11-20 20:28:30.176792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.216 [2024-11-20 20:28:30.176819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.216 [2024-11-20 20:28:30.176845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.216 [2024-11-20 20:28:30.179066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.216 [2024-11-20 20:28:30.188522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.216 [2024-11-20 20:28:30.188878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.189031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.216 [2024-11-20 20:28:30.189065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.216 [2024-11-20 20:28:30.189106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.216 [2024-11-20 20:28:30.189358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.217 [2024-11-20 20:28:30.189543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.217 [2024-11-20 20:28:30.189569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.217 [2024-11-20 20:28:30.189594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.217 [2024-11-20 20:28:30.191791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.217 [2024-11-20 20:28:30.201129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.217 [2024-11-20 20:28:30.201515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.217 [2024-11-20 20:28:30.201680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.217 [2024-11-20 20:28:30.201713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.217 [2024-11-20 20:28:30.201743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.217 [2024-11-20 20:28:30.201955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.217 [2024-11-20 20:28:30.202182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.217 [2024-11-20 20:28:30.202204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.217 [2024-11-20 20:28:30.202224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.217 [2024-11-20 20:28:30.204601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.217 [2024-11-20 20:28:30.213520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.217 [2024-11-20 20:28:30.213902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.217 [2024-11-20 20:28:30.214085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.217 [2024-11-20 20:28:30.214116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.217 [2024-11-20 20:28:30.214143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.217 [2024-11-20 20:28:30.214395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.217 [2024-11-20 20:28:30.214597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.217 [2024-11-20 20:28:30.214623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.217 [2024-11-20 20:28:30.214647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.217 [2024-11-20 20:28:30.217026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.217 [2024-11-20 20:28:30.226231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.217 [2024-11-20 20:28:30.226617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.217 [2024-11-20 20:28:30.226752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.217 [2024-11-20 20:28:30.226785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.217 [2024-11-20 20:28:30.226817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.217 [2024-11-20 20:28:30.227043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.217 [2024-11-20 20:28:30.227240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.217 [2024-11-20 20:28:30.227268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.217 [2024-11-20 20:28:30.227292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.217 [2024-11-20 20:28:30.229379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.499 [2024-11-20 20:28:30.238674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.499 [2024-11-20 20:28:30.239015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.239201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.239231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.499 [2024-11-20 20:28:30.239257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.499 [2024-11-20 20:28:30.239490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.499 [2024-11-20 20:28:30.239702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.499 [2024-11-20 20:28:30.239728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.499 [2024-11-20 20:28:30.239753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.499 [2024-11-20 20:28:30.242265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.499 [2024-11-20 20:28:30.251282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.499 [2024-11-20 20:28:30.251710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.251937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.251971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.499 [2024-11-20 20:28:30.252001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.499 [2024-11-20 20:28:30.252242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.499 [2024-11-20 20:28:30.252449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.499 [2024-11-20 20:28:30.252475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.499 [2024-11-20 20:28:30.252499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.499 [2024-11-20 20:28:30.254772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.499 [2024-11-20 20:28:30.263873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.499 [2024-11-20 20:28:30.264203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.264341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.264387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.499 [2024-11-20 20:28:30.264417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.499 [2024-11-20 20:28:30.264610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.499 [2024-11-20 20:28:30.264821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.499 [2024-11-20 20:28:30.264853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.499 [2024-11-20 20:28:30.264879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.499 [2024-11-20 20:28:30.267316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.499 [2024-11-20 20:28:30.276423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.499 [2024-11-20 20:28:30.276757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.276917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.276951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.499 [2024-11-20 20:28:30.276981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.499 [2024-11-20 20:28:30.277182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.499 [2024-11-20 20:28:30.277367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.499 [2024-11-20 20:28:30.277391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.499 [2024-11-20 20:28:30.277424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.499 [2024-11-20 20:28:30.279744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.499 [2024-11-20 20:28:30.289056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.499 [2024-11-20 20:28:30.289458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.289638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 20:28:30.289672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.499 [2024-11-20 20:28:30.289702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.499 [2024-11-20 20:28:30.289876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.499 [2024-11-20 20:28:30.290033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.499 [2024-11-20 20:28:30.290060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.499 [2024-11-20 20:28:30.290097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.499 [2024-11-20 20:28:30.292500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.499 [2024-11-20 20:28:30.301816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.499 [2024-11-20 20:28:30.302174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.302352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.302386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.302415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.302660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.302781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.302807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.302840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.305025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.314268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.314636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.314813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.314863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.314892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.315116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.315330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.315353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.315374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.317783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.326730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.327148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.327302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.327335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.327366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.327579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.327738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.327765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.327790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.330103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.339338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.339656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.339812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.339846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.339876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.340050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.340265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.340289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.340310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.342848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.352029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.352388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.352556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.352587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.352613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.352826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.353056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.353098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.353140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.355583] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.364578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.365006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.365169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.365203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.365233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.365431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.365626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.365652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.365678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.367956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.377045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.377451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.377671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.377701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.377743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.377896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.378124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.378147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.378183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.380525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.389497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.389863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.390054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.390096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.390124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.390371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.390619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.390646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.390671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.393116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.402089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.402485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.402754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.402808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.402837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.500 [2024-11-20 20:28:30.403030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.500 [2024-11-20 20:28:30.403249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.500 [2024-11-20 20:28:30.403272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.500 [2024-11-20 20:28:30.403307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.500 [2024-11-20 20:28:30.405739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.500 [2024-11-20 20:28:30.414908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.500 [2024-11-20 20:28:30.415282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.415438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 20:28:30.415468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.500 [2024-11-20 20:28:30.415495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.415720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.415879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.415906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.415931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.418264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.427226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.427554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.427683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.427729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.427756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.427977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.428195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.428218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.428239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.430532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.439716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.440103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.440235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.440273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.440303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.440498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.440692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.440719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.440745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.443102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.452458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.452818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.452973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.453008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.453037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.453303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.453524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.453551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.453576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.455727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.465039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.465389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.465585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.465620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.465647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.465859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.466053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.466094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.466121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.468459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.477651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.478046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.478235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.478270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.478300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.478472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.478666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.478693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.478719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.481157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.490271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.490647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.490814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.490844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.490871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.491045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.491230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.491254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.491275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.493567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.502949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.503358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.503518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.503552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.503588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.503816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.504047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.504085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.504113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.506501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.515587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.515925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.516084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.516132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.516159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.516373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.516590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.516617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.501 [2024-11-20 20:28:30.516642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.501 [2024-11-20 20:28:30.519122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.501 [2024-11-20 20:28:30.528134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.501 [2024-11-20 20:28:30.528532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.528769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 20:28:30.528821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.501 [2024-11-20 20:28:30.528852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.501 [2024-11-20 20:28:30.529023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.501 [2024-11-20 20:28:30.529214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.501 [2024-11-20 20:28:30.529238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.502 [2024-11-20 20:28:30.529259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.502 [2024-11-20 20:28:30.531558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.540744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.541053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.541219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.541249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.541276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.541544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.541721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.541748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.541772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.544342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.553275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.553652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.553803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.553837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.553868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.554127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.554334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.554356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.554390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.556991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.565940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.566264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.566420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.566453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.566484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.566678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.566874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.566900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.566926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.569381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.578261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.578686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.578839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.578869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.578910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.579217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.579427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.579454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.579478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.581830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.590990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.591348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.591504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.591538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.591568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.591779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.592009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.592035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.592060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.594560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.603515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.603854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.604022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.604053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.604093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.604301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.604518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.604544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.604570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.606919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.615964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.616328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.616566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.616600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.616630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.616858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.617035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.617084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.617114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.619342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.628656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.629159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.629294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.629328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.629357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.629570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.629781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.629808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.764 [2024-11-20 20:28:30.629833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.764 [2024-11-20 20:28:30.632236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.764 [2024-11-20 20:28:30.641266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.764 [2024-11-20 20:28:30.641618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.641774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.764 [2024-11-20 20:28:30.641807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.764 [2024-11-20 20:28:30.641837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.764 [2024-11-20 20:28:30.642098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.764 [2024-11-20 20:28:30.642234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.764 [2024-11-20 20:28:30.642256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.642276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.644600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.653951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.654388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.654658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.654714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.654743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.654954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.655187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.655209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.655237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.657608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.666334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.666694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.666877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.666911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.666941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.667180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.667323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.667345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.667366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.669580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.678801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.679139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.679273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.679309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.679338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.679532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.679726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.679754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.679780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.682154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.691312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.691693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.691916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.691950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.691980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.692246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.692407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.692429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.692467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.694834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.703887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.704222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.704407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.704441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.704472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.704683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.704879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.704906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.704931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.707317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.716566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.716934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.717116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.717164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.717191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.717446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.717657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.717683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.717709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.720000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.729012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.729449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.729700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.729744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.729769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.729971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.730184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.730207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.730229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.732467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.741590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.741931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.742092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.742126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.742173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.742392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.742600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.742627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.742652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.745033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.754133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.765 [2024-11-20 20:28:30.754599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.754881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.765 [2024-11-20 20:28:30.754937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.765 [2024-11-20 20:28:30.754966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.765 [2024-11-20 20:28:30.755229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.765 [2024-11-20 20:28:30.755427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.765 [2024-11-20 20:28:30.755454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.765 [2024-11-20 20:28:30.755478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.765 [2024-11-20 20:28:30.757985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.765 [2024-11-20 20:28:30.766420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.766 [2024-11-20 20:28:30.766736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.766 [2024-11-20 20:28:30.766920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.766 [2024-11-20 20:28:30.766953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.766 [2024-11-20 20:28:30.766982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.766 [2024-11-20 20:28:30.767195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.766 [2024-11-20 20:28:30.767382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.766 [2024-11-20 20:28:30.767403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.766 [2024-11-20 20:28:30.767440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.766 [2024-11-20 20:28:30.769842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.766 [2024-11-20 20:28:30.778820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.766 [2024-11-20 20:28:30.779156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.766 [2024-11-20 20:28:30.779315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.766 [2024-11-20 20:28:30.779362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.766 [2024-11-20 20:28:30.779391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.766 [2024-11-20 20:28:30.779623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.766 [2024-11-20 20:28:30.779819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.766 [2024-11-20 20:28:30.779845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.766 [2024-11-20 20:28:30.779870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.766 [2024-11-20 20:28:30.782408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.766 [2024-11-20 20:28:30.791300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.766 [2024-11-20 20:28:30.791708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.766 [2024-11-20 20:28:30.791863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.766 [2024-11-20 20:28:30.791897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:25.766 [2024-11-20 20:28:30.791927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:25.766 [2024-11-20 20:28:30.792178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:25.766 [2024-11-20 20:28:30.792372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.766 [2024-11-20 20:28:30.792394] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.766 [2024-11-20 20:28:30.792414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.766 [2024-11-20 20:28:30.794773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.026 [2024-11-20 20:28:30.803877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.026 [2024-11-20 20:28:30.804208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.804362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.804396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.026 [2024-11-20 20:28:30.804426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.026 [2024-11-20 20:28:30.804599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.026 [2024-11-20 20:28:30.804779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.026 [2024-11-20 20:28:30.804805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.026 [2024-11-20 20:28:30.804831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.026 [2024-11-20 20:28:30.806978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.026 [2024-11-20 20:28:30.816451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.026 [2024-11-20 20:28:30.816824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.816980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.817030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.026 [2024-11-20 20:28:30.817057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.026 [2024-11-20 20:28:30.817316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.026 [2024-11-20 20:28:30.817512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.026 [2024-11-20 20:28:30.817538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.026 [2024-11-20 20:28:30.817563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.026 [2024-11-20 20:28:30.819979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.026 [2024-11-20 20:28:30.829218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.026 [2024-11-20 20:28:30.829556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.829737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.829771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.026 [2024-11-20 20:28:30.829801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.026 [2024-11-20 20:28:30.830011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.026 [2024-11-20 20:28:30.830257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.026 [2024-11-20 20:28:30.830280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.026 [2024-11-20 20:28:30.830300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.026 [2024-11-20 20:28:30.832539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.026 [2024-11-20 20:28:30.841875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.026 [2024-11-20 20:28:30.842402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.842620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.842654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.026 [2024-11-20 20:28:30.842683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.026 [2024-11-20 20:28:30.842898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.026 [2024-11-20 20:28:30.843107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.026 [2024-11-20 20:28:30.843134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.026 [2024-11-20 20:28:30.843158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.026 [2024-11-20 20:28:30.845619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.026 [2024-11-20 20:28:30.854403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.026 [2024-11-20 20:28:30.854797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.026 [2024-11-20 20:28:30.854956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.854991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.855028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.855235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.855435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.855476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.855501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.857973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.866911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.867346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.867582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.867636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.867665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.867815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.868015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.868041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.868067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.870522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.879549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.879930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.880108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.880140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.880166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.880365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.880569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.880596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.880621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.883102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.892099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.892485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.892591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.892620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.892646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.892846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.893089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.893116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.893141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.895519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.904777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.905108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.905246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.905276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.905303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.905508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.905702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.905729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.905754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.908125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.917305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.917768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.917949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.917983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.918013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.918218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.918414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.918441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.918466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.920795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.929820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.930240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.930384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.930415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.930442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.930636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.930818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.930845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.930870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.933466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.942220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.942561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.942741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.942775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.942804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.942995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.943218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.943241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.943261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.945340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.954673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.955112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.955354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.955385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.955427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.027 [2024-11-20 20:28:30.955695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.027 [2024-11-20 20:28:30.955854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.027 [2024-11-20 20:28:30.955881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.027 [2024-11-20 20:28:30.955906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.027 [2024-11-20 20:28:30.958355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.027 [2024-11-20 20:28:30.967224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.027 [2024-11-20 20:28:30.967583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.967795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.027 [2024-11-20 20:28:30.967826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.027 [2024-11-20 20:28:30.967866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:30.968115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:30.968291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:30.968324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:30.968350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:30.970714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:30.979698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:30.980066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:30.980209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:30.980243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:30.980273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:30.980485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:30.980680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:30.980707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:30.980733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:30.983067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:30.992381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:30.992703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:30.992854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:30.992888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:30.992917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:30.993066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:30.993280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:30.993302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:30.993322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:30.995702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:31.004918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:31.005235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.005399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.005429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:31.005473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:31.005731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:31.005892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:31.005918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:31.005952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:31.008415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:31.017430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:31.017757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.018004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.018048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:31.018098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:31.018280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:31.018507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:31.018534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:31.018559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:31.020830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:31.030022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:31.030392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.030534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.030566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:31.030592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:31.030855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:31.031033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:31.031060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:31.031102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:31.033543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:31.042447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:31.042825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.043019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.043050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:31.043087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:31.043283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:31.043478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:31.043505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:31.043530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:31.046110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.028 [2024-11-20 20:28:31.054935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.028 [2024-11-20 20:28:31.055275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.055462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.028 [2024-11-20 20:28:31.055496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.028 [2024-11-20 20:28:31.055526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.028 [2024-11-20 20:28:31.055754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.028 [2024-11-20 20:28:31.055991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.028 [2024-11-20 20:28:31.056018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.028 [2024-11-20 20:28:31.056044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.028 [2024-11-20 20:28:31.058330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.289 [2024-11-20 20:28:31.067480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.289 [2024-11-20 20:28:31.067860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.289 [2024-11-20 20:28:31.068024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.289 [2024-11-20 20:28:31.068057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.289 [2024-11-20 20:28:31.068098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.289 [2024-11-20 20:28:31.068330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.289 [2024-11-20 20:28:31.068489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.289 [2024-11-20 20:28:31.068515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.289 [2024-11-20 20:28:31.068541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.289 [2024-11-20 20:28:31.071018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.289 [2024-11-20 20:28:31.080044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.289 [2024-11-20 20:28:31.080444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.289 [2024-11-20 20:28:31.080733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.289 [2024-11-20 20:28:31.080792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.289 [2024-11-20 20:28:31.080821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.289 [2024-11-20 20:28:31.081055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.289 [2024-11-20 20:28:31.081263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.289 [2024-11-20 20:28:31.081290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.289 [2024-11-20 20:28:31.081315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.289 [2024-11-20 20:28:31.083681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.289 [2024-11-20 20:28:31.092496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.289 [2024-11-20 20:28:31.092929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.289 [2024-11-20 20:28:31.093140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.289 [2024-11-20 20:28:31.093175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.289 [2024-11-20 20:28:31.093205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.289 [2024-11-20 20:28:31.093417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.289 [2024-11-20 20:28:31.093612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.289 [2024-11-20 20:28:31.093639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.289 [2024-11-20 20:28:31.093664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.289 [2024-11-20 20:28:31.096161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.289 [2024-11-20 20:28:31.105007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.105408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.105659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.105698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.105747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.105962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.106148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.106172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.106194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.108503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.117471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.117839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.117992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.118027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.118055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.118282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.118495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.118523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.118547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.120974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.130017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.130433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.130669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.130714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.130740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.130984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.131214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.131242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.131266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.133747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.142550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.142893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.143052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.143096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.143127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.143336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.143495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.143522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.143546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.146167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.155178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.155640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.155838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.155899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.155927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.156214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.156408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.156435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.156461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.158746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.167712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.168112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.169048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.169115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.169142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.169336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.169552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.169580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.169605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.171925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.180389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.180750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.180949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.180982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.181012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.181255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.181462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.181489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.181515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.183907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.193077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.193391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.193538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.193569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.193595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.193801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.194009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.194033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.194056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.196153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.205282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.205631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.205754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.205785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.290 [2024-11-20 20:28:31.205819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.290 [2024-11-20 20:28:31.206080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.290 [2024-11-20 20:28:31.206251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.290 [2024-11-20 20:28:31.206274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.290 [2024-11-20 20:28:31.206296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.290 [2024-11-20 20:28:31.208808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.290 [2024-11-20 20:28:31.217877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.290 [2024-11-20 20:28:31.218266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.218423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.290 [2024-11-20 20:28:31.218457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.218486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.218700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.218831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.218853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.218873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.221248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.230423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.230783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.230946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.230998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.231027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.231282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.231501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.231528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.231553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.233990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.242959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.243294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.243540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.243589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.243617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.243797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.243989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.244015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.244041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.246587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.255445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.255840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.256016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.256062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.256102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.256334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.256530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.256557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.256582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.258821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.267885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.268217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.268392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.268444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.268473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.268718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.268930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.268958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.268984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.271519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.280429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.280842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.281037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.281067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.281103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.281376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.281577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.281605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.281630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.284133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.292986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.293394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.293585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.293617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.293644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.293871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.294098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.294126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.294160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.296539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.305387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.305812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.305958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.305989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.306016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.306237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.306436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.306463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.306488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.308607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.291 [2024-11-20 20:28:31.318011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.291 [2024-11-20 20:28:31.318397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.318552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.291 [2024-11-20 20:28:31.318586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.291 [2024-11-20 20:28:31.318615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.291 [2024-11-20 20:28:31.318860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.291 [2024-11-20 20:28:31.319055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.291 [2024-11-20 20:28:31.319098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.291 [2024-11-20 20:28:31.319126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.291 [2024-11-20 20:28:31.321441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-20 20:28:31.330750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-20 20:28:31.331097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-20 20:28:31.331227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-20 20:28:31.331258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-20 20:28:31.331285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.551 [2024-11-20 20:28:31.331542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.551 [2024-11-20 20:28:31.331702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-20 20:28:31.331728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-20 20:28:31.331753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-20 20:28:31.334163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-20 20:28:31.343250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-20 20:28:31.343635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-20 20:28:31.343773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-20 20:28:31.343804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-20 20:28:31.343831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.551 [2024-11-20 20:28:31.344086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.551 [2024-11-20 20:28:31.344280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-20 20:28:31.344307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-20 20:28:31.344332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-20 20:28:31.346696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-20 20:28:31.355703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-20 20:28:31.356123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-20 20:28:31.356290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-20 20:28:31.356321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-20 20:28:31.356348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.551 [2024-11-20 20:28:31.356528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.551 [2024-11-20 20:28:31.356750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.356777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.356811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.359325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.368276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.368682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.368854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.368885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.368912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.369188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.369418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.369445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.369469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.371698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.380901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.381193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.381317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.381351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.381380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.381590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.381765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.381792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.381818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.384371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.393358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.393759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.393904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.393937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.393966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.394234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.394395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.394432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.394458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.396670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.405874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.406313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.406497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.406530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.406560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.406687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.406883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.406910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.406936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.409135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.418387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.418703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.418893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.418924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.418952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.419198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.419359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.419394] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.419414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.421917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.430808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.431229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.431360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.431394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.431424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.431596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.431789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.431816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.431841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.434127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.443401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.443760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.443937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.443967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.444010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.444216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.444420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.444456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.444481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.446883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.456231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.456660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.456840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.456874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.456903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.457173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.457302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.457325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.457358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.459723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.468929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.552 [2024-11-20 20:28:31.469306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.469435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.552 [2024-11-20 20:28:31.469469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.552 [2024-11-20 20:28:31.469498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.552 [2024-11-20 20:28:31.469729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.552 [2024-11-20 20:28:31.469925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.552 [2024-11-20 20:28:31.469951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.552 [2024-11-20 20:28:31.469976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.552 [2024-11-20 20:28:31.472462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.552 [2024-11-20 20:28:31.481626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.482061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.482223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.482269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.482299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.482548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.482740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.482767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.482792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.485355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.494525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.494846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.495008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.495042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.495082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.495343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.495533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.495560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.495585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.497947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.507053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.507426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.507618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.507648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.507674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.507909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.508172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.508194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.508216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.510584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.519629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.520116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.520271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.520312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.520342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.520572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.520803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.520831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.520856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.523235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.532166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.532562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.532714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.532760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.532786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.533022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.533269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.533291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.533311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.535839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.544736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.545114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.545276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.545308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.545349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.545574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.545734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.545761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.545785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.548173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.557420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.557817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.557998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.558044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.558093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.558338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.558559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.558586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.558611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.561027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.569924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.570219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.570399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.570433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.570463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.570654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.570813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.570840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.570864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.573262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.553 [2024-11-20 20:28:31.582410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.553 [2024-11-20 20:28:31.582762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.582910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.553 [2024-11-20 20:28:31.582941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.553 [2024-11-20 20:28:31.582968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.553 [2024-11-20 20:28:31.583167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.553 [2024-11-20 20:28:31.583376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.553 [2024-11-20 20:28:31.583398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.553 [2024-11-20 20:28:31.583435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.553 [2024-11-20 20:28:31.585936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-20 20:28:31.595137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-20 20:28:31.595484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-20 20:28:31.595641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-20 20:28:31.595673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-20 20:28:31.595700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.813 [2024-11-20 20:28:31.595941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.813 [2024-11-20 20:28:31.596142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-20 20:28:31.596164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-20 20:28:31.596185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-20 20:28:31.598580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-20 20:28:31.607672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-20 20:28:31.608082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-20 20:28:31.608269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-20 20:28:31.608299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-20 20:28:31.608326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.813 [2024-11-20 20:28:31.608588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.813 [2024-11-20 20:28:31.608766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-20 20:28:31.608793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-20 20:28:31.608818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-20 20:28:31.611299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-20 20:28:31.620542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-20 20:28:31.620893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-20 20:28:31.621034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-20 20:28:31.621065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.621102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.621332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.621525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.621552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.621576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.624037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.633196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.633570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.633719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.633750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.633777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.634038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.634254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.634275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.634295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.636643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.645699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.646082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.646259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.646291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.646318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.646560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.646772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.646799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.646824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.649091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.658253] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.658609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.658760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.658790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.658818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.659079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.659257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.659279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.659299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.661651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.670948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.671359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.671514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.671548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.671578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.671752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.671965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.671997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.672024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.674415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.683389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.683768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.683922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.683955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.683985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.684240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.684439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.684466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.684490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.686782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.695862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.696209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.696384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.696415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.696457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.696703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.696863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.696889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.696914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.699378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.708446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.708778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.708926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.708956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.708998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.709238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.709355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.709377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.709424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.711925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.721130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.721479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.721636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.721670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.721699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.721944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.722113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-20 20:28:31.722153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-20 20:28:31.722173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-20 20:28:31.724518] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-20 20:28:31.733701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-20 20:28:31.734017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.734192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-20 20:28:31.734223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-20 20:28:31.734249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.814 [2024-11-20 20:28:31.734426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.814 [2024-11-20 20:28:31.734619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.734646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.734671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.736871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.746123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.746469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.746660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.746692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.746720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.746879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.747116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.747156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.747176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.749200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.758706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.759153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.759308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.759341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.759370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.759565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.759811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.759838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.759863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.762112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.771379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.771735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.771855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.771889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.771918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.772125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.772299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.772322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.772342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.774699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.783779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.784106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.784264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.784298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.784327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.784477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.784622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.784649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.784675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.787213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.796313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.796655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.796800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.796832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.796873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.797115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.797281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.797304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.797325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.799684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.809000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.809377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.809566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.809611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.809637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.809839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.810090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.810118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.810154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.812488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.821610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.821987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.822161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.822193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.822220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.822412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.822580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.822607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.822631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.824883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.833947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.834279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.834473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.834507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.834537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.834746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.834923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.834950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.834974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.815 [2024-11-20 20:28:31.837186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.815 [2024-11-20 20:28:31.846764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.815 [2024-11-20 20:28:31.847098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.847235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-20 20:28:31.847266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:26.815 [2024-11-20 20:28:31.847308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:26.815 [2024-11-20 20:28:31.847503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:26.815 [2024-11-20 20:28:31.847677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.815 [2024-11-20 20:28:31.847703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.815 [2024-11-20 20:28:31.847729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-20 20:28:31.850017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-20 20:28:31.859525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-20 20:28:31.859916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-20 20:28:31.860051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-20 20:28:31.860091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-20 20:28:31.860119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.075 [2024-11-20 20:28:31.860309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.075 [2024-11-20 20:28:31.860507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-20 20:28:31.860533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-20 20:28:31.860559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-20 20:28:31.862852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-20 20:28:31.871980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-20 20:28:31.872398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-20 20:28:31.872546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-20 20:28:31.872612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-20 20:28:31.872642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.075 [2024-11-20 20:28:31.872835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.075 [2024-11-20 20:28:31.872996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-20 20:28:31.873022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-20 20:28:31.873047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-20 20:28:31.875330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.884716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.885099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.885260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.885291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.885317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.885550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.885762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.885789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.885815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.888115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.897256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.897552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.897707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.897741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.897771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.897961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.898201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.898228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.898254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.900316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.909799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.910153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.910268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.910299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.910332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.910513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.910715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.910742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.910766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.913057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.922660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.923052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.923232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.923262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.923289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.923472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.923669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.923697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.923722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.926138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.935168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.935504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.935668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.935698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.935724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.935907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.936091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.936129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.936149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.938613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.947703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.948096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.948267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.948298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.948341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.948519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.948695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.948722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.948746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.951296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.960112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.960504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.960668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.960700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.960742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.961009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.961231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.961254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.961275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.963506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.972669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.973050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.973253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.973284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.973325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.973545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.973721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.973748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.973772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.976057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.985247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.985596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.985746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.985776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-20 20:28:31.985816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.076 [2024-11-20 20:28:31.986036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.076 [2024-11-20 20:28:31.986238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-20 20:28:31.986259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-20 20:28:31.986281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-20 20:28:31.988824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-20 20:28:31.997519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-20 20:28:31.997897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-20 20:28:31.998084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:31.998118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:31.998160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:31.998390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:31.998608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:31.998635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:31.998660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.000945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.010059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.010422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.010578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.010612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.010641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.010870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.011131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.011169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.011189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.013637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.022518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.022921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.023047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.023087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.023116] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.023420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.023614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.023647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.023674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.026035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.035136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.035587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.035734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.035765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.035793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.036016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.036250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.036273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.036294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.038597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.047767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.048126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.048272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.048307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.048336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.048550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.048747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.048775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.048801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.051111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.060311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.060723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.060850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.060884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.060914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.061175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.061336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.061363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.061396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.063708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.072517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.072898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.073039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.073084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.073117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.073330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.073558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.073585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.073611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-20 20:28:32.076060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-20 20:28:32.084985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.085377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.085518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.085550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-20 20:28:32.085576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.077 [2024-11-20 20:28:32.085803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.077 [2024-11-20 20:28:32.086016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-20 20:28:32.086044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-20 20:28:32.086080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3276418 Killed "${NVMF_APP[@]}" "$@" 00:27:27.077 20:28:32 -- host/bdevperf.sh@36 -- # tgt_init 00:27:27.077 20:28:32 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:27.077 20:28:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:27.077 20:28:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:27.077 20:28:32 -- common/autotest_common.sh@10 -- # set +x 00:27:27.077 [2024-11-20 20:28:32.088461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 20:28:32 -- nvmf/common.sh@469 -- # nvmfpid=3277538 00:27:27.077 20:28:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:27.077 20:28:32 -- nvmf/common.sh@470 -- # waitforlisten 3277538 00:27:27.077 20:28:32 -- common/autotest_common.sh@829 -- # '[' -z 3277538 ']' 00:27:27.077 20:28:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:27.077 20:28:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:27.077 20:28:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:27.077 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:27.077 20:28:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:27.077 20:28:32 -- common/autotest_common.sh@10 -- # set +x 00:27:27.077 [2024-11-20 20:28:32.097315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-20 20:28:32.097663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-20 20:28:32.097771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.078 [2024-11-20 20:28:32.097809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.078 [2024-11-20 20:28:32.097837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.078 [2024-11-20 20:28:32.098048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.078 [2024-11-20 20:28:32.098258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.078 [2024-11-20 20:28:32.098283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.078 [2024-11-20 20:28:32.098307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.078 [2024-11-20 20:28:32.100335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.078 [2024-11-20 20:28:32.109679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.078 [2024-11-20 20:28:32.110119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.078 [2024-11-20 20:28:32.110270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.078 [2024-11-20 20:28:32.110302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.078 [2024-11-20 20:28:32.110329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.078 [2024-11-20 20:28:32.110518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.078 [2024-11-20 20:28:32.110730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.078 [2024-11-20 20:28:32.110754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.078 [2024-11-20 20:28:32.110776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.337 [2024-11-20 20:28:32.112895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.337 [2024-11-20 20:28:32.122025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.337 [2024-11-20 20:28:32.122436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.122613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.122644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.122672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.122888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.123105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.123128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.123151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.125176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.131359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:27.338 [2024-11-20 20:28:32.131437] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:27.338 [2024-11-20 20:28:32.134100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.134417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.134521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.134551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.134577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.134789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.134930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.134951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.134972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.137102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.146205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.146617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.146736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.146767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.146794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.147041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.147219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.147244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.147267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.149094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.158599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.158915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.159094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.159125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.159152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.159355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.159511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.159532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.159552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.161553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.338 [2024-11-20 20:28:32.170879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.171228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.171397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.171428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.171456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.171658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.171835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.171862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.171887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.174272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.183618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.183982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.184180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.184215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.184246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.184458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.184635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.184662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.184688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.187273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.196242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.196585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.196712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.196745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.196775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.197002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.197207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.197232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.197255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.198934] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:27.338 [2024-11-20 20:28:32.199534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.208873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.209492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.209737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.209772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.209807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.210058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.210235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.210260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.210287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.212723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-20 20:28:32.221496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-20 20:28:32.222581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.222810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-20 20:28:32.222846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-20 20:28:32.222879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.338 [2024-11-20 20:28:32.223059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.338 [2024-11-20 20:28:32.223279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-20 20:28:32.223304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-20 20:28:32.223327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-20 20:28:32.225713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.234183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.234561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.234732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.234775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.234806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.235021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.235234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.235259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.235283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.237587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.246808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.247201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.247356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.247388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.247415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.247660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.247881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.247908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.247934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.250283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.259602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.259973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.260160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.260192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.260219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.260463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.260628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.260651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.260686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.263175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.272018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.272631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.272775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.272815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.272846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.273017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.273271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.273297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.273324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.275891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.284631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.285065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.285248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.285280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.285309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.285544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.285740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.285777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.285803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.288244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.297159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.297420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.297602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.297641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.297668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.297870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.298110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.298151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.298176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.300611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.309583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.309960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.310166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.310197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.310226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.310436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.310578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.310606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.310631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.313040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.322019] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:27.339 [2024-11-20 20:28:32.322093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.322150] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:27.339 [2024-11-20 20:28:32.322178] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:27.339 [2024-11-20 20:28:32.322191] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:27.339 [2024-11-20 20:28:32.322252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:27.339 [2024-11-20 20:28:32.322287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:27.339 [2024-11-20 20:28:32.322290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:27.339 [2024-11-20 20:28:32.322424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.322551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.322584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.322610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.322858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.323028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.323051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-20 20:28:32.323099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-20 20:28:32.325194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-20 20:28:32.334552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-20 20:28:32.335090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.335233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-20 20:28:32.335264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-20 20:28:32.335297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.339 [2024-11-20 20:28:32.335565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.339 [2024-11-20 20:28:32.335705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-20 20:28:32.335728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.340 [2024-11-20 20:28:32.335755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.340 [2024-11-20 20:28:32.338094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.340 [2024-11-20 20:28:32.346983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.340 [2024-11-20 20:28:32.347539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.340 [2024-11-20 20:28:32.347674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.340 [2024-11-20 20:28:32.347708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.340 [2024-11-20 20:28:32.347740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.340 [2024-11-20 20:28:32.347973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.340 [2024-11-20 20:28:32.348147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.340 [2024-11-20 20:28:32.348172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.340 [2024-11-20 20:28:32.348213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.340 [2024-11-20 20:28:32.350378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.340 [2024-11-20 20:28:32.359444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.340 [2024-11-20 20:28:32.359924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.340 [2024-11-20 20:28:32.360089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.340 [2024-11-20 20:28:32.360133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.340 [2024-11-20 20:28:32.360165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.340 [2024-11-20 20:28:32.360345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.340 [2024-11-20 20:28:32.360535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.340 [2024-11-20 20:28:32.360561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.340 [2024-11-20 20:28:32.360590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.340 [2024-11-20 20:28:32.362853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.340 [2024-11-20 20:28:32.371934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.340 [2024-11-20 20:28:32.372441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.340 [2024-11-20 20:28:32.372620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.340 [2024-11-20 20:28:32.372652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.340 [2024-11-20 20:28:32.372684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.340 [2024-11-20 20:28:32.372930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.340 [2024-11-20 20:28:32.373137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.340 [2024-11-20 20:28:32.373162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.340 [2024-11-20 20:28:32.373190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-20 20:28:32.375414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-20 20:28:32.384536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-20 20:28:32.384893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.385059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.385110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-20 20:28:32.385141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.601 [2024-11-20 20:28:32.385412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.601 [2024-11-20 20:28:32.385565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-20 20:28:32.385588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-20 20:28:32.385612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-20 20:28:32.387767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-20 20:28:32.396927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-20 20:28:32.397481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.397652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.397683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-20 20:28:32.397715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.601 [2024-11-20 20:28:32.397882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.601 [2024-11-20 20:28:32.398119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-20 20:28:32.398144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-20 20:28:32.398172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-20 20:28:32.400345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-20 20:28:32.409051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-20 20:28:32.409408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.409530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.409560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-20 20:28:32.409588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.601 [2024-11-20 20:28:32.409775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.601 [2024-11-20 20:28:32.409940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-20 20:28:32.409963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-20 20:28:32.409986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-20 20:28:32.412204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-20 20:28:32.421451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-20 20:28:32.421793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.421955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-20 20:28:32.421985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-20 20:28:32.422011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.601 [2024-11-20 20:28:32.422212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.601 [2024-11-20 20:28:32.422433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-20 20:28:32.422457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-20 20:28:32.422480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-20 20:28:32.424622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-20 20:28:32.433973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.434292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.434462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.434492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.434519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.434757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.434929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.434953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.434975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.437164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.446237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.446637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.446783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.446814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.446841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.447097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.447291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.447315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.447338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.449358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.458526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.458806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.458976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.459007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.459033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.459187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.459382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.459405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.459426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.461563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.470725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.471052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.471240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.471271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.471298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.471466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.471692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.471715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.471736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.473697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.483030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.483334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.483477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.483508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.483534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.483738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.483888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.483911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.483932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.486016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.495223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.495583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.495720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.495751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.495778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.496078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.496283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.496307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.496330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.498594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.507334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.507704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.507847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.507878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.507904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.508104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.508285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.508310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.508332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.510487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.519733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.520053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.520169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.520199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.520227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.520476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.520641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.520663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.520684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.522769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.531948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.532275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.532381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.532412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-20 20:28:32.532439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.602 [2024-11-20 20:28:32.532593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.602 [2024-11-20 20:28:32.532761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-20 20:28:32.532784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-20 20:28:32.532806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-20 20:28:32.534738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-20 20:28:32.544118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-20 20:28:32.544423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-20 20:28:32.544563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.544593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.544626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.544813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.544992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.545015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.545036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.547308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.556393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.556733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.556838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.556868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.556895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.557121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.557265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.557290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.557312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.559278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.568514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.568805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.568946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.568976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.569002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.569144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.569324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.569349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.569386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.571390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.580813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.581084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.581270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.581300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.581327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.581487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.581682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.581704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.581725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.583934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.593095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.593429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.593543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.593573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.593600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.593802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.593951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.593973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.593994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.596196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.605461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.605754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.605862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.605892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.605920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.606134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.606321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.606358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.606379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.608346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.617732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.618079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.618225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.618256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.618284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.618458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.618627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.618652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.618675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.620957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.603 [2024-11-20 20:28:32.629952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.603 [2024-11-20 20:28:32.630219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.630332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.603 [2024-11-20 20:28:32.630362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.603 [2024-11-20 20:28:32.630389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.603 [2024-11-20 20:28:32.630592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.603 [2024-11-20 20:28:32.630771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.603 [2024-11-20 20:28:32.630794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.603 [2024-11-20 20:28:32.630815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.603 [2024-11-20 20:28:32.633118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-20 20:28:32.642249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-20 20:28:32.642558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-20 20:28:32.642723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-20 20:28:32.642754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-20 20:28:32.642782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.863 [2024-11-20 20:28:32.643002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.643151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.643175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.643198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.645307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.654451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.654803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.654908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.654939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.654966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.655180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.655356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.655399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.655421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.657447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.666741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.667009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.667144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.667181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.667208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.667394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.667560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.667582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.667603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.669710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.679023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.679355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.679490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.679521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.679547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.679750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.679988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.680011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.680032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.682248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.691339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.691747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.691861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.691892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.691919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.692119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.692279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.692303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.692334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.694421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.703446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.703803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.703944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.703974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.704000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.704215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.704406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.704443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.704465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.706646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.715735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.716001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.716169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.716200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.716227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.716433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.716599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.716621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.716642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.718777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.728093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.728373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.728532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.728563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.728590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.728798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.728963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.728985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.729007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.731207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.740550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.740894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.741062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.741100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.741127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.741376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.741526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.864 [2024-11-20 20:28:32.741549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.864 [2024-11-20 20:28:32.741570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.864 [2024-11-20 20:28:32.743646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.864 [2024-11-20 20:28:32.752851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.864 [2024-11-20 20:28:32.753161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.753275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-20 20:28:32.753305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.864 [2024-11-20 20:28:32.753331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.864 [2024-11-20 20:28:32.753508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.864 [2024-11-20 20:28:32.753672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.753695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.753716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.755715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.765023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.765358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.765478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.765509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.765536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.765753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.765917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.765940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.765960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.768183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.777218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.777588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.777692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.777722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.777749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.777981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.778189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.778213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.778234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.780342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.789537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.789841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.790018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.790049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.790084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.790258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.790470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.790493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.790513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.792568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.801672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.802020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.802158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.802189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.802216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.802448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.802614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.802636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.802657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.804635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.813880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.814150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.814287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.814318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.814344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.814493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.814663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.814686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.814707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.816787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.826232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.826606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.826779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.826810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.826837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.826993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.827189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.827213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.827234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.829386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.838491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.838783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.838920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.838950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.838976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.839189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.839373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.839395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.839416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.841606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.850810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.851183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.851317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.851348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.851375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.851550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.851736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.851759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.851781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.854005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.863151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.863446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.863586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-20 20:28:32.863617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.865 [2024-11-20 20:28:32.863644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.865 [2024-11-20 20:28:32.863814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.865 [2024-11-20 20:28:32.864009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.865 [2024-11-20 20:28:32.864032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.865 [2024-11-20 20:28:32.864066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.865 [2024-11-20 20:28:32.866270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.865 [2024-11-20 20:28:32.875455] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.865 [2024-11-20 20:28:32.875779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-20 20:28:32.875921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-20 20:28:32.875952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.866 [2024-11-20 20:28:32.875980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.866 [2024-11-20 20:28:32.876185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.866 [2024-11-20 20:28:32.876348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.866 [2024-11-20 20:28:32.876372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.866 [2024-11-20 20:28:32.876395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.866 [2024-11-20 20:28:32.878575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.866 [2024-11-20 20:28:32.887725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.866 [2024-11-20 20:28:32.888039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-20 20:28:32.888170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-20 20:28:32.888200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:27.866 [2024-11-20 20:28:32.888234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:27.866 [2024-11-20 20:28:32.888484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:27.866 [2024-11-20 20:28:32.888647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.866 [2024-11-20 20:28:32.888670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.866 [2024-11-20 20:28:32.888691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.866 [2024-11-20 20:28:32.890789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-20 20:28:32.900117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.900443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.900547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.900577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.900604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.900809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.900989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.901011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.901032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.903209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.912581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.912952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.913099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.913130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.913155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.913290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.913463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.913486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.913507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.915509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.924888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.925209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.925320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.925351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.925378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.925604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.925784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.925807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.925828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.927971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.937248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.937652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.937797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.937828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.937854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.938022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.938231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.938256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.938278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.940375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.949464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.949799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.949937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.949968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.949995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.950177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.950353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.950391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.950413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.952395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.961704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.962089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.962204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.962234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.962261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.962516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.962650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.962673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.962694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.964734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.973875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.974206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.974326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.974356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.974383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.974586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.974810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.974834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.974857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.977007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.986403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.986658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.986774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.986803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.986830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.987033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.987240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.987264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.987286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:32.989145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:32.998828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:32.999204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.999364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.126 [2024-11-20 20:28:32.999395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.126 [2024-11-20 20:28:32.999421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.126 [2024-11-20 20:28:32.999623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.126 [2024-11-20 20:28:32.999792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.126 [2024-11-20 20:28:32.999815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.126 [2024-11-20 20:28:32.999837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.126 [2024-11-20 20:28:33.001926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.126 [2024-11-20 20:28:33.011062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.126 [2024-11-20 20:28:33.011442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.011554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.011585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.011612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.011832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.011981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.012005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.012026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.014206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.023486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.023809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.023962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.023993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.024020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.024220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.024426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.024449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.024470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.026521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.036096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.036381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.036517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.036547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.036575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.036807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.036955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.036978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.037006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.039244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.048527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.048836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.048977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.049008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.049035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.049222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.049422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.049445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.049467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.051703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.060783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.061108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.061250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.061281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.061308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.061556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.061721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.061744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.061765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.063701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.072992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.073289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.073458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.073489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.073515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.073705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.073899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.073921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.073948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.076162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.085331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.085723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.085861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.085892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.085919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.086117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.086256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.086280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.086303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.088371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.097663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.097977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.098148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.098179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.098206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.098412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.098577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.098600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.098622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.100716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.109942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.110255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.110367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.110402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.127 [2024-11-20 20:28:33.110429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.127 [2024-11-20 20:28:33.110623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.127 [2024-11-20 20:28:33.110793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.127 [2024-11-20 20:28:33.110817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.127 [2024-11-20 20:28:33.110838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.127 [2024-11-20 20:28:33.112970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.127 [2024-11-20 20:28:33.122091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.127 [2024-11-20 20:28:33.122439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-20 20:28:33.122578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.122609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.128 [2024-11-20 20:28:33.122638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.128 [2024-11-20 20:28:33.122827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.128 [2024-11-20 20:28:33.123021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.128 [2024-11-20 20:28:33.123044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.128 [2024-11-20 20:28:33.123090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.128 [2024-11-20 20:28:33.125201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.128 [2024-11-20 20:28:33.134354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.128 [2024-11-20 20:28:33.134644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.134782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.134813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.128 [2024-11-20 20:28:33.134839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.128 [2024-11-20 20:28:33.135033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.128 [2024-11-20 20:28:33.135244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.128 [2024-11-20 20:28:33.135269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.128 [2024-11-20 20:28:33.135292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.128 [2024-11-20 20:28:33.137311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.128 [2024-11-20 20:28:33.146718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.128 [2024-11-20 20:28:33.147081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.147226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.147256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.128 [2024-11-20 20:28:33.147283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.128 [2024-11-20 20:28:33.147489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.128 [2024-11-20 20:28:33.147617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.128 [2024-11-20 20:28:33.147641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.128 [2024-11-20 20:28:33.147664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.128 [2024-11-20 20:28:33.149836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.128 20:28:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:28.128 20:28:33 -- common/autotest_common.sh@862 -- # return 0 00:27:28.128 20:28:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:28.128 20:28:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:28.128 20:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:28.128 [2024-11-20 20:28:33.159261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.128 [2024-11-20 20:28:33.159583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.159723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-20 20:28:33.159753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.128 [2024-11-20 20:28:33.159780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.128 [2024-11-20 20:28:33.160002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.128 [2024-11-20 20:28:33.160183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.128 [2024-11-20 20:28:33.160208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.128 [2024-11-20 20:28:33.160233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.387 [2024-11-20 20:28:33.162484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.387 [2024-11-20 20:28:33.171564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.387 [2024-11-20 20:28:33.171965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.387 [2024-11-20 20:28:33.172109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.387 [2024-11-20 20:28:33.172140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.387 [2024-11-20 20:28:33.172167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.172325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.172495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.172519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.172542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 [2024-11-20 20:28:33.174531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 20:28:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:28.388 20:28:33 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:28.388 20:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.388 20:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:28.388 [2024-11-20 20:28:33.183875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 [2024-11-20 20:28:33.184185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.184307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.184338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.388 [2024-11-20 20:28:33.184365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.184379] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:28.388 [2024-11-20 20:28:33.184609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.184756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.184788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.184811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 [2024-11-20 20:28:33.186955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 20:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.388 20:28:33 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:28.388 20:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.388 20:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:28.388 [2024-11-20 20:28:33.196260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 [2024-11-20 20:28:33.196618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.196763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.196793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.388 [2024-11-20 20:28:33.196820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.197066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.197300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.197324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.197347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 [2024-11-20 20:28:33.199517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 [2024-11-20 20:28:33.208606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 [2024-11-20 20:28:33.208940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.209080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.209111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.388 [2024-11-20 20:28:33.209138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.209339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.209518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.209540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.209561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 [2024-11-20 20:28:33.211761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 [2024-11-20 20:28:33.220759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 [2024-11-20 20:28:33.221288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.221458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.221489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.388 [2024-11-20 20:28:33.221520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.221795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.222007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.222030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.222080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 [2024-11-20 20:28:33.224226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 Malloc0 00:27:28.388 [2024-11-20 20:28:33.233146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 20:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.388 20:28:33 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:28.388 20:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.388 [2024-11-20 20:28:33.233572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 20:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:28.388 [2024-11-20 20:28:33.233739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.233771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.388 [2024-11-20 20:28:33.233802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.233998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.234190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.234215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.234240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 [2024-11-20 20:28:33.236586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 20:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.388 20:28:33 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:28.388 20:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.388 20:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:28.388 [2024-11-20 20:28:33.245640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 [2024-11-20 20:28:33.246021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.246166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.388 [2024-11-20 20:28:33.246197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x112a160 with addr=10.0.0.2, port=4420 00:27:28.388 [2024-11-20 20:28:33.246225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112a160 is same with the state(5) to be set 00:27:28.388 [2024-11-20 20:28:33.246444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a160 (9): Bad file descriptor 00:27:28.388 [2024-11-20 20:28:33.246608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.388 [2024-11-20 20:28:33.246631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.388 [2024-11-20 20:28:33.246653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.388 20:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.388 20:28:33 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:28.388 20:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.388 [2024-11-20 20:28:33.249114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.388 20:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:28.388 [2024-11-20 20:28:33.252656] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:28.388 20:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.388 20:28:33 -- host/bdevperf.sh@38 -- # wait 3276847 00:27:28.388 [2024-11-20 20:28:33.257905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.388 [2024-11-20 20:28:33.288723] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:38.369 00:27:38.369 Latency(us) 00:27:38.369 [2024-11-20T19:28:43.408Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:38.369 [2024-11-20T19:28:43.408Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:38.369 Verification LBA range: start 0x0 length 0x4000 00:27:38.369 Nvme1n1 : 15.01 8939.89 34.92 15783.62 0.00 5162.41 691.77 26602.76 00:27:38.369 [2024-11-20T19:28:43.408Z] =================================================================================================================== 00:27:38.369 [2024-11-20T19:28:43.408Z] Total : 8939.89 34.92 15783.62 0.00 5162.41 691.77 26602.76 00:27:38.369 20:28:41 -- host/bdevperf.sh@39 -- # sync 00:27:38.369 20:28:41 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:38.369 20:28:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.369 20:28:41 -- common/autotest_common.sh@10 -- # set +x 00:27:38.369 20:28:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.369 20:28:41 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:38.369 20:28:41 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:38.369 20:28:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:38.369 20:28:41 -- nvmf/common.sh@116 -- # sync 00:27:38.369 20:28:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:38.369 20:28:41 -- nvmf/common.sh@119 -- # set +e 00:27:38.369 20:28:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:38.369 20:28:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:38.369 rmmod nvme_tcp 00:27:38.369 rmmod nvme_fabrics 00:27:38.369 rmmod nvme_keyring 00:27:38.369 20:28:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:38.369 20:28:41 -- nvmf/common.sh@123 -- # set -e 00:27:38.369 20:28:41 -- nvmf/common.sh@124 -- # return 0 00:27:38.369 20:28:41 -- nvmf/common.sh@477 -- # '[' -n 3277538 ']' 00:27:38.369 20:28:41 -- nvmf/common.sh@478 -- # killprocess 3277538 00:27:38.369 20:28:41 -- common/autotest_common.sh@936 -- # '[' -z 3277538 ']' 00:27:38.369 20:28:41 -- common/autotest_common.sh@940 -- # kill -0 3277538 00:27:38.369 20:28:41 -- common/autotest_common.sh@941 -- # uname 00:27:38.369 20:28:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:38.369 20:28:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3277538 00:27:38.369 20:28:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:38.369 20:28:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:38.369 20:28:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3277538' 00:27:38.369 killing process with pid 3277538 00:27:38.369 20:28:42 -- common/autotest_common.sh@955 -- # kill 3277538 00:27:38.369 20:28:42 -- common/autotest_common.sh@960 -- # wait 3277538 00:27:38.369 20:28:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:38.370 20:28:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:38.370 20:28:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:38.370 20:28:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:38.370 20:28:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:38.370 20:28:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:38.370 20:28:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:38.370 20:28:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.749 20:28:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:39.749 00:27:39.749 real 0m23.617s 00:27:39.749 user 1m3.660s 00:27:39.749 sys 0m4.363s 00:27:39.749 20:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:39.749 20:28:44 -- common/autotest_common.sh@10 -- # set +x 00:27:39.749 ************************************ 00:27:39.749 END TEST nvmf_bdevperf 00:27:39.749 ************************************ 00:27:39.749 20:28:44 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:39.749 20:28:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:39.749 20:28:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:39.749 20:28:44 -- common/autotest_common.sh@10 -- # set +x 00:27:39.749 ************************************ 00:27:39.749 START TEST nvmf_target_disconnect 00:27:39.749 ************************************ 00:27:39.750 20:28:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:39.750 * Looking for test storage... 00:27:39.750 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:39.750 20:28:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:39.750 20:28:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:39.750 20:28:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:39.750 20:28:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:39.750 20:28:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:39.750 20:28:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:39.750 20:28:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:39.750 20:28:44 -- scripts/common.sh@335 -- # IFS=.-: 00:27:39.750 20:28:44 -- scripts/common.sh@335 -- # read -ra ver1 00:27:39.750 20:28:44 -- scripts/common.sh@336 -- # IFS=.-: 00:27:39.750 20:28:44 -- scripts/common.sh@336 -- # read -ra ver2 00:27:39.750 20:28:44 -- scripts/common.sh@337 -- # local 'op=<' 00:27:39.750 20:28:44 -- scripts/common.sh@339 -- # ver1_l=2 00:27:39.750 20:28:44 -- scripts/common.sh@340 -- # ver2_l=1 00:27:39.750 20:28:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:39.750 20:28:44 -- scripts/common.sh@343 -- # case "$op" in 00:27:39.750 20:28:44 -- scripts/common.sh@344 -- # : 1 00:27:39.750 20:28:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:39.750 20:28:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:39.750 20:28:44 -- scripts/common.sh@364 -- # decimal 1 00:27:39.750 20:28:44 -- scripts/common.sh@352 -- # local d=1 00:27:39.750 20:28:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:39.750 20:28:44 -- scripts/common.sh@354 -- # echo 1 00:27:39.750 20:28:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:39.750 20:28:44 -- scripts/common.sh@365 -- # decimal 2 00:27:39.750 20:28:44 -- scripts/common.sh@352 -- # local d=2 00:27:39.750 20:28:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:39.750 20:28:44 -- scripts/common.sh@354 -- # echo 2 00:27:39.750 20:28:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:39.750 20:28:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:39.750 20:28:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:39.750 20:28:44 -- scripts/common.sh@367 -- # return 0 00:27:39.750 20:28:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:39.750 20:28:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:39.750 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.750 --rc genhtml_branch_coverage=1 00:27:39.750 --rc genhtml_function_coverage=1 00:27:39.750 --rc genhtml_legend=1 00:27:39.750 --rc geninfo_all_blocks=1 00:27:39.750 --rc geninfo_unexecuted_blocks=1 00:27:39.750 00:27:39.750 ' 00:27:39.750 20:28:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:39.750 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.750 --rc genhtml_branch_coverage=1 00:27:39.750 --rc genhtml_function_coverage=1 00:27:39.750 --rc genhtml_legend=1 00:27:39.750 --rc geninfo_all_blocks=1 00:27:39.750 --rc geninfo_unexecuted_blocks=1 00:27:39.750 00:27:39.750 ' 00:27:39.750 20:28:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:39.750 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.750 --rc genhtml_branch_coverage=1 00:27:39.750 --rc genhtml_function_coverage=1 00:27:39.750 --rc genhtml_legend=1 00:27:39.750 --rc geninfo_all_blocks=1 00:27:39.750 --rc geninfo_unexecuted_blocks=1 00:27:39.750 00:27:39.750 ' 00:27:39.750 20:28:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:39.750 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.750 --rc genhtml_branch_coverage=1 00:27:39.750 --rc genhtml_function_coverage=1 00:27:39.750 --rc genhtml_legend=1 00:27:39.750 --rc geninfo_all_blocks=1 00:27:39.750 --rc geninfo_unexecuted_blocks=1 00:27:39.750 00:27:39.750 ' 00:27:39.750 20:28:44 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:39.750 20:28:44 -- nvmf/common.sh@7 -- # uname -s 00:27:39.750 20:28:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:39.750 20:28:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:39.750 20:28:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:39.750 20:28:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:39.750 20:28:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:39.750 20:28:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:39.750 20:28:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:39.750 20:28:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:39.750 20:28:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:39.750 20:28:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:39.750 20:28:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.750 20:28:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.750 20:28:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:39.750 20:28:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:39.750 20:28:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:39.750 20:28:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:39.750 20:28:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:39.750 20:28:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:39.750 20:28:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:39.750 20:28:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.750 20:28:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.750 20:28:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.750 20:28:44 -- paths/export.sh@5 -- # export PATH 00:27:39.750 20:28:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.750 20:28:44 -- nvmf/common.sh@46 -- # : 0 00:27:39.750 20:28:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:39.750 20:28:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:39.750 20:28:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:39.750 20:28:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:39.750 20:28:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:39.750 20:28:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:39.750 20:28:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:39.750 20:28:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:39.750 20:28:44 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:39.750 20:28:44 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:39.750 20:28:44 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:39.750 20:28:44 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:39.750 20:28:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:39.750 20:28:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:39.750 20:28:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:39.750 20:28:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:39.750 20:28:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:39.750 20:28:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:39.750 20:28:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:39.750 20:28:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.750 20:28:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:39.750 20:28:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:39.750 20:28:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:39.750 20:28:44 -- common/autotest_common.sh@10 -- # set +x 00:27:41.656 20:28:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:41.656 20:28:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:41.656 20:28:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:41.656 20:28:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:41.656 20:28:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:41.656 20:28:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:41.656 20:28:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:41.656 20:28:46 -- nvmf/common.sh@294 -- # net_devs=() 00:27:41.656 20:28:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:41.656 20:28:46 -- nvmf/common.sh@295 -- # e810=() 00:27:41.656 20:28:46 -- nvmf/common.sh@295 -- # local -ga e810 00:27:41.656 20:28:46 -- nvmf/common.sh@296 -- # x722=() 00:27:41.656 20:28:46 -- nvmf/common.sh@296 -- # local -ga x722 00:27:41.656 20:28:46 -- nvmf/common.sh@297 -- # mlx=() 00:27:41.656 20:28:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:41.656 20:28:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:41.656 20:28:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:41.656 20:28:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:41.657 20:28:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:41.657 20:28:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.657 20:28:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:41.657 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:41.657 20:28:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.657 20:28:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:41.657 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:41.657 20:28:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:41.657 20:28:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.657 20:28:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.657 20:28:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.657 20:28:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.657 20:28:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:41.657 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:41.657 20:28:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.657 20:28:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.657 20:28:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.657 20:28:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.657 20:28:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.657 20:28:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:41.657 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:41.657 20:28:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.657 20:28:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:41.657 20:28:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:41.657 20:28:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:41.657 20:28:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:41.657 20:28:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:41.657 20:28:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:41.657 20:28:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:41.657 20:28:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:41.657 20:28:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:41.657 20:28:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:41.657 20:28:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:41.657 20:28:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:41.657 20:28:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:41.657 20:28:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:41.657 20:28:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:41.657 20:28:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:41.657 20:28:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:41.657 20:28:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:41.657 20:28:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:41.657 20:28:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:41.657 20:28:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:41.657 20:28:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:41.657 20:28:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:41.657 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:41.657 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:27:41.657 00:27:41.657 --- 10.0.0.2 ping statistics --- 00:27:41.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.657 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:27:41.657 20:28:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:41.657 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:41.657 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:27:41.657 00:27:41.657 --- 10.0.0.1 ping statistics --- 00:27:41.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.657 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:27:41.657 20:28:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:41.657 20:28:46 -- nvmf/common.sh@410 -- # return 0 00:27:41.657 20:28:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:41.657 20:28:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:41.657 20:28:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:41.657 20:28:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:41.657 20:28:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:41.657 20:28:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:41.657 20:28:46 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:41.657 20:28:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:41.657 20:28:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.657 20:28:46 -- common/autotest_common.sh@10 -- # set +x 00:27:41.657 ************************************ 00:27:41.657 START TEST nvmf_target_disconnect_tc1 00:27:41.657 ************************************ 00:27:41.657 20:28:46 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:41.657 20:28:46 -- host/target_disconnect.sh@32 -- # set +e 00:27:41.657 20:28:46 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:41.657 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.915 [2024-11-20 20:28:46.710040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-20 20:28:46.710246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-20 20:28:46.710277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf89b40 with addr=10.0.0.2, port=4420 00:27:41.915 [2024-11-20 20:28:46.710317] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:41.915 [2024-11-20 20:28:46.710339] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:41.915 [2024-11-20 20:28:46.710355] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:41.915 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:41.915 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:41.915 Initializing NVMe Controllers 00:27:41.915 20:28:46 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:41.915 20:28:46 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:41.915 20:28:46 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:41.915 20:28:46 -- common/autotest_common.sh@1142 -- # return 0 00:27:41.915 20:28:46 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:41.915 20:28:46 -- host/target_disconnect.sh@41 -- # set -e 00:27:41.915 00:27:41.915 real 0m0.091s 00:27:41.915 user 0m0.037s 00:27:41.915 sys 0m0.053s 00:27:41.915 20:28:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:41.915 20:28:46 -- common/autotest_common.sh@10 -- # set +x 00:27:41.915 ************************************ 00:27:41.915 END TEST nvmf_target_disconnect_tc1 00:27:41.915 ************************************ 00:27:41.915 20:28:46 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:41.915 20:28:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:41.915 20:28:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.915 20:28:46 -- common/autotest_common.sh@10 -- # set +x 00:27:41.915 ************************************ 00:27:41.915 START TEST nvmf_target_disconnect_tc2 00:27:41.915 ************************************ 00:27:41.916 20:28:46 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:41.916 20:28:46 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:41.916 20:28:46 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:41.916 20:28:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:41.916 20:28:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:41.916 20:28:46 -- common/autotest_common.sh@10 -- # set +x 00:27:41.916 20:28:46 -- nvmf/common.sh@469 -- # nvmfpid=3280748 00:27:41.916 20:28:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:41.916 20:28:46 -- nvmf/common.sh@470 -- # waitforlisten 3280748 00:27:41.916 20:28:46 -- common/autotest_common.sh@829 -- # '[' -z 3280748 ']' 00:27:41.916 20:28:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:41.916 20:28:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:41.916 20:28:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:41.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:41.916 20:28:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:41.916 20:28:46 -- common/autotest_common.sh@10 -- # set +x 00:27:41.916 [2024-11-20 20:28:46.796254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:41.916 [2024-11-20 20:28:46.796345] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:41.916 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.916 [2024-11-20 20:28:46.858963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:42.174 [2024-11-20 20:28:46.968738] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:42.174 [2024-11-20 20:28:46.968880] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:42.174 [2024-11-20 20:28:46.968899] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:42.174 [2024-11-20 20:28:46.968912] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:42.174 [2024-11-20 20:28:46.968990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:42.174 [2024-11-20 20:28:46.969042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:42.174 [2024-11-20 20:28:46.969082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:42.174 [2024-11-20 20:28:46.969087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:43.112 20:28:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:43.112 20:28:47 -- common/autotest_common.sh@862 -- # return 0 00:27:43.112 20:28:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:43.112 20:28:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 20:28:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:43.112 20:28:47 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:43.112 20:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 Malloc0 00:27:43.112 20:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.112 20:28:47 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:43.112 20:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 [2024-11-20 20:28:47.880414] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:43.112 20:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.112 20:28:47 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:43.112 20:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 20:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.112 20:28:47 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:43.112 20:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 20:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.112 20:28:47 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:43.112 20:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 [2024-11-20 20:28:47.908693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:43.112 20:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.112 20:28:47 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:43.112 20:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.112 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:43.112 20:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.112 20:28:47 -- host/target_disconnect.sh@50 -- # reconnectpid=3280904 00:27:43.112 20:28:47 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:43.112 20:28:47 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:43.112 EAL: No free 2048 kB hugepages reported on node 1 00:27:45.028 20:28:49 -- host/target_disconnect.sh@53 -- # kill -9 3280748 00:27:45.028 20:28:49 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 [2024-11-20 20:28:49.933052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Read completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.028 Write completed with error (sct=0, sc=8) 00:27:45.028 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Read completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 Write completed with error (sct=0, sc=8) 00:27:45.029 starting I/O failed 00:27:45.029 [2024-11-20 20:28:49.933374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:45.029 [2024-11-20 20:28:49.933540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.933651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.933676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.933795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.933892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.933916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.934017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.934283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.934503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.934719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.934876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.934980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.935229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.935435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.935686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.935837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.935965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.936194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.936455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.936771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.936937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.937074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.937298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.937551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.937869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.937979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.938110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.938336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.938604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.938815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.938968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.939057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.939155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.939179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.029 [2024-11-20 20:28:49.939276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.939404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.029 [2024-11-20 20:28:49.939428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.029 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.939557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.939642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.939666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.939754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.939845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.939869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.939994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.940208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.940469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.940722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.940845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.940942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.941180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.941436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.941715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.941860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.941986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.942239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.942483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.942784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.942932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.943089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.943361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.943572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.943865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.943981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.944107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.944206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.944231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.944326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.944447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.944472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.944621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.944728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.944756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.944906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.945138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.945437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.945720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.945840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.945947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.946081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.946106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.946196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.946286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.946311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.030 qpair failed and we were unable to recover it. 00:27:45.030 [2024-11-20 20:28:49.946415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.030 [2024-11-20 20:28:49.946562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.946586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.946720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.946885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.946912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.947056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.947290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.947535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.947775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.947930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.948049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.948299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.948540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.948782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.948925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.949054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.949343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.949588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.949806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.949963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.950092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.950183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.950208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.951258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.951383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.951408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.951512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.951636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.951660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.951785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.951876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.951900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.952027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.952156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.952181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.952283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.952410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.952434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.952539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.952677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.952704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.952879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.953168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.953472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.953713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.953856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.954008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.954143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.954168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.954293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.954416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.954441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.031 qpair failed and we were unable to recover it. 00:27:45.031 [2024-11-20 20:28:49.954537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.031 [2024-11-20 20:28:49.954642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.954668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.954817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.955981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.956182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.956431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.956653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.956809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.956900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.957180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.957400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.957692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.957841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.957955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.958236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.958511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.958775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.958927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.959047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.959147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.959172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.959297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.959416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.959445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.959548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.959674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.959698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.959866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.960154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.960444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.960688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.960837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.960943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.961248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.961472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.961770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.961916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.962044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.962151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.962175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.962312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.962436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.962460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.962596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.962725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.962751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.962854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.963003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.963028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.963140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.963264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.032 [2024-11-20 20:28:49.963289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.032 qpair failed and we were unable to recover it. 00:27:45.032 [2024-11-20 20:28:49.963390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.963507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.963531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.963633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.963758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.963782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.963893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.964228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.964492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.964768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.964942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.965079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.965175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.965200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.965293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.965417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.965441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.965538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.965715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.965742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.965935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.966181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.966426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.966674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.966832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.966956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.967215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.967511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.967780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.967934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.968063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.968323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.968562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.968794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.968965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.969114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.969256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.969280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.969431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.969558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.969582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.969710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.969865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.969889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.033 qpair failed and we were unable to recover it. 00:27:45.033 [2024-11-20 20:28:49.970015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.970137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.033 [2024-11-20 20:28:49.970162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.970263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.970380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.970404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.970534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.970636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.970661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.970767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.970893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.970920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.971089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.971334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.971613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.971881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.971995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.972167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.972465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.972753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.972899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.973027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.973156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.973181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.973336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.973455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.973483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.973641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.973757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.973782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.973902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.974167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.974437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.974676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.974817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.974934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.975172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.975440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.975696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.975842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.976029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.976250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.976553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.976807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.976927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.977081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.977242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.977267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.977392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.977523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.977547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.977701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.977791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.977815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.034 qpair failed and we were unable to recover it. 00:27:45.034 [2024-11-20 20:28:49.977968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.034 [2024-11-20 20:28:49.978092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.978225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.978470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.978734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.978885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.978990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.979234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.979472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.979759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.979872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.979973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.980250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.980540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.980819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.980970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.981116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.981355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.981635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.981779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.981931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.982237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.982487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.982763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.982943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.983034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.983161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.983189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.983360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.983490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.983514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.983631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.983741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.983769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.983900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.984176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.984473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.984753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.984937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.985092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.985196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.985220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.035 [2024-11-20 20:28:49.985350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.985499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.035 [2024-11-20 20:28:49.985540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.035 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.985663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.985785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.985809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.985899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.986224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.986541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.986791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.986938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.987099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.987195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.987220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.987367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.987485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.987514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.987639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.987763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.987787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.987938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.988157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.988364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.988626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.988774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.988922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.989058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.989094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.989283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.989379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.989405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.989565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.989698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.989726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.989896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.990036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.990063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.990246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.990362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.990391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.990549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.990686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.990727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.990889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.991216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.991475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.991783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.991947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.992056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.992152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.992177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.992320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.992475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.992499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.992595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.992713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.992737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.992898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.993023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.993048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.993153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.993302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.993326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.036 [2024-11-20 20:28:49.993461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.993631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.036 [2024-11-20 20:28:49.993656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.036 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.993752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.993874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.993899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.994026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.994304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.994579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.994882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.994999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.995151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.995457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.995727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.995878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.996030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.996208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.996236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.996379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.996503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.996527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.996669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.996784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.996808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.996912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.997224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.997459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.997710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.997844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.997992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.998251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.998555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.998861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.998985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.999135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.999508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:49.999774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:49.999944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:50.000050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.000214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.000239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:50.000347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.000464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.000504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:50.000612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.000736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.000761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.037 qpair failed and we were unable to recover it. 00:27:45.037 [2024-11-20 20:28:50.000936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.001075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.037 [2024-11-20 20:28:50.001103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.001245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.001376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.001404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.001521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.001622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.001647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.001799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.001947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.001974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.002092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.002212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.002240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.002365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.002510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.002534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.002690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.002848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.002873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.002998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.003135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.003165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.003341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.003439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.003472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.003616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.003726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.003754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 [2024-11-20 20:28:50.003892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.004020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.038 [2024-11-20 20:28:50.004048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 qpair failed and we were unable to recover it. 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 [2024-11-20 20:28:50.004399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Write completed with error (sct=0, sc=8) 00:27:45.038 starting I/O failed 00:27:45.038 Read completed with error (sct=0, sc=8) 00:27:45.039 starting I/O failed 00:27:45.039 Read completed with error (sct=0, sc=8) 00:27:45.039 starting I/O failed 00:27:45.039 Read completed with error (sct=0, sc=8) 00:27:45.039 starting I/O failed 00:27:45.039 [2024-11-20 20:28:50.004706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:45.039 [2024-11-20 20:28:50.004841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.005153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.005415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.005667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.005801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.005918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.006257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.006569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.006853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.006983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.007097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.007199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.007226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.007385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.007523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.007561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.007690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.007813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.007847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.008019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.008173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.008208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.008328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.008500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.008538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.008698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.008816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.008860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.009023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.009130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.009157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.009283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.009458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.009485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.009610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.009790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.009818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.009955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.010115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.010141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.010241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.010383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.010411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.010523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.010683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.010710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.010876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.011200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.011430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.011733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.011917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.012058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.012183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.039 [2024-11-20 20:28:50.012209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.039 qpair failed and we were unable to recover it. 00:27:45.039 [2024-11-20 20:28:50.012335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.012502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.012530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.012669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.012809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.012837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.012981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.013139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.013165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.013288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.013403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.013430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.013547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.013722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.013749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.013916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.014225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.014525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.014828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.014967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.015131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.015488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.015825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.015985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.016113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.016241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.016266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.016392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.016505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.016533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.016639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.016772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.016800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.016932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.017179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.017446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.017711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.017872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.018018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.018153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.018178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.018286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.018400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.018427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.018563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.018680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.018709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.018917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.019212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.019483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.019806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.019974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.040 qpair failed and we were unable to recover it. 00:27:45.040 [2024-11-20 20:28:50.020126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.020219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.040 [2024-11-20 20:28:50.020246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.020369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.020554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.020582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.020741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.020879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.020908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.021030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.021196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.021222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.021324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.021459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.021488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.021596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.021715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.021746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.021914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.022083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.022131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.022239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.022335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.022361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.022528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.022697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.022751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.022892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.023191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.023423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.023679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.023827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.023986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.024235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.024531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.024804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.024938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.025079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.025231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.025256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.025402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.025574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.025599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.025716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.025807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.025834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.025929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.026024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.026051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.026282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.026447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.026496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.026647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.026770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.026795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.026902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.027185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.027561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.027824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.027970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.028138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.028260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.041 [2024-11-20 20:28:50.028286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.041 qpair failed and we were unable to recover it. 00:27:45.041 [2024-11-20 20:28:50.028390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.028517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.028544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.028665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.028793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.028818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.028970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.029227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.029528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.029814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.029959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.030097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.030239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.030267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.030401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.030537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.030562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.030701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.030847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.030873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.031092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.031190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.031216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.031315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.031437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.031479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.031615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.031760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.031797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.031969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.032304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.032598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.032860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.032981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.033164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.033428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.033712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.033867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.033993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.034283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.034569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.034859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.034984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.035009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.035163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.035271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.035314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.035412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.035512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.035537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.042 qpair failed and we were unable to recover it. 00:27:45.042 [2024-11-20 20:28:50.035671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.042 [2024-11-20 20:28:50.035772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.035798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.035928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.036206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.036480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.036792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.036951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.037059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.037318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.037537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.037805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.037924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.038018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.038146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.038172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.038357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.038522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.038550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.038699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.038797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.038824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.038942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.039200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.039462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.039669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.039818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.039986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.040120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.040148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.040313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.040451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.040479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.040628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.040776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.040801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.040954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.041049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.041092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.041248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.041374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.041401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.041559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.041691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.041732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.041867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.042170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.042415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.042727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.042918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.043083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.043198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.043226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.043373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.043498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.043525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.043 qpair failed and we were unable to recover it. 00:27:45.043 [2024-11-20 20:28:50.043674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.043786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.043 [2024-11-20 20:28:50.043814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.043942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.044221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.044546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.044860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.044992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.045170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.045276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.045303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.045513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.045685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.045711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.045836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.045961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.045990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.046141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.046240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.046266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.046420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.046555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.046584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.046688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.046825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.046853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.046986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.047140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.047166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.047352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.047559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.047602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.047740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.047919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.047945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.048036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.048134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.048160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.048256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.048383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.048408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.048529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.048696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.048723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.048895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.049212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.049517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.049842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.049996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.050185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.050463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.050718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.050830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.050937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.051202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.051546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.051824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.051980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.052107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.052236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.044 [2024-11-20 20:28:50.052261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.044 qpair failed and we were unable to recover it. 00:27:45.044 [2024-11-20 20:28:50.052347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.052441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.052466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.045 qpair failed and we were unable to recover it. 00:27:45.045 [2024-11-20 20:28:50.052571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.052738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.052766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.045 qpair failed and we were unable to recover it. 00:27:45.045 [2024-11-20 20:28:50.052900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.053110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.053137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.045 qpair failed and we were unable to recover it. 00:27:45.045 [2024-11-20 20:28:50.053287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.053389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.045 [2024-11-20 20:28:50.053416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.045 qpair failed and we were unable to recover it. 00:27:45.045 [2024-11-20 20:28:50.053524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.053617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.053643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.053808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.053908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.053935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.054089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.054361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.054615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.054868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.054986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.055116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.055228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.055256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.055365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.055574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.055604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.055722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.055846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.055873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.056063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.056168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.056198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.056338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.056457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.056485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.328 qpair failed and we were unable to recover it. 00:27:45.328 [2024-11-20 20:28:50.056600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.328 [2024-11-20 20:28:50.056749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.056774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.056923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.057166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.057482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.057808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.057958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.058097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.058283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.058308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.058402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.058521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.058546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.058721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.058815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.058844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.058978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.059276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.059589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.059882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.059981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.060179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.060465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.060744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.060937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.061080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.061183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.061208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.061336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.061529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.061557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.061697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.061808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.061836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.061984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.062301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.062558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.062867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.062999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.063023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.063128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.063294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.329 [2024-11-20 20:28:50.063320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.329 qpair failed and we were unable to recover it. 00:27:45.329 [2024-11-20 20:28:50.063437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.063606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.063633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.063757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.063884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.063908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.064026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.064204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.064232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.064361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.064459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.064487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.064607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.064708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.064733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.064862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.065205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.065528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.065841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.065974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.066144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.066450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.066729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.066944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.067146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.067297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.067339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.067464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.067589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.067615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.067749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.067879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.067904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.068048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.068185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.068213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.068365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.068490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.068515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.068676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.068811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.068838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.069012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.069257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.069557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.069816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.069982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.070100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.070250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.330 [2024-11-20 20:28:50.070275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.330 qpair failed and we were unable to recover it. 00:27:45.330 [2024-11-20 20:28:50.070444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.070647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.070672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.070816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.070982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.071183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.071456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.071738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.071888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.071981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.072270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.072884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.072986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.073143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.073477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.073757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.073882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.074015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.074164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.074195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.074310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.074472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.074501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.074675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.074796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.074821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.074976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.075081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.075126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.075331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.075459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.075486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.075639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.075757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.075782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.075908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.076316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.076617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.076870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.076996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.077154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.077279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.077306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.077464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.077565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.331 [2024-11-20 20:28:50.077592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.331 qpair failed and we were unable to recover it. 00:27:45.331 [2024-11-20 20:28:50.077748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.077899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.077925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.078081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.078260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.078287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.078430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.078560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.078584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.078714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.078837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.078861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.078984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.079156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.079185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.079326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.079423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.079448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.079562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.079702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.079744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.079863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.080220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.080474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.080729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.080858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.080974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.081267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.081566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.081824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.081935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.082081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.082290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.082319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.082482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.082615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.082643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.082780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.082927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.082968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.083137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.083245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.083272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.083410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.083618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.083646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.083797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.083925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.083950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.084078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.084345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.084603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.332 qpair failed and we were unable to recover it. 00:27:45.332 [2024-11-20 20:28:50.084835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.332 [2024-11-20 20:28:50.084957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.084981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.085134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.085292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.085317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.085416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.085566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.085590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.085693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.085840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.085865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.086012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.086121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.086150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.086304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.086456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.086481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.086611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.086751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.086793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.086923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.087049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.087081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.087210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.087344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.087370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.087495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.087667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.087695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.087846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.088025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.088075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.088250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.088353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.088379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.088529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.088642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.088670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.088804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.089200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.089471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.089778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.089912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.090028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.090289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.090557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.090867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.090986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.091153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.091279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.091303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.333 qpair failed and we were unable to recover it. 00:27:45.333 [2024-11-20 20:28:50.091440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.091551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.333 [2024-11-20 20:28:50.091579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.091696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.091792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.091817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.091990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.092152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.092178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.092310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.092405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.092448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.092598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.092750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.092776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.092908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.093270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.093510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.093809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.093940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.094087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.094189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.094215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.094338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.094436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.094463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.094606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.094707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.094734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.094899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.095214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.095509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.095804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.095940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.096057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.096192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.096217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.096363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.096507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.096532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.334 qpair failed and we were unable to recover it. 00:27:45.334 [2024-11-20 20:28:50.096617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.096787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.334 [2024-11-20 20:28:50.096814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.096936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.097062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.097108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.097291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.097431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.097459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.097599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.097694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.097721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.097903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.098182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.098512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.098764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.098930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.099128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.099252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.099277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.099454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.099602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.099628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.099783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.099947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.099975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.100114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.100223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.100253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.100389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.100492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.100519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.100726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.100894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.100922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.101064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.101182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.101210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.101376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.101483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.101526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.101654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.101804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.101830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.102019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.102156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.102186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.102330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.102461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.102485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.102609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.102706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.102731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.102853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.103056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.103092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.103259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.103370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.103398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.103538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.103672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.103697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.103919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.104055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.104090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.104256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.104365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.104408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.335 qpair failed and we were unable to recover it. 00:27:45.335 [2024-11-20 20:28:50.104505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.335 [2024-11-20 20:28:50.104633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.104662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.104823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.104948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.104974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.105105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.105243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.105284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.105441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.105535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.105561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.105715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.105866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.105890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.106015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.106151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.106178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.106324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.106423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.106449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.106593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.106735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.106763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.106901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.107213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.107477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.107841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.107972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.108146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.108534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.108816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.108968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.109080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.109202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.109228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.109373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.109541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.109566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.109699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.109859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.109885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.110005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.110335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.110577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.110824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.110996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.111143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.111235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.111260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.336 qpair failed and we were unable to recover it. 00:27:45.336 [2024-11-20 20:28:50.111355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.336 [2024-11-20 20:28:50.111468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.111495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.111643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.111769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.111795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.111936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.112034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.112058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.112216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.112332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.112359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.112517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.112645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.112671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.112892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.113183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.113451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.113760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.113908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.114034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.114191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.114217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.114422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.114587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.114614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.114782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.114902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.114928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.115022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.115322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.115594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.115889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.115989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.116160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.116397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.116727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.116887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.116992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.117304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.117557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.117883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.117997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.118026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.118178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.118318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.118343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.337 qpair failed and we were unable to recover it. 00:27:45.337 [2024-11-20 20:28:50.118495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.337 [2024-11-20 20:28:50.118586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.118611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.118798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.118921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.118946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.119083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.119230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.119254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.119372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.119494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.119519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.119619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.119716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.119742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.119913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.120079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.120105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.120226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.120363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.120392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.120553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.120697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.120724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.120865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.121223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.121547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.121858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.121985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.122131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.122263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.122287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.122381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.122472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.122497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.122642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.122753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.122795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.122923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.123253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.123511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.123855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.123991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.124171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.124427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.338 qpair failed and we were unable to recover it. 00:27:45.338 [2024-11-20 20:28:50.124706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.338 [2024-11-20 20:28:50.124851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.124993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.125142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.125167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.125266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.125394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.125419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.125571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.125706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.125730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.125863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.126154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.126521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.126875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.126995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.127114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.127358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.127660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.127799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.127940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.128082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.128108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.128338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.128453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.128481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.128650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.128796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.128821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.128974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.129098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.129124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.129250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.129373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.129400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.129577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.129714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.129741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.129884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.130136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.130384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.130684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.339 [2024-11-20 20:28:50.130847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.339 qpair failed and we were unable to recover it. 00:27:45.339 [2024-11-20 20:28:50.131017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.131161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.131187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.131315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.131465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.131495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.131680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.131776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.131801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.131981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.132151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.132180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.132316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.132464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.132491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.132603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.132704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.132732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.132879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.133230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.133487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.133764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.133893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.134021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.134148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.134173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.134282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.134485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.134510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.134686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.134801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.134829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.134965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.135170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.135195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.135304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.135426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.135451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.135617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.135732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.135760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.135891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.136222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.136469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.136775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.136943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.137076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.137186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.137212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.137377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.137495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.340 [2024-11-20 20:28:50.137523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.340 qpair failed and we were unable to recover it. 00:27:45.340 [2024-11-20 20:28:50.137726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.137833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.137861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.138005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.138118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.138161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.138283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.138426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.138454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.138582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.138679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.138707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.138945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.139161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.139187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.139396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.139503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.139532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.139675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.139850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.139874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.140022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.140148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.140174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.140273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.140399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.140423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.140553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.140727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.140770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.140910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.141232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.141536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.141849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.141986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.142176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.142505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.142812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.142980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.143149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.143368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.143396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.143500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.143638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.143665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.143794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.143930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.143959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.144081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.144214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.144239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.144349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.144488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.144515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.341 [2024-11-20 20:28:50.144623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.144782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.341 [2024-11-20 20:28:50.144810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.341 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.144948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.145237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.145497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.145793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.145931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.146061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.146203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.146228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.146338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.146455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.146488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.146636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.146812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.146840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.147021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.147182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.147208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.147318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.147460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.147488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.147623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.147787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.147815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.147926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.148216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.148480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.148764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.148943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.149111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.149236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.149261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.149419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.149583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.149610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.149744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.149849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.149877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.149992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.150120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.150153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.150259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.150405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.150432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.150567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.150715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.150742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.150846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.151026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.151053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.342 [2024-11-20 20:28:50.151236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.151365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.342 [2024-11-20 20:28:50.151391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.342 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.151630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.151760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.151788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.151926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.152277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.152569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.152844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.152983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.153177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.153453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.153704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.153884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.153995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.154140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.154166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.154317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.154464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.154492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.154638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.154861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.154888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.155052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.155288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.155615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.155891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.155995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.156144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.156457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.156761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.156929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.157107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.157232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.157257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.157361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.157491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.157517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.157741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.157874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.157902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.158040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.158170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.158197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.158354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.158498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.158525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.158670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.158797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.343 [2024-11-20 20:28:50.158821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.343 qpair failed and we were unable to recover it. 00:27:45.343 [2024-11-20 20:28:50.159006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.159143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.159170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.159317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.159489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.159521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.159659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.159795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.159823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.159997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.160103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.160129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.160367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.160502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.160530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.160704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.160811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.160839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.160974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.161141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.161167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.161268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.161399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.161424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.161592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.161717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.161741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.161886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.162203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.162513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.162761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.162885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.163005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.163163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.163188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.163328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.163435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.163462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.163580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.163719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.163744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.163879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.164240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.164558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.164817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.164971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.165180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.165312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.165339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.165440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.165603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.165630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.165782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.165943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.165970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.344 qpair failed and we were unable to recover it. 00:27:45.344 [2024-11-20 20:28:50.166135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.166263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.344 [2024-11-20 20:28:50.166288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.166426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.166531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.166558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.166664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.166816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.166843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.166984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.167132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.167161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.167304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.167390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.167415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.167561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.167715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.167740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.167871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.168211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.168517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.168859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.168981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.169097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.169240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.169268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.169393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.169501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.169529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.169645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.169778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.169802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.169901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.170047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.170080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.170218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.170368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.170396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.345 qpair failed and we were unable to recover it. 00:27:45.345 [2024-11-20 20:28:50.170522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.170653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.345 [2024-11-20 20:28:50.170678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.170770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.170889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.170914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.171096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.171269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.171297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.171503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.171627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.171653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.171813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.171935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.171965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.172084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.172327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.172563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.172880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.172994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.173205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.173535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.173783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.173988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.174162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.174288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.174315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.174434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.174558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.174583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.174694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.174814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.174842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.175018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.175181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.175222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.175369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.175464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.175489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.175584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.175709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.175734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.175888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.176196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.176431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.176743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.176897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.177060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.177205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.346 [2024-11-20 20:28:50.177233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.346 qpair failed and we were unable to recover it. 00:27:45.346 [2024-11-20 20:28:50.177399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.177506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.177535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.177652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.177803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.177828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.177931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.178204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.178512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.178857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.178979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.179159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.179470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.179776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.179934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.180050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.180210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.180236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.180385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.180532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.180573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.180729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.180885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.180910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.181054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.181260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.181286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.181392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.181563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.181592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.181734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.181837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.181862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.182021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.182190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.182219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.182364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.182516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.182544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.182721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.182846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.182871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.183018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.183112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.183137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.183330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.183498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.183527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.183696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.183829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.183857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.184011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.184137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.184163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.184290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.184384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.184410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.184555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.184709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.347 [2024-11-20 20:28:50.184736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.347 qpair failed and we were unable to recover it. 00:27:45.347 [2024-11-20 20:28:50.184836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.184941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.184983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.185083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.185219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.185245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.185332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.185442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.185468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.185690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.185830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.185858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.185997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.186165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.186190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.186326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.186471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.186498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.186649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.186849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.186890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.187061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.187223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.187249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.187348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.187508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.187534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.187648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.187749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.187793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.187919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.188118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.188144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.188331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.188503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.188531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.188677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.188775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.188817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.188936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.189083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.189113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.189261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.189385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.189410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.189627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.189734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.189762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.189898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.190272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.190545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.190794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.190949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.191065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.191181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.191209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.191344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.191494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.191524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.348 qpair failed and we were unable to recover it. 00:27:45.348 [2024-11-20 20:28:50.191654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.348 [2024-11-20 20:28:50.191787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.191812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.191949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.192123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.192150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.192308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.192411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.192439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.192576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.192713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.192741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.192861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.193029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.193077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.193226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.193377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.193405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.193571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.193719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.193743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.193893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.194158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.194419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.194716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.194861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.194993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.195135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.195163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.195321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.195539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.195566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.195681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.195847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.195874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.196033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.196150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.196178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.196293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.196459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.196487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.196663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.196843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.196871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.197017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.197153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.197183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.197325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.197453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.197480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.197630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.197743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.197771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.197926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.198219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.198553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.349 qpair failed and we were unable to recover it. 00:27:45.349 [2024-11-20 20:28:50.198847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.349 [2024-11-20 20:28:50.198976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.199102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.199396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.199701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.199903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.200040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.200207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.200235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.200381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.200527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.200570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.200730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.200855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.200880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.201020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.201196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.201232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.201333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.201447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.201475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.201600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.201730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.201756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.201879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.202215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.202516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.202847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.202996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.203125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.203215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.203240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.203380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.203502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.203527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.203657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.203822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.203851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.203997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.204282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.204537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.204852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.204993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.205138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.205274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.205299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.205456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.205633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.205665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.205808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.205970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.205997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.206142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.206306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.206335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.206489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.206582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.206607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.206737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.206869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.206897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.350 qpair failed and we were unable to recover it. 00:27:45.350 [2024-11-20 20:28:50.207061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.350 [2024-11-20 20:28:50.207203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.207239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.207401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.207503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.207529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.207671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.207770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.207794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.207929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.208201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.208544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.208865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.208990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.209095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.209244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.209269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.209386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.209480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.209505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.209626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.209727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.209770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.209888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.210279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.210585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.210878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.210991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.211020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.211176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.211301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.211326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.211505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.211610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.211638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.211816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.211980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.212008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.212154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.212284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.212312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.212463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.212619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.212644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.351 qpair failed and we were unable to recover it. 00:27:45.351 [2024-11-20 20:28:50.212772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.351 [2024-11-20 20:28:50.212915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.212944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.213082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.213190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.213219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.213362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.213491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.213519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.213631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.213731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.213756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.213911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.214180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.214414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.214726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.214878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.214977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.215307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.215567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.215785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.215931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.216110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.216245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.216271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.216402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.216538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.216565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.216671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.216777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.216805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.216963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.217228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.217549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.217850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.217978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.218176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.218468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.218806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.218933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.352 qpair failed and we were unable to recover it. 00:27:45.352 [2024-11-20 20:28:50.219039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.352 [2024-11-20 20:28:50.219218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.219243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.219397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.219500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.219525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.219662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.219818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.219846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.219950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.220235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.220520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.220751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.220899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.221046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.221172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.221202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.221346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.221463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.221491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.221630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.221732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.221757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.221909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.222243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.222475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.222759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.222904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.223081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.223250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.223275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.223434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.223554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.223596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.223723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.223888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.223916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.224054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.224284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.224550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.224815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.224959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.225001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.225139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.225236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.225261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.353 qpair failed and we were unable to recover it. 00:27:45.353 [2024-11-20 20:28:50.225446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.353 [2024-11-20 20:28:50.225597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.225622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.225741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.225868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.225894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.226047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.226217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.226252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.226385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.226518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.226541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.226668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.226815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.226838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.226935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.227246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.227511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.227799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.227967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.228138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.228229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.228253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.228374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.228492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.228534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.228682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.228822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.228848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.228952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.229243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.229574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.229877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.229978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.230164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.230541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.230820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.230947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.231043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.231204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.231229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.231371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.231544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.231569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.231664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.231853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.231880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.231983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.232276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.232547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.232830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.232994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.354 qpair failed and we were unable to recover it. 00:27:45.354 [2024-11-20 20:28:50.233125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.354 [2024-11-20 20:28:50.233257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.233281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.233389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.233519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.233544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.233662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.233818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.233843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.233970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.234268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.234607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.234866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.234995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.235197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.235468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.235750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.235900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.236039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.236171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.236196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.236324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.236467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.236494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.236632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.236742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.236769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.236931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.237042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.237067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.237179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.237326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.237351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.237566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.237720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.237744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.237967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.238103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.238133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.238271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.238400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.238425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.238589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.238735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.238761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.238906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.239188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.239491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.239752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.239899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.240014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.240188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.240214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.240336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.240474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.240502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.355 [2024-11-20 20:28:50.240625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.240780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.355 [2024-11-20 20:28:50.240805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.355 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.240958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.241248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.241497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.241759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.241937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.242039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.242150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.242176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.242327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.242443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.242471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.242621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.242753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.242777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.242928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.243160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.243498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.243730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.243935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.244159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.244255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.244280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.244388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.244539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.244566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.244711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.244817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.244844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.244957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.245112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.245155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.245303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.245455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.245498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.245612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.245753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.245782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.245899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.246204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.246508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.246809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.246942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.356 qpair failed and we were unable to recover it. 00:27:45.356 [2024-11-20 20:28:50.247083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.356 [2024-11-20 20:28:50.247201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.247226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.247370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.247475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.247503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.247624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.247729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.247755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.247879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.248221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.248543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.248827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.248945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.249062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.249227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.249252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.249392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.249527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.249555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.249716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.249820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.249850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.249975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.250324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.250619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.250883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.250994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.251207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.251461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.251780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.251909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.252047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.252161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.252201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.252323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.252423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.252448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.252595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.252706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.252733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.252873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.253197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.253477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.253841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.253978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.254132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.254231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.254256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.254402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.254600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.254649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.254769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.254896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.254921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.357 qpair failed and we were unable to recover it. 00:27:45.357 [2024-11-20 20:28:50.255038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.255170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.357 [2024-11-20 20:28:50.255196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.255294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.255415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.255457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.255585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.255718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.255746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.255891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.256170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.256437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.256718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.256852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.256995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.257300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.257573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.257843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.257987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.258133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.258364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.258718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.258877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.258977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.259264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.259482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.259756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.259891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.260058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.260232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.260256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.260357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.260478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.260502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.260651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.260799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.260824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.260916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.261247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.261508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.261795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.261971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.262099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.262198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.262223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.262316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.262498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.358 [2024-11-20 20:28:50.262525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.358 qpair failed and we were unable to recover it. 00:27:45.358 [2024-11-20 20:28:50.262652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.262746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.262771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.262898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.263215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.263424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.263702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.263831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.263954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.264206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.264458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.264775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.264922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.265033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.265173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.265198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.265301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.265446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.265472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.265619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.265730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.265757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.265925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.266172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.266498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.266789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.266961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.267081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.267178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.267205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.267305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.267460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.267485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.267617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.267707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.267748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.267909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.268181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.268427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.268674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.268798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.268945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.269229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.269513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.359 [2024-11-20 20:28:50.269827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.359 [2024-11-20 20:28:50.269954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.359 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.270082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.270189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.270214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.270303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.270439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.270463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.270596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.270721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.270746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.270873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.271189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.271435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.271733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.271883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.272146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.272172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.272339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.272474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.272500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.272592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.272721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.272746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.272889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.273201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.273514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.273782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.273961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.274094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.274209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.274251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.274354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.274480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.274513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.274628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.274770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.274795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.274916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.275230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.275507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.275778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.275958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.276107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.276215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.276247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.276377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.276511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.276536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.276639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.276788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.276816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.276919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.277049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.277083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.360 qpair failed and we were unable to recover it. 00:27:45.360 [2024-11-20 20:28:50.277212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.360 [2024-11-20 20:28:50.277314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.277339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.277451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.277589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.277616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.277776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.277900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.277927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.278104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.278205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.278230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.278328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.278482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.278507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.278650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.278776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.278804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.278982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.279256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.279523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.279820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.279968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.280062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.280166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.280206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.280300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.280424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.280451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.280596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.280723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.280748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.280905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.281247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.281558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.281822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.281981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.282131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.282338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.282615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.361 qpair failed and we were unable to recover it. 00:27:45.361 [2024-11-20 20:28:50.282899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.361 [2024-11-20 20:28:50.282997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.283147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.283401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.283694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.283847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.283983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.284113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.284138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.284298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.284423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.284448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.284641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.284725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.284749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.284863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.285143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.285383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.285678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.285838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.285939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.286227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.286535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.286815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.286961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.287075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.287226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.287254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.287403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.287493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.287518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.287661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.287837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.287864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.287963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.288241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.288512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.288803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.288945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.289089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.289245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.289270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.289371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.289494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.289537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.289654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.289781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.289805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.289946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.290052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.290088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.290227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.290363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.290390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.362 qpair failed and we were unable to recover it. 00:27:45.362 [2024-11-20 20:28:50.290536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.362 [2024-11-20 20:28:50.290684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.290713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.290839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.290962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.290986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.291113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.291234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.291274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.291394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.291543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.291570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.291673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.291783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.291811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.291960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.292052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.292081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.292238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.292369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.292396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.292501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.292627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.292655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.292820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.293147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.293399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.293717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.293875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.294012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.294281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.294532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.294869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.294992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.295151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.295455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.295708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.295863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.295962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.296144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.296170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.296318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.296447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.296474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.296632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.296766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.296790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.296914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.297202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.297431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.297703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.297855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.298015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.298162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.363 [2024-11-20 20:28:50.298191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.363 qpair failed and we were unable to recover it. 00:27:45.363 [2024-11-20 20:28:50.298301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.298450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.298474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.298611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.298700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.298740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.298891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.298979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.299138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.299456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.299735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.299924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.300062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.300189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.300213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.300362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.300525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.300552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.300657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.300772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.300799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.300905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.301107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.301143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.301305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.301406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.301436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.301586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.301751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.301778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.301929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.302076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.302120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.302223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.302362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.302389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.302540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.302676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.302701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.302846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.303185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.303454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.303720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.303892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.304034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.304286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.304607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.304834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.304986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.305090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.305213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.305260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.364 qpair failed and we were unable to recover it. 00:27:45.364 [2024-11-20 20:28:50.305389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.364 [2024-11-20 20:28:50.305517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.305546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.305657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.305786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.305813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.305934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.306223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.306514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.306809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.306952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.307103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.307250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.307292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.307414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.307575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.307602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.307736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.307867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.307894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.308028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.308312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.308577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.308825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.308968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.309064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.309181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.309222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.309345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.309473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.309498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.309689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.309786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.309812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.309916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.310229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.310518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.310861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.310994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.311171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.311481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.311791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.311986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.312136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.312282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.312307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.312467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.312611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.312638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.365 qpair failed and we were unable to recover it. 00:27:45.365 [2024-11-20 20:28:50.312761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.312873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.365 [2024-11-20 20:28:50.312900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.313017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.313139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.313164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.313295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.313431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.313475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.313601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.313737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.313764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.313911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.314212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.314461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.314789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.314981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.315169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.315470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.315700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.315862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.315983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.316254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.316537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.316759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.316900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.317027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.317189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.317217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.317319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.317465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.317505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.317630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.317780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.317804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.317956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.318100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.318129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.318263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.318433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.318461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.318588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.318748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.318772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.366 qpair failed and we were unable to recover it. 00:27:45.366 [2024-11-20 20:28:50.318904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.366 [2024-11-20 20:28:50.319030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.319189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.319500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.319785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.319918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.320061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.320224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.320249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.320412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.320563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.320592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.320703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.320838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.320880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.321008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.321175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.321203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.321340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.321490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.321515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.321681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.321786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.321811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.321961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.322200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.322550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.322834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.322961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.323076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.323186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.323228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.323390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.323567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.323599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.323743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.323840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.323873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.323977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.324096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.324123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.324297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.324438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.324491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.324612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.324748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.324789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.324918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.325244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.325603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.325892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.325989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.326152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.326415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.326721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.326859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.326998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.327146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.327182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.327307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.327431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.327455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.367 qpair failed and we were unable to recover it. 00:27:45.367 [2024-11-20 20:28:50.327579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.327711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.367 [2024-11-20 20:28:50.327736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.327883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.328166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.328413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.328669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.328804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.328985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.329116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.329142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.329288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.329452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.329480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.329632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.329756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.329780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.329895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.330215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.330457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.330786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.330912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.331009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.331325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.331657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.331896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.331987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.332011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.332111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.333236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.333270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.333400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.333550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.333578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.333716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.333826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.333868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.333968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.334255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.334500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.334771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.334937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.335096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.335225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.335250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.335340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.335453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.335489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.335603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.335737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.335764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.335907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.336174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.336470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.336746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.368 [2024-11-20 20:28:50.336911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.368 qpair failed and we were unable to recover it. 00:27:45.368 [2024-11-20 20:28:50.337066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.337347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.337564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.337864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.337985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.338009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.338183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.338318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.338344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.338535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.338642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.338666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.338763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.339764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.339799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.339990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.340315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.340609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.369 [2024-11-20 20:28:50.340858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.369 [2024-11-20 20:28:50.340983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.369 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.341090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.341205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.341235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.341366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.341477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.341505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.341632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.341755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.341780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.341939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.342216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.342502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.342755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.342918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.343078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.343347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.343629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.343853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.343985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.344081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.344233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.344258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.344386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.344515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.344542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.344689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.344871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.344898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.345022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.345315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.345597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.345877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.345985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.346157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.346438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.346767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.346916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.347023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.347280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.347494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.347770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.347903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.348020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.348156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.348181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.348266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.348364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.348390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.659 qpair failed and we were unable to recover it. 00:27:45.659 [2024-11-20 20:28:50.348543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.659 [2024-11-20 20:28:50.348764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.348799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.348945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.349284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.349549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.349775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.349936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.350035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.350291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.350530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.350807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.350964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.351060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.351178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.351205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.351306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.351437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.351466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.351616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.351718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.351746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.351882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.352172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.352511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.352764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.352898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.353024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.353289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.353567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.353806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.353983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.354083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.354193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.354218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.354314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.354425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.354451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.354658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.354793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.354818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.354919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.355205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.355499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.355767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.355997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.356109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.356201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.356227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.660 [2024-11-20 20:28:50.356325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.356433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.660 [2024-11-20 20:28:50.356460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.660 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.356569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.356688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.356713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.356803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.356913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.356939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.357145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.357242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.357267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.357361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.357533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.357559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.357684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.357782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.357808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.357940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.358188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.358449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.358730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.358872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.358997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.359252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.359494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.359804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.359933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.360036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.360281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.360536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.360822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.360981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.361098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.361322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.361578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.361836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.361959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.362074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.362176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.362205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.362304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.362509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.362535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.362662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.362820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.362846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.362969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.363208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.363452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.363816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.363964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.661 qpair failed and we were unable to recover it. 00:27:45.661 [2024-11-20 20:28:50.364091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.661 [2024-11-20 20:28:50.364197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.364318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.364547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.364837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.364962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.365078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.365314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.365573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.365840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.365994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.366101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.366323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.366562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.366803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.366958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.367092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.367304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.367570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.367821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.367978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.368093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.368243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.368289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.368388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.368515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.368541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.368643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.368782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.368807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.368922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.369229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.369553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.369849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.369976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.370078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.370179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.370211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.370310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.370470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.370495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.370642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.370782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.370807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.370912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.371045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.371088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.371196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.371297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.371322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.371424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.371553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.662 [2024-11-20 20:28:50.371579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.662 qpair failed and we were unable to recover it. 00:27:45.662 [2024-11-20 20:28:50.371707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.371834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.371861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.371969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.372225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.372456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.372738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.372893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.372991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.373249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.373508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.373784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.373947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.374045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.374279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.374525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.374781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.374918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.375054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.375314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.375646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.375879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.375997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.376102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.376335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.376595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.376848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.376968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.377105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.377199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.377224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.377343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.377471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.377497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.663 [2024-11-20 20:28:50.377591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.377717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.663 [2024-11-20 20:28:50.377744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.663 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.377863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.377988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.378142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.378372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.378687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.378839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.378935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.379059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.379101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.379203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.379297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.379322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.379473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ade600 is same with the state(5) to be set 00:27:45.664 [2024-11-20 20:28:50.379643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.379818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.379846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.379954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.380208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.380432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.380697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.380827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.380955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.381196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.381462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.381711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.381834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.381961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.382194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.382414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.382651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.382865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.382988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.383145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.383389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.383678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.383906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.383996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.384145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.384370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.384601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.384840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.664 [2024-11-20 20:28:50.384974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.664 qpair failed and we were unable to recover it. 00:27:45.664 [2024-11-20 20:28:50.385114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.385335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.385564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.385801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.385916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.386013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.386281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.386525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.386773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.386897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.387026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.387272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.387530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.387810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.387930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.388057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.388159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.388184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.388291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.388431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.388456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.388596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.388740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.388767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.388891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.389230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.389469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.389783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.389918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.390025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.390190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.390216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.390317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.390443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.390470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.390601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.390765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.390793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.390943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.391249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.391602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.391877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.391994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.392131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.392352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.392600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.665 [2024-11-20 20:28:50.392729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.665 qpair failed and we were unable to recover it. 00:27:45.665 [2024-11-20 20:28:50.392836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.392969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.392996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.393142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.393248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.393273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.393386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.393480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.393523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.393661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.393823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.393849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.393960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.394122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.394149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.394250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.394338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.394363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.394503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.394670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.394699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.395477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.395646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.395675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.395835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.396174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.396429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.396752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.396904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.397013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.397173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.397200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.397295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.397435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.397462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.397607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.397759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.397786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.397928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.398211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.398452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.398839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.398982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.399023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.399244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.399343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.399368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.399518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.399652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.399679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.399800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.399989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.400189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.400419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.400769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.400899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.401054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.401289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.401592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.666 [2024-11-20 20:28:50.401887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.401997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.666 [2024-11-20 20:28:50.402024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.666 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.402152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.402255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.402280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.402414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.402540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.402565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.402667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.402800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.402827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.403000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.403140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.403165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.403292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.403385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.403408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.403506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.403627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.403654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.403795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.404694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.404728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.404920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.405213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.405477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.405758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.405900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.406039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.406165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.406190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.406317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.406446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.406471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.406618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.406773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.406797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.407009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.407307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.407556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.407869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.407980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.408144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.408403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.408650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.408785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.408919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.409196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.409476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.409792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.409996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.410109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.410251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.410276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.410416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.410551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.410577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.410722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.410864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.410888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.667 qpair failed and we were unable to recover it. 00:27:45.667 [2024-11-20 20:28:50.411007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.411160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.667 [2024-11-20 20:28:50.411186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.411312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.411478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.411503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.411632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.411760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.411787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.411895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.411998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.412175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.412462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.412746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.412910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.413039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.413286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.413590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.413834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.413995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.414139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.414232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.414256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.414348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.414481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.414509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.414637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.414755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.414782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.414995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.415270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.415540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.415824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.415992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.416146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.416236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.416265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.416385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.416519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.416547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.416717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.416857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.416884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.416992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.417171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.417196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.417300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.417412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.417453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.417572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.417709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.417737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.417884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.418028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.418053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.668 [2024-11-20 20:28:50.418166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.418255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.668 [2024-11-20 20:28:50.418281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.668 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.418420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.418568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.418610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.418751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.418924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.418951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.419113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.419213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.419238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.419334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.419491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.419516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.419635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.419771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.419798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.419938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.420208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.420472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.420749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.420884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.421049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.421288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.421547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.421829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.421989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.422117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.422325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.422694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.422814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.422928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.423222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.423484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.423849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.423981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.424137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.424243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.424267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.424385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.424511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.424537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.424712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.424849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.424876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.425035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.425183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.425214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.425311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.425475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.425505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.425650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.425761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.425792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.425935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.426048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.426081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.426182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.426285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.426311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.669 qpair failed and we were unable to recover it. 00:27:45.669 [2024-11-20 20:28:50.426461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.426595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.669 [2024-11-20 20:28:50.426623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.426742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.426870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.426898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.427008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.427282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.427494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.427739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.427951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.428076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.428181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.428208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.428316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.428467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.428493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.428625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.428746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.428772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.428872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.429168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.429416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.429704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.429864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.429990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.430249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.430543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.430797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.430920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.431011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.431271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.431571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.431836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.431965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.432066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.432322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.432569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.432838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.432978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.433144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.433247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.433274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.433444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.433568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.433595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.433725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.433845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.433870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.434021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.434157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.670 [2024-11-20 20:28:50.434184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.670 qpair failed and we were unable to recover it. 00:27:45.670 [2024-11-20 20:28:50.434284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.434415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.434459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.434576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.434701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.434731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.434877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.434968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.434996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.435130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.435226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.435252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.435398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.435512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.435542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.435682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.435848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.435875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.436012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.436249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.436497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.436794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.436919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.437019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.437297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.437542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.437807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.437976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.438138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.438869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.438903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.439060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.439307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.439590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.439863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.439984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.440134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.440360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.440691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.440830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.440995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.441257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.441557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.441804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.441953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.442095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.442205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.442234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.442339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.442515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.442543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.671 [2024-11-20 20:28:50.442682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.442801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.671 [2024-11-20 20:28:50.442829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.671 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.442951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.443222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.443521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.443784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.443946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.444064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.444169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.444195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.444317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.444476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.444504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.444655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.444776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.444804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.444957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.445196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.445440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.445748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.445916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.446026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.446285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.446527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.446790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.446927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.447043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.447153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.447179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.447276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.447397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.447426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.447530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.447633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.447665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.447790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.448551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.448584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.448726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.448876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.448907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.449024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.449159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.449185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.449289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.449415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.449441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.449584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.449728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.449753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.449936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.450115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.450142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.450248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.450344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.672 [2024-11-20 20:28:50.450370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.672 qpair failed and we were unable to recover it. 00:27:45.672 [2024-11-20 20:28:50.450496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.450598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.450626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.450807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.450912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.450955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.451120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.451227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.451259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.451408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.451542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.451569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.451691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.451836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.451861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.452015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.452272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.452571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.452867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.452978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.453006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.453153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.453868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.453901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.454096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.455244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.455511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.455855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.455977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.456129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.456367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.456695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.456868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.456998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.457255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.457526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.457807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.457976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.458111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.458215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.458240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.458341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.458474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.458499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.458612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.458760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.458789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.458926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.459046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.459080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.459212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.459313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.459338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.459558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.459678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.459703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.459858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.460026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.460053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.673 qpair failed and we were unable to recover it. 00:27:45.673 [2024-11-20 20:28:50.460218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.673 [2024-11-20 20:28:50.460347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.460391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.460583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.460747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.460774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.460883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.461158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.461492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.461829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.461991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.462132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.462235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.462261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.462415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.462539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.462580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.462717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.462824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.462851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.463000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.463301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.463522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.463776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.463964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.464087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.464219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.464244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.464362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.464459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.464487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.464675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.464822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.464850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.465083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.465230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.465256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.465413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.465545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.465573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.465677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.465782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.465811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.466017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.466156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.466181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.466280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.466464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.466491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.466596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.466735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.466763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.466883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.467195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.467486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.467795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.467926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.468064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.468213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.468239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.468345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.468465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.468491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.468620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.468735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.674 [2024-11-20 20:28:50.468764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.674 qpair failed and we were unable to recover it. 00:27:45.674 [2024-11-20 20:28:50.468907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.469213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.469490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.469803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.469967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.470083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.470201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.470226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.470357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.470463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.470488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.470638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.470775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.470802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.470968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.471252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.471509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.471789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.471923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.472040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.472175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.472200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.472370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.472510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.472537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.472641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.472784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.472813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.473049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.473182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.473209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.473306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.473453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.473481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.473593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.473701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.473731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.473835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.474189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.474411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.474762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.474925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.475061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.475217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.475243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.475399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.475544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.475586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.475752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.475878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.475906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.476043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.476189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.476215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.476330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.476460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.476489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.476663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.476825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.476853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.477001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.477117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.477142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.675 qpair failed and we were unable to recover it. 00:27:45.675 [2024-11-20 20:28:50.477266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.477410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.675 [2024-11-20 20:28:50.477438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.477585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.477767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.477795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.477903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.478021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.478050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.478216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.478343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.478386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.478566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.478694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.478736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.478844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.479188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.479410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.479747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.479949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.480060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.480210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.480235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.480389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.480488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.480530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.480623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.480715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.480742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.480886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.481188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.481433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.481757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.481899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.482024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.482147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.482174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.482285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.482395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.482423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.482586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.482736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.482764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.482899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.483207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.483519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.483859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.483996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.484144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.484476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.484810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.484978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.485138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.485232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.485256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.485346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.485444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.485471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.485597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.485761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.485789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.676 qpair failed and we were unable to recover it. 00:27:45.676 [2024-11-20 20:28:50.485907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.676 [2024-11-20 20:28:50.486029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.486185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.486457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.486696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.486824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.486963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.487142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.487167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.487270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.487395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.487421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.487609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.487752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.487781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.487914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.488186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.488455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.488787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.488963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.489102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.489200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.489225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.489319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.489448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.489490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.489672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.489803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.489831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.489974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.490235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.490468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.490743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.490860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.490989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.491235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.491567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.491835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.491996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.492139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.492281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.492309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.492439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.492569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.677 [2024-11-20 20:28:50.492594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.677 qpair failed and we were unable to recover it. 00:27:45.677 [2024-11-20 20:28:50.492764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.492886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.492911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.493065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.493187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.493216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.493353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.493480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.493505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.493629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.493751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.493779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.493908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.494201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.494531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.494841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.494970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.495083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.495203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.495228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.495378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.495503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.495528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.495662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.495840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.495865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.495963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.496202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.496435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.496745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.496867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.496965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.497254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.497590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.497856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.497987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.498156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.498421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.498678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.498803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.498922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.499241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.499524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.499832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.499988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.500142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.500251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.500277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.500421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.500586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.500613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.678 qpair failed and we were unable to recover it. 00:27:45.678 [2024-11-20 20:28:50.500750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.500854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.678 [2024-11-20 20:28:50.500882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.501009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.501144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.501170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.501321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.501469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.501498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.501674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.501799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.501827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.501964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.502049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.502096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.502256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.502358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.502384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.502520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.502711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.502738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.502892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.503231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.503511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.503848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.503995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.504130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.504242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.504270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.504406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.504504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.504532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.504676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.504799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.504824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.504919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.505263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.505568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.505847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.505984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.506107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.506260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.506284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.506391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.506511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.506536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.506648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.506790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.506815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.506978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.507255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.507541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.507855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.507996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.508155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.508440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.508756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.508896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.509013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.509185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.509211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.679 qpair failed and we were unable to recover it. 00:27:45.679 [2024-11-20 20:28:50.509313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.679 [2024-11-20 20:28:50.509426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.509453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.509592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.509694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.509723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.509873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.510237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.510611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.510889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.510987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.511179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.511520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.511762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.511912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.512048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.512145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.512172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.512322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.512462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.512491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.512632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.512758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.512783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.512909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.513211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.513480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.513766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.513974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.514121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.514247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.514272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.514391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.514490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.514515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.514686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.514820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.514847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.514965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.515268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.515537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.515804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.515970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.516120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.516245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.516269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.516409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.516536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.516561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.516687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.516830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.516858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.517003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.517105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.517130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.517254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.517362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.517390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.680 [2024-11-20 20:28:50.517488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.517637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.680 [2024-11-20 20:28:50.517662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.680 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.517816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.517915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.517941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.518117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.518231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.518259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.518439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.518528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.518552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.518699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.518827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.518851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.519034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.519308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.519595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.519853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.519972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.520101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.520417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.520635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.520841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.520977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.521105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.521234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.521259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.521377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.521473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.521513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.521653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.521806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.521831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.521960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.522224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.522498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.522785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.522911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.523065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.523207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.523232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.523382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.523549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.523577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.523726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.523843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.523868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.523979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.524124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.524149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.524277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.524393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.524420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.681 [2024-11-20 20:28:50.524593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.524716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.681 [2024-11-20 20:28:50.524740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.681 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.524862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.525165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.525407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.525627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.525814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.525964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.526248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.526527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.526765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.526940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.527099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.527240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.527267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.527396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.527542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.527569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.527708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.527807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.527849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.527945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.528264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.528552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.528849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.528968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.529116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.529255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.529284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.529400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.529509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.529538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.529653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.529805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.529831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.529997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.530142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.530170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.530310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.530449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.530476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.530657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.530834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.530860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.531010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.531295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.531601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.531853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.531994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.532095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.532199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.532224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.532343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.532464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.532489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.532613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.532781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.532808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.682 qpair failed and we were unable to recover it. 00:27:45.682 [2024-11-20 20:28:50.532957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.682 [2024-11-20 20:28:50.533084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.533110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.533235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.533364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.533389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.533504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.533625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.533652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.533803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.533976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.534098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.534411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.534742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.534886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.535038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.535175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.535204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.535361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.535534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.535562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.535698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.535861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.535889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.536005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.536145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.536171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.536358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.536481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.536506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.536606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.536717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.536744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.536891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.537169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.537483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.537791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.537918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.538067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.538214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.538247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.538357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.538470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.538512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.538636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.538788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.538813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.538934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.539247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.539587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.539835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.539960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.540107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.540213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.540255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.540380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.540517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.540541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.540654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.540758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.540787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.540962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.541153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.541185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.683 qpair failed and we were unable to recover it. 00:27:45.683 [2024-11-20 20:28:50.541289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.541416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.683 [2024-11-20 20:28:50.541441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.541582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.541680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.541709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.541852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.541993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.542186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.542487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.542792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.542961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.543084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.543208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.543234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.543379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.543482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.543510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.543662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.543822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.543847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.543945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.544282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.544552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.544845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.544996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.545164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.545315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.545340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.545484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.545604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.545628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.545760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.545885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.545909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.546095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.546256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.546284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.546432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.546569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.546598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.546772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.546871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.546897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.547056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.547339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.547589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.547849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.547974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.548117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.548401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.548626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.548747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.548897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.549008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.549035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.549193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.549298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.549323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.549450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.549589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.684 [2024-11-20 20:28:50.549617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.684 qpair failed and we were unable to recover it. 00:27:45.684 [2024-11-20 20:28:50.549733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.549858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.549887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.550015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.550267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.550512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.550772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.550904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.551016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.551161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.551187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.551306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.551457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.551485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.551670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.551776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.551800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.551931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.552238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.552519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.552843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.552995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.553160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.553283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.553307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.553433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.553582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.553623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.553762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.553871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.553900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.554031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.554165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.554191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.554315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.554436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.554461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.554634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.554762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.554786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.554936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.555275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.555638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.555885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.555991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.556140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.556395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.556667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.556835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.556959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.557218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.557471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.685 qpair failed and we were unable to recover it. 00:27:45.685 [2024-11-20 20:28:50.557795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.685 [2024-11-20 20:28:50.557929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.557955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.558065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.558243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.558270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.558379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.558510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.558538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.558657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.558750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.558774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.558903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.559211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.559522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.559790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.559986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.560103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.560231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.560259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.560378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.560504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.560529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.560660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.560762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.560789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.560962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.561097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.561141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.561292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.561418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.561443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.561584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.561710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.561735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.561895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.562172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.562414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.562751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.562891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.563028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.563320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.563579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.563832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.563982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.564134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.564466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.564797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.564999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.686 qpair failed and we were unable to recover it. 00:27:45.686 [2024-11-20 20:28:50.565138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.565307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.686 [2024-11-20 20:28:50.565332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.565463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.565610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.565635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.565757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.565913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.565938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.566089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.566191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.566218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.566334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.566436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.566464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.566583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.566675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.566700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.566868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.567190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.567416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.567706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.567830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.567983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.568133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.568159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.568283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.568404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.568430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.568583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.568759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.568784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.568881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.569146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.569410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.569727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.569871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.570020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.570154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.570197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.570336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.570476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.570504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.570658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.570754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.570778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.570908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.571156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.571428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.571701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.571816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.571958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.572101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.572131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.572268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.572409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.572437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.572557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.572710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.572735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.572853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.573023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.573048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.573204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.573367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.573392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.687 qpair failed and we were unable to recover it. 00:27:45.687 [2024-11-20 20:28:50.573521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.687 [2024-11-20 20:28:50.573669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.573694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.573801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.573927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.573956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.574139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.574268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.574293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.574420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.574579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.574604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.574765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.574902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.574929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.575064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.575235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.575261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.575364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.575512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.575537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.575638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.575791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.575817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.575940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.576272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.576556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.576831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.576966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.577093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.577199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.577224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.577328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.577453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.577477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.577600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.577732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.577759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.577880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.578156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.578477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.578793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.578915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.579100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.579240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.579268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.579387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.579515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.579542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.579660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.579755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.579779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.579875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.580140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.580442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.580678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.580824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.580942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.581037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.581063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.581208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.581308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.581333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.688 [2024-11-20 20:28:50.581480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.581612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.688 [2024-11-20 20:28:50.581639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.688 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.581743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.581867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.581899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.582022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.582174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.582199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.582326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.582474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.582500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.582626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.582751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.582777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.582892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.583207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.583523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.583803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.583982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.584117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.584242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.584267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.584371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.584493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.584518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.584643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.584776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.584808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.584954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.585242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.585500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.585777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.585916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.586066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.586299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.586546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.586815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.586946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.587118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.587210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.587234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.587377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.587541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.587573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.587742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.587871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.587898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.588038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.588172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.588197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.588329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.588495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.588522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.588681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.588795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.588823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.588937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.589236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.589498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.689 qpair failed and we were unable to recover it. 00:27:45.689 [2024-11-20 20:28:50.589820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.689 [2024-11-20 20:28:50.589943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.589969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.590108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.590243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.590271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.590414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.590525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.590557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.590686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.590804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.590829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.590943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.591253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.591520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.591807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.591973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.592096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.592229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.592254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.592411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.592535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.592577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.592724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.592881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.592906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.593086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.593355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.593591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.593811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.593984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.594111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.594218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.594243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.594372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.594470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.594497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.594623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.594747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.594773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.594929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.595204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.595466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.595823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.595937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.596048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.596188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.596216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.596404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.596535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.596560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.596691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.596817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.596841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.597014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.597304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.597574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.690 [2024-11-20 20:28:50.597854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.690 [2024-11-20 20:28:50.597978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.690 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.598110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.598228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.598254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.598408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.598528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.598570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.598718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.598899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.598924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.599048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.599200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.599228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.599379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.599513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.599538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.599666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.599759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.599784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.599926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.600224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.600492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.600793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.600995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.601113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.601262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.601287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.601396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.601567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.601591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.601707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.601842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.601870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.602030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.602162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.602187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.602315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.602467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.602492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.602643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.602746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.602790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.602881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.603185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.603510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.603826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.603981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.604087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.604212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.604237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.604384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.604545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.604573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.604697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.604819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.604843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.605011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.605174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.605202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.691 [2024-11-20 20:28:50.605342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.605473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.691 [2024-11-20 20:28:50.605501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.691 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.605617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.605719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.605744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.605851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.606198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.606489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.606759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.606889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.607041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.607176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.607203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.607300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.607421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.607447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.607559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.607660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.607687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.607854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.608184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.608426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.608682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.608845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.609012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.609168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.609200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.609375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.609507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.609535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.609671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.609776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.609804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.609948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.610183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.610470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.610784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.610960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.611122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.611273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.611297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.611424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.611514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.611539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.611638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.611764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.611790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.611975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.612250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.612544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.612776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.612902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.613005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.613130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.613166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.692 qpair failed and we were unable to recover it. 00:27:45.692 [2024-11-20 20:28:50.613298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.692 [2024-11-20 20:28:50.613427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.613452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.613601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.613757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.613781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.613896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.614200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.614532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.614804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.614948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.615094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.615216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.615242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.615354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.615524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.615551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.615689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.615803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.615829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.615932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.616221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.616496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.616779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.616913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.617011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.617257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.617579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.617823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.617975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.618095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.618223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.618248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.618372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.618505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.618530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.618658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.618787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.618812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.618931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.619216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.619494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.619801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.619940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.620067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.620229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.620254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.620390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.620530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.620558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.620663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.620799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.620827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.620950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.621049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.621084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.693 [2024-11-20 20:28:50.621195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.621329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.693 [2024-11-20 20:28:50.621357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.693 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.621463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.621627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.621652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.621754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.621891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.621916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.622031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.622184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.622211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.622325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.622449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.622475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.622578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.622706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.622731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.622875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.623223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.623545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.623834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.623982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.624078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.624195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.624220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.624317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.624438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.624471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.624616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.624758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.624786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.624953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.625260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.625575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.625863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.625996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.626092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.626191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.626216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.626348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.626473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.626503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.626671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.626821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.626845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.626936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.627197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.627468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.627706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.627853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.628000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.628326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.628621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.628884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.628991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.629019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.629159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.629339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.629364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.694 qpair failed and we were unable to recover it. 00:27:45.694 [2024-11-20 20:28:50.629491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.694 [2024-11-20 20:28:50.629583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.629609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.629783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.629934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.629960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.630063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.630193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.630220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.630346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.630441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.630466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.630631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.630759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.630784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.630909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.631197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.631451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.631757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.631885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.632076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.632214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.632240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.632334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.632506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.632534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.632646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.632744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.632772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.632951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.633181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.633510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.633849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.633974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.634098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.634238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.634266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.634415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.634518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.634544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.634697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.634825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.634851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.634984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.635295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.635591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.635815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.635990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.636017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.636171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.636276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.636304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.636449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.636565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.636590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-20 20:28:50.637423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-20 20:28:50.637608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.637634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.637767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.637866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.637891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.638035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.638285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.638515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.638779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.638904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.639054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.639180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.639208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.639340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.639452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.639481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.639646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.639754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.639779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.639928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.640217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.640451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.640725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.640869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.640994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.641290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.641587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.641867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.641988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.642094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.642192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.642218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.642342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.642474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.642502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.642617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.642734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.642759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.642906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.643220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.643489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.643759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.643910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.644003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.644249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.644504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.644825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.644963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-20 20:28:50.645125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.645240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-20 20:28:50.645269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.645396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.645516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.645543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.645682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.645826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.645852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.645972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.646227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.646545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.646818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.646947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.647076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.647294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.647322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.647433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.647538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.647581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.647706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.647853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.647881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.647995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.648271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.648605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.648883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.648991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.649194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.649518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.649767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.649907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.650058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.650172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.650198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.650349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.650446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.650474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.650587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.650687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.650712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.650864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.651169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.651462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.651786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.651952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.652063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.652217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.652247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.652360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.652452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.652477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.652623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.652762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.652789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.652932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.653062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.653103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.653226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.653328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-20 20:28:50.653354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-20 20:28:50.653449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.653614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.653642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.653749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.653849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.653877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.654000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.654147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.654172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.654303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.654450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.654476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.654689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.654818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.654844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.654964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.655199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.655473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.655704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.655836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.655945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.656225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.656480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.656852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.656992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.657131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.657357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.657705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.657907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.658033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.658285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.658530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.658772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.658887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.659091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.659242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.659282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.659410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.659508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.659534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.659641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.659739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.659765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.659902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.660170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.660440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.660673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.660789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.660887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.661017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.661042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-20 20:28:50.661147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.661256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-20 20:28:50.661281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.661395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.661537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.661562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.661685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.661818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.661842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.661970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.662222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.662455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.662696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.662865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.662993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.663278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.663549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.663787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.663996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.664231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.664504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.664759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.664913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.665115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.665257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.665282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.665372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.665456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-20 20:28:50.665480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-20 20:28:50.665604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.665706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.665732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.665822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.665972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.665999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.666104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.666329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.666576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.666847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.666997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.667120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.667340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.667588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.667866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.667989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.668094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.668194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.668219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.668366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.668491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.668517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.668624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.668753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.668778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.668939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.669232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.669501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.669783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.669933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.982 qpair failed and we were unable to recover it. 00:27:45.982 [2024-11-20 20:28:50.670026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.982 [2024-11-20 20:28:50.670126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.670252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.670501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.670731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.670893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.670989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.671245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.671518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.671752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.671903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.672030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.672323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.672604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.672814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.672936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.673064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.673216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.673243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.673341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.673496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.673525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.673633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.673758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.673784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.673892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.674015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.674040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.674162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.674310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.674335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.674461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.674665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.674692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.674820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.675199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.675469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.675688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.675813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.675920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.676193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.676498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.983 [2024-11-20 20:28:50.676805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.983 [2024-11-20 20:28:50.676958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.983 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.677057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.677177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.677202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.677320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.677514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.677539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.677658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.677787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.677812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.677954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.678102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.678139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.678241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.678391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.678419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.678542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.678700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.678725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.678895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.679175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.679444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.679772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.679974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.680140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.680242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.680267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.680389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.680588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.680613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.680753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.680855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.680882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.681022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.681312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.681552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.681777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.681923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.682049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.682305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.682581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.682847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.682972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.683083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.683206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.683232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.683332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.683481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.683506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.683630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.683753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.683779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.683930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.684147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.684173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.684393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.684528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.684569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.684699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.684824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.684850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.684960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.685081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.984 [2024-11-20 20:28:50.685107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.984 qpair failed and we were unable to recover it. 00:27:45.984 [2024-11-20 20:28:50.685236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.685367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.685393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.685592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.685733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.685760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.685886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.686182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.686409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.686652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.686820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.686962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.687235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.687516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.687876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.687988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.688187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.688479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.688779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.688959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.689100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.689224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.689252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.689411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.689533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.689559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.689735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.689846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.689874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.690036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.690141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.690166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.690265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.690386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.690414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.690520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.690675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.690702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.690925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.691056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.691118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.691293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.691464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.691489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.691617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.691731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.691758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.691894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.692007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.692033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.692263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.692365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.692395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.692549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.692751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.692781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.692945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.693210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.693506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.985 qpair failed and we were unable to recover it. 00:27:45.985 [2024-11-20 20:28:50.693815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.985 [2024-11-20 20:28:50.693942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.693968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.694087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.694232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.694257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.694401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.694528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.694554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.694708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.694828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.694853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.695025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.695159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.695186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.695310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.695442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.695467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.695602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.695717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.695743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.695900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.696160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.696469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.696811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.696952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.697095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.697237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.697262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.697406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.697499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.697523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.697643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.697776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.697804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.697918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.698194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.698445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.698784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.698940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.699114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.699241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.699267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.699362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.699507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.699536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.699663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.699824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.699852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.700003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.700250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.700488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.700763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.700906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.701016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.701140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.701167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.701273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.701416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.701445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.701621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.701749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.701790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.986 qpair failed and we were unable to recover it. 00:27:45.986 [2024-11-20 20:28:50.701974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.702104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.986 [2024-11-20 20:28:50.702131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.702256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.702403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.702431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.702564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.702690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.702714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.702837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.702977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.703217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.703555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.703840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.703986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.704112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.704241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.704267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.704384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.704511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.704537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.704685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.704855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.704883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.705063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.705208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.705233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.705358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.705461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.705488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.705691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.705808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.705852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.705974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.706155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.706181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.706290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.706394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.706419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.706549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.706692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.706719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.706857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.707162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.707542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.707843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.707977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.708101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.708195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.708221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.708349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.708527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.708553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.708689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.708809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.708839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.708986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.709104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.709130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.987 qpair failed and we were unable to recover it. 00:27:45.987 [2024-11-20 20:28:50.709282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.709410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.987 [2024-11-20 20:28:50.709453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.709580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.709712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.709740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.709861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.709989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.710148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.710391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.710665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.710861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.711012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.711244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.711522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.711751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.711890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.712027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.712169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.712195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.712325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.712528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.712555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.712729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.712866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.712894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.713095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.713215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.713240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.713370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.713473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.713497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.713605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.713729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.713755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.713882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.714169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.714405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.714677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.714919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.715041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.715158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.715183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.715289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.715459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.715487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.715661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.715761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.715787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.715914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.716229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.716546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.716827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.716976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.717016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.717171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.717301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.717327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.717505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.717694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.988 [2024-11-20 20:28:50.717742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.988 qpair failed and we were unable to recover it. 00:27:45.988 [2024-11-20 20:28:50.717881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.718169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.718500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.718743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.718895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.719009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.719302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.719582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.719879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.719985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.720116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.720334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.720588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.720868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.720978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.721179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.721461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.721703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.721874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.722035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.722209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.722236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.722345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.722449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.722474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.722596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.722760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.722789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.722907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.723249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.723546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.723856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.723980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.724146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.724241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.724267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.724451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.724554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.724583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.724755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.724886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.724912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.725043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.725291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.725506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.989 qpair failed and we were unable to recover it. 00:27:45.989 [2024-11-20 20:28:50.725837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.989 [2024-11-20 20:28:50.725929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.725953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.726101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.726215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.726240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.726444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.726570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.726619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.726753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.726910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.726939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.727045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.727177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.727204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.727405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.727587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.727615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.727822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.727957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.727986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.728160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.728265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.728292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.728403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.728532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.728557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.728702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.728880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.728905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.729030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.729163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.729188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.729287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.729411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.729436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.729567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.729768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.729810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.729924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.730219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.730506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.730823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.730989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.731110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.731241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.731267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.731385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.731540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.731565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.731695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.731792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.731818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.731928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.732213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.732518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.732798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.732927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.733047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.733221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.733247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.733343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.733440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.733467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.733572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.733717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.733744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.733869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.734011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.734041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.734195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.734300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.990 [2024-11-20 20:28:50.734343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.990 qpair failed and we were unable to recover it. 00:27:45.990 [2024-11-20 20:28:50.734502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.734671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.734699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.734856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.734978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.735161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.735416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.735681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.735857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.736005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.736215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.736242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.736349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.736479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.736504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.736649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.736784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.736812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.736913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.737014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.737042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.737239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.737358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.737384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.737527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.737658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.737685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.737893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.738184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.738437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.738725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.738902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.739037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.739143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.739169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.739264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.739416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.739442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.739597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.739721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.739746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.739898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.740245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.740480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.740755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.740905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.741032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.741166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.741195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.741300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.741459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.741487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.991 qpair failed and we were unable to recover it. 00:27:45.991 [2024-11-20 20:28:50.741633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.741762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.991 [2024-11-20 20:28:50.741787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.741892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.741991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.742124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.742402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.742724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.742870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.742972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.743263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.743476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.743784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.743943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.744117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.744353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.744602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.744872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.744988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.745158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.745447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.745703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.745830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.745972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.746119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.746149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.746255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.746424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.746451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.746623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.746744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.746770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.746914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.747203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.747529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.747790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.747926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.748111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.748232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.748257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.748357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.748482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.748508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.748613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.748782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.748807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.748936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.749103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.749131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.749274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.749401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.749426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.749561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.749709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.992 [2024-11-20 20:28:50.749734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.992 qpair failed and we were unable to recover it. 00:27:45.992 [2024-11-20 20:28:50.749860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.749985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.750102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.750356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.750579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.750730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.750887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.751174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.751454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.751790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.751963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.752098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.752242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.752270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.752447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.752576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.752601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.752728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.752861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.752887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.752988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.753251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.753541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.753825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.753974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.754085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.754301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.754346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.754523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.754673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.754718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.754826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.754939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.754968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.755134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.755259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.755285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.755444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.755542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.755568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.755759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.755912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.755940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.756082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.756187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.756232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.756363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.756467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.756494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.756651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.756756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.756783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.756988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.757169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.757195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.757323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.757450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.757476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.757630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.757789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.757813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.757934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.758064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.758121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.993 [2024-11-20 20:28:50.758287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.758410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.993 [2024-11-20 20:28:50.758435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.993 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.758586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.758707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.758736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.758878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.758970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.758998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.759126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.759256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.759281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.759487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.759629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.759658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.759778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.759914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.759942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.760064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.760200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.760225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.760384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.760478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.760503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.760617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.760725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.760754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.760912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.761260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.761535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.761841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.761991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.762116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.762288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.762313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.762436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.762586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.762618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.762767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.762885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.762910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.763079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.763200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.763225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.763386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.763505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.763535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.763660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.763762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.763787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.763923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.764216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.764508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.764748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.764939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.765048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.765275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.765304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.765448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.765579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.765608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.765766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.765926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.765950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.766081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.766236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.766261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.766360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.766492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.766518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.766644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.766767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.766795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.994 qpair failed and we were unable to recover it. 00:27:45.994 [2024-11-20 20:28:50.766908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.994 [2024-11-20 20:28:50.767009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.767177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.767434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.767693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.767838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.767986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.768203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.768231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.768342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.768468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.768500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.768602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.768712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.768740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.768850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.769192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.769449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.769758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.769883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.770037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.770214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.770240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.770348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.770524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.770552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.770671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.770799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.770824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.770942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.771060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.771096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.771314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.771482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.771534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.771675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.771832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.771858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.772030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.772152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.772178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.772326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.772462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.772490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.772607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.772756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.772781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.772903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.773192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.773504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.773757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.773913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.774047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.774225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.774254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.774426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.774583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.774625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.995 qpair failed and we were unable to recover it. 00:27:45.995 [2024-11-20 20:28:50.774786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.995 [2024-11-20 20:28:50.774893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.774918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.775064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.775221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.775247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.775401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.775525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.775550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.775726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.775827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.775852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.775977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.776285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.776565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.776867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.776980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.777178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.777404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.777621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.777773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.777903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.778232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.778562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.778834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.778988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.779130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.779247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.779275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.779413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.779550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.779575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.779705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.779804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.779830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.779997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.780127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.780154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.780277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.780422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.780450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.780609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.780763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.780788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.780937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.781038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.781090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.781201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.781304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.781330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.996 qpair failed and we were unable to recover it. 00:27:45.996 [2024-11-20 20:28:50.781453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.781578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.996 [2024-11-20 20:28:50.781604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.781733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.781861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.781886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.782016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.782326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.782556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.782851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.782983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.783169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.783268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.783295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.783407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.783535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.783562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.783736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.783836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.783861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.783979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.784135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.784161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.784316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.784482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.784510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.784685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.784810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.784835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.784955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.785228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.785494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.785786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.785934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.786046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.786198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.786227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.786366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.786502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.786531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.786686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.786812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.786837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.786952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.787055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.787092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.787241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.787440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.787466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.787636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.787759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.787784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.787926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.788176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.788475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.788771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.788903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.789018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.789152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.789180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.789333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.789459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.789484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.997 qpair failed and we were unable to recover it. 00:27:45.997 [2024-11-20 20:28:50.789585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.997 [2024-11-20 20:28:50.789682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.789708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.789795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.789923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.789947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.790061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.790210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.790236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.790381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.790514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.790542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.790645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.790771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.790799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.790969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.791092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.791126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.791290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.791441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.791467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.791607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.791738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.791765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.791881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.792153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.792442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.792764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.792918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.793017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.793318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.793534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.793786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.793934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.794082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.794235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.794260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.794420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.794514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.794539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.794690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.794786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.794812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.794920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.795159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.795390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.795677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.795840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.795990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.796116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.796142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.796311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.796436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.796463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.796614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.796716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.796741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.796891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.797008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.797033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.797201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.797319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.797345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.998 qpair failed and we were unable to recover it. 00:27:45.998 [2024-11-20 20:28:50.797439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.797562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.998 [2024-11-20 20:28:50.797588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.797734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.797838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.797865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.797989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.798158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.798184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.798308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.798414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.798441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.798568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.798671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.798698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.798874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.799178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.799405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.799733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.799890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.800077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.800190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.800217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.800327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.800453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.800479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.800606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.800769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.800796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.800915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.801231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.801503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.801761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.801906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.802026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.802282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.802583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.802883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.802998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.803149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.803383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.803713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.803837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.803986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.804130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.804160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.804304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.804439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.804469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.804643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.804765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.804790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.804971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.805133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.805163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.805295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.805428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.805455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:45.999 [2024-11-20 20:28:50.805576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.805730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.999 [2024-11-20 20:28:50.805755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:45.999 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.805860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.805997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.806171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.806454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.806761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.806876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.806999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.807254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.807531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.807806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.807994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.808119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.808274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.808299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.808421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.808593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.808620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.808766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.808923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.808950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.809099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.809251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.809276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.809399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.809559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.809589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.809690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.809838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.809866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.809989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.810243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.810531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.810793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.810922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.811048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.811177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.811203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.811388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.811541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.811566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.811666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.811802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.811828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.811914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.812179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.812450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.812775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.812929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.813058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.813204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.813231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.813325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.813455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.813480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.000 qpair failed and we were unable to recover it. 00:27:46.000 [2024-11-20 20:28:50.813577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.813707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.000 [2024-11-20 20:28:50.813732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.813824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.813918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.813944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.814105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.814239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.814264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.814384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.814524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.814552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.814698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.814831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.814858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.814983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.815256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.815559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.815876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.815988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.816115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.816396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.816722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.816865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.817041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.817285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.817516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.817793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.817927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.818032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.818184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.818212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.818365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.818492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.818517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.818613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.818753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.818781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.818898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.819225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.819513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.819825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.819992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.820157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.820281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.820306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.001 qpair failed and we were unable to recover it. 00:27:46.001 [2024-11-20 20:28:50.820423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.820590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.001 [2024-11-20 20:28:50.820616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.820712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.820866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.820893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.820991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.821250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.821488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.821806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.821927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.822082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.822242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.822270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.822382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.822497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.822523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.822651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.822750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.822776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.822920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.823235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.823541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.823781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.823949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.824085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.824221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.824249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.824388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.824516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.824542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.824702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.824798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.824824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.824946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.825227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.825528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.825848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.825997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.826138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.826264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.826290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.826408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.826554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.826579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.826709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.826809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.826835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.826963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.827109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.827135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.827286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.827448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.827476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.827649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.827781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.827806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.827906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.828030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.828055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.828211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.828315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.828343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.828499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.828624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.002 [2024-11-20 20:28:50.828649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.002 qpair failed and we were unable to recover it. 00:27:46.002 [2024-11-20 20:28:50.828777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.828907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.828934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.829058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.829213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.829238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.829395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.829540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.829570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.829697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.829844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.829869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.830020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.830162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.830191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.830328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.830428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.830470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.830595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.830716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.830741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.830852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.831225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.831524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.831830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.831996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.832140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.832260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.832288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.832427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.832582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.832607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.832759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.832872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.832901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.833033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.833169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.833199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.833326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.833417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.833442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.833582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.833728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.833752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.833854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.834137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.834355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.834615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.834821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.834958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.835232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.835511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.835857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.835984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.836110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.836211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.836236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.836330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.836498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.836525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.003 qpair failed and we were unable to recover it. 00:27:46.003 [2024-11-20 20:28:50.836693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.836824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.003 [2024-11-20 20:28:50.836850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.836968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.837081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.837114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.837257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.837405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.837433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.837588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.837685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.837710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.837881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.838187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.838478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.838752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.838873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.838985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.839245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.839466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.839774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.839923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.840078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.840194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.840221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.840324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.840486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.840512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.840648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.840804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.840830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.840927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.841548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.841823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.841987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.842137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.842385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.842631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.842780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.842907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.843240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.843526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.843754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.843898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.843997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.844103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.844129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.844224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.844330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.844355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.844495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.844631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.004 [2024-11-20 20:28:50.844658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.004 qpair failed and we were unable to recover it. 00:27:46.004 [2024-11-20 20:28:50.844765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.844905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.844931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.845032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.845168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.845196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.845319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.845508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.845533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.845635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.845775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.845803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.845945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.846206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.846465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.846740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.846867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.846987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.847151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.847180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.847295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.847452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.847478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.847601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.847723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.847748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.847899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.848233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.848526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.848795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.848911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.849053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.849193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.849223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.849398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.849490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.849515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.849660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.849804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.849831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.849960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.850248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.850515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.850813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.850948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.851094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.851220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.851245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.851397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.851547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.851573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.851660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.851811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.851835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.005 qpair failed and we were unable to recover it. 00:27:46.005 [2024-11-20 20:28:50.851964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.005 [2024-11-20 20:28:50.852148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.852292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.852565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.852858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.852979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.853099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.853197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.853222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.853319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.853441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.853469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.853643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.853757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.853782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.853933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.854266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.854516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.854760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.854931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.855049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.855187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.855212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.855310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.855397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.855426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.855532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.855694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.855723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.855871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.856196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.856495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.856833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.856958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.857048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.857156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.857182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.857328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.857434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.857477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.857627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.857775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.857803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.857951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.858244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.858540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.858782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.858896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.859079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.859247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.859274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.859378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.859511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.859539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.859684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.859816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.859842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.006 [2024-11-20 20:28:50.859945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.860086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.006 [2024-11-20 20:28:50.860116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.006 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.860257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.860401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.860426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.860578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.860711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.860752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.860853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.860986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.861137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.861426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.861647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.861797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.861910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.862199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.862473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.862786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.862908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.863039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.863168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.863194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.863351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.863518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.863547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.863696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.863826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.863852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.863980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.864228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.864459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.864768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.864921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.865078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.865200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.865227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.865342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.865510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.865535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.865658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.865752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.865777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.865918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.866047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.866089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.866219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.866357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.866385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.866531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.866684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.866709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.866887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.867185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.867458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.867739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.867877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.867986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.868143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.868171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.007 qpair failed and we were unable to recover it. 00:27:46.007 [2024-11-20 20:28:50.868264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.007 [2024-11-20 20:28:50.868361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.868388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.868540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.868632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.868660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.868800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.868913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.868941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.869062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.869326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.869572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.869842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.869982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.870101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.870204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.870232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.870366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.870507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.870534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.870661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.870781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.870806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.870901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.871160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.871447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.871765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.871931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.872078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.872213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.872241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.872368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.872465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.872490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.872625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.872751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.872776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.872917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.873243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.873527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.873791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.873956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.874135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.874239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.874264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.874392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.874568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.874596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.874727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.874872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.874900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.875042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.875173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.875198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.875347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.875486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.875513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.875628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.875788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.875815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.875938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.876074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.876100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.008 qpair failed and we were unable to recover it. 00:27:46.008 [2024-11-20 20:28:50.876231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.008 [2024-11-20 20:28:50.876365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.876393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.876531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.876697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.876725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.876877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.876979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.877144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.877414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.877731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.877882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.878002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.878175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.878201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.878305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.878449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.878473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.878575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.878670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.878695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.878864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.879195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.879499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.879824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.879985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.880081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.880185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.880228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.880374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.880473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.880498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.880640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.880773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.880801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.880968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.881220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.881518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.881793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.881993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.882101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.882259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.882284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.882452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.882602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.882627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.882772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.882876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.882918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.883045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.883149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.883175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.883344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.883500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.883525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.883627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.883752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.883778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.883908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.884035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.884060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.884211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.884324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.884351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.009 qpair failed and we were unable to recover it. 00:27:46.009 [2024-11-20 20:28:50.884471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.009 [2024-11-20 20:28:50.884585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.884613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.884738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.884841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.884866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.884963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.885201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.885459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.885731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.885872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.886032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.886180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.886208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.886355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.886485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.886511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.886648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.886772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.886796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.886948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.887238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.887486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.887764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.887946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.888094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.888218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.888243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.888373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.888501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.888528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.888673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.888807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.888836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.888982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.889281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.889519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.889830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.889987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.890129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.890273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.890299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.890419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.890583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.890611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.890751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.890901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.890941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.891095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.891245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.891272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.891400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.891612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.891637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.010 qpair failed and we were unable to recover it. 00:27:46.010 [2024-11-20 20:28:50.891789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.010 [2024-11-20 20:28:50.891887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.891913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.892037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.892195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.892223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.892387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.892489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.892516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.892669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.892819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.892859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.893008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.893140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.893166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.893344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.893543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.893591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.893730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.893829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.893853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.893995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.894247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.894530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.894791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.894968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.895121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.895273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.895298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.895398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.895535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.895560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.895682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.895819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.895846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.896001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.896311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.896625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.896835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.896977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.897115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.897391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.897676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.897841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.897992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.898267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.898593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.898831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.898982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.899108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.899238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.899269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.899388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.899526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.899555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.899671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.899822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.899846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.011 [2024-11-20 20:28:50.899998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.900126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.011 [2024-11-20 20:28:50.900152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.011 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.900290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.900450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.900475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.900600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.900728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.900753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.900864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.901207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.901545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.901839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.901991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.902165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.902484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.902735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.902897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.903036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.903334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.903579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.903866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.903985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.904165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.904452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.904722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.904901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.905018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.905268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.905476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.905740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.905889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.906006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.906182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.906208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.906350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.906463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.906492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.906640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.906764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.906793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.906910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.907233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.907495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.907711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.907889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.908017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.908184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.908210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.012 qpair failed and we were unable to recover it. 00:27:46.012 [2024-11-20 20:28:50.908337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.012 [2024-11-20 20:28:50.908464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.908488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.908626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.908782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.908809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.908943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.909255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.909493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.909794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.909931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.910048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.910192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.910218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.910336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.910470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.910497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.910633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.910812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.910838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.910939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.911269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.911553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.911800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.911949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.912067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.912225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.912250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.912354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.912481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.912505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.912633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.912731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.912756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.912871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.913145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.913456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.913788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.913942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.914085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.914250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.914277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.914430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.914557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.914581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.914715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.914838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.914863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.915026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.915183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.915208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.915369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.915497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.915522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.915674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.915816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.915844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.915983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.916120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.916150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.916298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.916417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.916442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.916594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.916735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.013 [2024-11-20 20:28:50.916760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.013 qpair failed and we were unable to recover it. 00:27:46.013 [2024-11-20 20:28:50.916860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.916986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.917160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.917411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.917719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.917893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.917988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.918243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.918524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.918805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.918983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.919122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.919259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.919287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.919421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.919561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.919585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.919686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.919788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.919814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.919917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.920241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.920554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.920790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.920938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.921075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.921201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.921226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.921320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.921469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.921496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.921635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.921770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.921798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.921939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.922220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.922552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.922839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.922974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.923167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.923493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.923813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.923965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.014 qpair failed and we were unable to recover it. 00:27:46.014 [2024-11-20 20:28:50.924116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.014 [2024-11-20 20:28:50.924216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.924241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.924368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.924513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.924541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.924657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.924758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.924787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.924945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.925219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.925499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.925837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.925982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.926165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.926292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.926318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.926433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.926597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.926624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.926774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.926876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.926900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.927020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.927195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.927224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.927366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.927512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.927536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.927635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.927787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.927811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.927970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.928270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.928553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.928809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.928974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.929147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.929297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.929323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.929452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.929599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.929623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.929803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.929970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.929997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.930135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.930242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.930269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.930440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.930531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.930556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.930685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.930798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.930842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.930965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.931220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.931453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.931777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.931911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.932037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.932148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.932174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.015 [2024-11-20 20:28:50.932320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.932427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.015 [2024-11-20 20:28:50.932455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.015 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.932574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.932676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.932705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.932852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.932946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.932970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.933106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.933253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.933279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.933385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.933517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.933540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.933663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.933815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.933840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.933961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.934103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.934132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.934318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.934448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.934473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.934626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.934719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.934745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.934900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.935234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.935508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.935757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.935904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.936034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.936159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.936187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.936311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.936469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.936496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.936645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.936755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.936780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.936935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.937240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.937583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.937810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.937965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.938089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.938216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.938241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.938409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.938533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.938560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.938701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.938845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.938871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.938966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.939125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.939152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.939306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.939428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.939454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.939612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.939740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.939768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.939884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.940232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.940539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.016 qpair failed and we were unable to recover it. 00:27:46.016 [2024-11-20 20:28:50.940785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.016 [2024-11-20 20:28:50.940938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.940964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.941095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.941366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.941581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.941838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.941971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.942141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.942432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.942785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.942994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.943108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.943261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.943287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.943386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.943474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.943500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.943657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.943784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.943811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.943922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.944230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.944490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.944773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.944970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.945082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.945180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.945207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.945361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.945489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.945516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.945647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.945752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.945780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.945923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.946095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.946141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.946278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.946453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.946478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.946632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.946760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.946787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.946938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.947227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.947476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.947785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.947901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.947999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.948296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.948545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.017 [2024-11-20 20:28:50.948826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.017 [2024-11-20 20:28:50.948953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.017 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.949042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.949216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.949245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.949422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.949579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.949622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.949729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.949869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.949896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.950003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.950138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.950167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.950349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.950538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.950590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.950766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.950862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.950887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.950976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.951278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.951572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.951852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.951983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.952112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.952240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.952266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.952417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.952574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.952600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.952697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.952833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.952861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.952984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.953289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.953592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.953847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.953973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.954126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.954251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.954276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.954408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.954528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.954557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.954709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.954814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.954844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.954937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.955238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.955617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.955828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.955948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.956047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.956208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.956234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.956355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.956479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.956504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.956650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.956810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.956838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.956980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.957079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.957107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.018 qpair failed and we were unable to recover it. 00:27:46.018 [2024-11-20 20:28:50.957264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.018 [2024-11-20 20:28:50.957390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.957414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.957537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.957669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.957697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.957805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.957971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.957999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.958149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.958282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.958307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.958432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.958583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.958609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.958706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.958852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.958881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.959034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.959152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.959179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.959340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.959486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.959515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.959685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.959818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.959846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.959987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.960221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.960529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.960841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.960989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.961134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.961397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.961695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.961846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.961999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.962302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.962590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.962869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.962990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.963117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.963388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.963724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.963864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.964025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.964169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.964198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.019 [2024-11-20 20:28:50.964371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.964462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.019 [2024-11-20 20:28:50.964487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.019 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.964637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.964778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.964806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.964954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.965258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.965530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.965755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.965923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.966064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.966209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.966236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.966389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.966529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.966557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.966733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.966891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.966917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.967086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.967340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.967584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.967862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.967983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.968148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.968465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.968737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.968881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.969011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.969152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.969182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.969348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.969501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.969527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.969626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.969774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.969801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.969911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.970189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.970501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.970766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.970908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.971059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.971238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.971266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.971442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.971568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.971593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.971746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.971881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.971909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.972019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.972171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.972199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.972353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.972502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.972527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.020 qpair failed and we were unable to recover it. 00:27:46.020 [2024-11-20 20:28:50.972658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.972816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.020 [2024-11-20 20:28:50.972841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.972950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.973051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.973085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.973187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.973338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.973363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.973563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.973697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.973722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.973901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.974032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.974059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.974257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.974386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.974411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.974511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.974644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.974689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.974856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.975190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.975440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.975746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.975898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.976000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.976241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.976516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.976828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.976977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.977144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.977438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.977743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.977864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.977962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.978205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.978467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.978806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.978974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.979145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.979419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.979683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.979821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.979963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.980078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.980108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.980263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.980389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.980414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.980545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.980674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.980699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.021 qpair failed and we were unable to recover it. 00:27:46.021 [2024-11-20 20:28:50.980864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.981027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.021 [2024-11-20 20:28:50.981055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.981204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.981301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.981325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.981472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.981577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.981607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.981740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.981852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.981880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.982053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.982247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.982276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.982421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.982575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.982601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.982737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.982861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.982886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.983015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.983286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.983543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.983830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.983955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.984081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.984192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.984220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.984387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.984534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.984562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.984739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.984839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.984863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.985014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.985307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.985552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.985806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.985935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.986032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.986194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.986219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.986316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.986412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.986438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.986544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.986714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.986741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.986908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.987201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.987491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.987704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.987838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.987993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.988149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.988193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.988300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.988470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.988496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.988631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.988805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.988830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.988956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.989080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.989106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.022 qpair failed and we were unable to recover it. 00:27:46.022 [2024-11-20 20:28:50.989195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.022 [2024-11-20 20:28:50.989290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.989315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.989463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.989601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.989629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.989744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.989838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.989863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.990010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.990180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.990209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.990345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.990482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.990509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.990654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.990796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.990821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.990914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.991229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.991544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.991871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.991974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.992190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.992473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.992743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.992893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.993020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.993122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.993150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.993277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.993413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.993438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.993633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.993761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.993788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.993946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.994228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.994525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.994791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.994936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.995065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.995197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.995222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.995374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.995486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.995515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.995643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.995731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.995757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.995882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.996022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.996051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.996191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.996340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.996368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.023 [2024-11-20 20:28:50.996516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.996619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.023 [2024-11-20 20:28:50.996644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.023 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.996781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.996901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.996927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.997023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.997303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.997577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.997818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.997995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.998135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.998266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.998308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.998462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.998592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.998616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.998711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.998861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.998890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.999004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.999172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.999201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.999316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.999421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.999446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.999543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.999639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.306 [2024-11-20 20:28:50.999663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.306 qpair failed and we were unable to recover it. 00:27:46.306 [2024-11-20 20:28:50.999781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:50.999906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:50.999933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.000083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.000306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.000555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.000796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.000948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.001095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.001258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.001286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.001458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.001592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.001626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.001727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.001830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.001856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.002001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.002271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.002575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.002812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.002986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.003116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.003294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.003319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.003451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.003538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.003562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.003705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.003810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.003837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.003978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.004148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.004177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.004321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.004452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.004477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.004601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.004724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.004750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.004858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.005188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.005520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.005801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.005959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.006085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.006303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.006628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.006852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.006999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.007180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.007318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.007345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.007529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.007620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.007645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.307 qpair failed and we were unable to recover it. 00:27:46.307 [2024-11-20 20:28:51.007771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.307 [2024-11-20 20:28:51.007894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.007920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.008063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.008180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.008209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.008355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.008478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.008505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.008655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.008747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.008772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.008905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.009226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.009534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.009817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.009970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.010097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.010260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.010287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.010479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.010606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.010631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.010749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.010895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.010922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.011036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.011234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.011260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.011435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.011539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.011563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.011673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.011808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.011835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.011961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.012266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.012504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.012781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.012945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.013121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.013225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.013251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.013381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.013522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.013550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.013723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.013844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.013869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.013962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.014267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.014556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.014902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.014996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.015120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.015438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.015719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.015860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.308 [2024-11-20 20:28:51.016009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.016143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.308 [2024-11-20 20:28:51.016171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.308 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.016320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.016480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.016508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.016673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.016846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.016874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.017031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.017327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.017619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.017854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.017994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.018107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.018263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.018287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.018441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.018544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.018569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.018690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.018787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.018813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.018919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.019200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.019455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.019676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.019855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.020009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.020160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.020203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.020342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.020505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.020532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.020664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.020817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.020842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.020941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.021244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.021514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.021804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.021928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.022055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.022204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.022232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.022334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.022466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.022494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.022621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.022778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.022803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.022980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.023256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.023564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.023839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.023997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.024131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.024262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.309 [2024-11-20 20:28:51.024291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.309 qpair failed and we were unable to recover it. 00:27:46.309 [2024-11-20 20:28:51.024436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.024563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.024588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.024698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.024834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.024860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.024998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.025245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.025493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.025805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.025974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.026097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.026191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.026216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.026345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.026508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.026536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.026672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.026802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.026829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.026977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.027231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.027442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.027702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.027895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.028059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.028206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.028234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.028336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.028510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.028534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.028662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.028792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.028816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.028935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.029092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.029126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.029255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.029390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.029418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.029564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.029716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.029741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.029924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.030240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.030596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.030841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.030995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.031098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.031341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.031591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.031845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.031967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.032059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.032231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.032258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.310 qpair failed and we were unable to recover it. 00:27:46.310 [2024-11-20 20:28:51.032413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.032573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.310 [2024-11-20 20:28:51.032601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.032736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.032872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.032900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.033080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.033206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.033247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.033414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.033522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.033549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.033656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.033790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.033818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.033947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.034200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.034487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.034764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.034917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.035110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.035229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.035254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.035374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.035487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.035516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.035647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.035742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.035768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.035913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.036185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.036457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.036752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.036916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.037057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.037353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.037611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.037852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.037999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.038160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.038404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.038697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.038854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.039007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.039160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.039186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.311 [2024-11-20 20:28:51.039302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.039445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.311 [2024-11-20 20:28:51.039478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.311 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.039628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.039726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.039751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.039877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.039997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.040163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.040405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.040683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.040803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.040908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.041215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.041463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.041731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.041897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.042001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.042129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.042164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.042314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.042437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.042462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.042637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.042744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.042772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.042911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.043251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.043481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.043781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.043944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.044056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.044304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.044552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.044834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.044996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.045128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.045260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.045285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.045423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.045563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.045591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.045767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.045868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.045893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.046022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.046169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.046197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.046336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.046436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.046478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.046629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.046724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.046749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.046867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.047035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.047063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.047202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.047297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.047324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.312 qpair failed and we were unable to recover it. 00:27:46.312 [2024-11-20 20:28:51.047469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.312 [2024-11-20 20:28:51.047594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.047618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.047806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.047936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.047961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.048105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.048216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.048244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.048421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.048551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.048593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.048749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.048870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.048895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.049020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.049315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.049538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.049776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.049947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.050093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.050214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.050240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.050332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.050465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.050490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.050621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.050777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.050803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.050907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.051169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.051445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.051745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.051869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.052023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.052307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.052600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.052990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.053152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.053403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.053662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.053852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.053993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.054093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.054121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.054233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.054359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.054385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.054535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.054667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.054692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.054865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.055034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.055059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.055240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.055333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.055359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.313 [2024-11-20 20:28:51.055509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.055676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.313 [2024-11-20 20:28:51.055705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.313 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.055842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.055977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.056164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.056455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.056733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.056908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.057022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.057174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.057200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.057312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.057468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.057492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.057614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.057761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.057789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.057918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.058198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.058531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.058764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.058909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.059008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.059131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.059157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.059318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.059443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.059470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.059645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.059744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.059769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.059915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.060196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.060552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.060795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.060924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.061060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.061200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.061228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.061368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.061498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.061522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.061646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.061765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.061794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.061903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.062226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.062510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.062929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.063053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.063161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.063188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.063332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.063485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.063512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.063620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.063794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.314 [2024-11-20 20:28:51.063822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.314 qpair failed and we were unable to recover it. 00:27:46.314 [2024-11-20 20:28:51.063992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.064276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.064534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.064886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.064982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.065127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.065452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.065709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.065832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.065956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.066104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.066133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.066288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.066384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.066408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.066563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.066691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.066733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.066842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.067171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.067460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.067814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.067945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.068098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.068300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.068352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.068470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.068576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.068602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.068735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.068830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.068857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.068966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.069294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.069521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.069760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.069912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.070030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.070161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.070187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.070306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.070441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.070469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.070636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.070734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.070762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.070936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.071065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.315 [2024-11-20 20:28:51.071095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.315 qpair failed and we were unable to recover it. 00:27:46.315 [2024-11-20 20:28:51.071269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.071428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.071454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.071553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.071717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.071742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.071835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.071962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.071987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.072153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.072279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.072304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.072444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.072547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.072588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.072682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.072808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.072834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.072927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.073258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.073509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.073801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.073945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.074076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.074203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.074230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.074323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.074442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.074467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.074653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.074750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.074777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.074906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.075174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.075445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.075740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.075929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.076100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.076192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.076217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.076387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.076521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.076549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.076685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.076830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.076857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.076956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.077115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.077141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.077327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.077461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.077487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.077619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.077734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.077777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.077935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.078207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.078534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.078877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.078994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.079114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.079238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.079264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.316 qpair failed and we were unable to recover it. 00:27:46.316 [2024-11-20 20:28:51.079405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.316 [2024-11-20 20:28:51.079548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.079576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.079701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.079796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.079821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.079925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.080250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.080562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.080792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.080960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.081126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.081237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.081266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.081412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.081534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.081560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.081696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.081829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.081857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.082032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.082194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.082219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.082352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.082515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.082540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.082693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.082821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.082846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.082969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.083246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.083498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.083822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.083960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.084094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.084219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.084245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.084344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.084485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.084512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.084652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.084802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.084827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.084955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.085235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.085487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.085829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.085949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.086081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.086178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.086204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.086371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.086479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.086506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.086618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.086769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.086794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.086942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.087081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.087109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.087220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.087389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.087414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.317 [2024-11-20 20:28:51.087544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.087666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.317 [2024-11-20 20:28:51.087690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.317 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.087802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.087951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.087977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.088095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.088275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.088303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.088470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.088596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.088637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.088786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.088917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.088955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.089089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.089222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.089251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.089376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.089496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.089520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.089619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.089776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.089801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.089940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.090250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.090549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.090840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.090986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.091123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.091231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.091255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.091356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.091481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.091506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.091604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.091749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.091783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.091962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.092222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.092525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.092843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.092960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.093113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.093220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.093263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.093381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.093470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.093513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.093686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.093812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.093837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.093955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.094122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.094150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.094287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.094435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.094461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.094593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.094746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.094772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.094934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.095147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.095466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.095689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.095810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.318 qpair failed and we were unable to recover it. 00:27:46.318 [2024-11-20 20:28:51.095997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.318 [2024-11-20 20:28:51.096138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.096167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.096313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.096411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.096437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.096534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.096658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.096684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.096860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.097139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.097407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.097674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.097857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.097987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.098151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.098194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.098334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.098480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.098505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.098629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.098783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.098808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.098959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.099296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.099591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.099891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.099989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.100114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.100443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.100742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.100887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.101049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.101185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.101210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.101379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.101538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.101566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.101713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.101837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.101863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.101978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.102250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.102540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.102869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.102994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.103141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.103430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.103696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.103891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.103986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.104135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.104160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.319 qpair failed and we were unable to recover it. 00:27:46.319 [2024-11-20 20:28:51.104263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.319 [2024-11-20 20:28:51.104390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.104415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.104556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.104698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.104722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.104875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.105180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.105471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.105745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.105908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.106056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.106163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.106188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.106358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.106538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.106596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.106763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.106902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.106930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.107056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.107156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.107182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.107323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.107469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.107493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.107598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.107754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.107779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.107909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.108200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.108478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.108799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.108918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.109094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.109271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.109297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.109418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.109552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.109580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.109707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.109829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.109855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.110026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.110175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.110203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.110356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.110510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.110535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.110664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.110762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.110787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.110938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.111256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.111514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.320 qpair failed and we were unable to recover it. 00:27:46.320 [2024-11-20 20:28:51.111769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.320 [2024-11-20 20:28:51.111909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.111936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.112091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.112209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.112235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.112355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.112451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.112475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.112598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.112741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.112765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.112884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.113233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.113474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.113729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.113881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.113977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.114081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.114106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.114209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.114347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.114373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.114542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.114679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.114708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.114856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.115180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.115488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.115817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.115966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.116090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.116197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.116226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.116372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.116496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.116521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.116610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.116752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.116777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.116952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.117251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.117515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.117817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.117973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.118083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.118254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.118279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.118378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.118479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.118506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.118671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.118845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.118870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.119021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.119150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.119180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.119294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.119404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.119429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.119527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.119692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.119718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.119846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.120006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.321 [2024-11-20 20:28:51.120031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.321 qpair failed and we were unable to recover it. 00:27:46.321 [2024-11-20 20:28:51.120150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.120251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.120277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.120430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.120547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.120574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.120688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.120795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.120823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.120965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.121269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.121626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.121842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.121998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.122141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.122245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.122273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.122413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.122549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.122577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.122750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.122865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.122905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.123005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.123298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.123602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.123850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.123961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.124087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.124216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.124241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.124395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.124513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.124538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.124655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.124758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.124788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.124919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.125248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.125542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.125812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.125974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.126118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.126213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.126240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.126348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.126491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.126517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.126657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.126754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.126779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.126881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.127164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.127416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.127740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.127882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.322 qpair failed and we were unable to recover it. 00:27:46.322 [2024-11-20 20:28:51.128031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.322 [2024-11-20 20:28:51.128179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.128207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.128316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.128502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.128526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.128679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.128774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.128800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.128939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.129245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.129587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.129841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.129995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.130149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.130302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.130330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.130472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.130625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.130650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.130747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.130894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.130922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.131080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.131182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.131206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.131342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.131466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.131491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.131617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.131756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.131784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.131926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.132203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.132488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.132735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.132859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.132994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.133282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.133573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.133860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.133985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.134142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.134456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.134745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.134893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.135064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.135219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.135244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.135447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.135651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.135702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.135857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.135987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.136016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.136122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.136248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.136274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.136426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.136546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.323 [2024-11-20 20:28:51.136574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.323 qpair failed and we were unable to recover it. 00:27:46.323 [2024-11-20 20:28:51.136687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.136822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.136850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.137016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.137282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.137554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.137847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.137980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.138160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.138474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.138745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.138937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.139042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.139326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.139555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.139789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.139918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.140037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.140127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.140153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.140254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.140383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.140408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.140754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.140781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.140992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.141134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.141160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.141257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.141386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.141412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.141560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.141706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.141735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.141882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.142202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.142439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.142744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.142885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.142995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.143124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.143149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.143258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.143411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.143438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.143605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.143773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.143800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.324 qpair failed and we were unable to recover it. 00:27:46.324 [2024-11-20 20:28:51.143942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.144052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.324 [2024-11-20 20:28:51.144087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.144229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.144358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.144401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.144557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.144668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.144695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.144835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.144946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.144974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.145092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.145240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.145265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.145406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.145547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.145575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.145683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.145820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.145848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.145955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.146255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.146517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.146840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.146964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.147060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.147175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.147201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.147322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.147456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.147484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.147594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.147711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.147738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.147873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.148155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.148461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.148740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.148885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.149028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.149153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.149179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.149282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.149430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.149459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.149584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.149761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.149789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.149951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.150129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.150156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.150295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.150435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.150462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.150693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.150829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.150856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.150974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.151262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.151524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.151780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.151940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.325 qpair failed and we were unable to recover it. 00:27:46.325 [2024-11-20 20:28:51.152092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.152212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.325 [2024-11-20 20:28:51.152237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.152341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.152457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.152482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.152591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.152695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.152724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.152835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.152971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.153149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.153384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.153715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.153843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.153964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.154096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.154125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.154250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.154385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.154412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.154545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.154708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.154736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.154869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.155169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.155416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.155676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.155860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.155994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.156290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.156547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.156807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.156969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.157081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.157319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.157524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.157758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.157945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.158088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.158183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.158208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.158311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.158451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.158479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.158585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.158720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.158748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.158974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.159103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.159141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.159297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.159458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.159500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.159625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.159822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.159865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.326 [2024-11-20 20:28:51.159994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.160135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.326 [2024-11-20 20:28:51.160164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.326 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.160296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.160475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.160501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.160657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.160802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.160827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.160924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.161082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.161134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.161248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.161409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.161452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.161602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.161773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.161799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.161928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.162195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.162411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.162636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.162787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.162919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.163218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.163494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.163739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.163895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.163995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.164086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.164112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.164238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.164382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.164407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.164544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.164699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.164725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.164851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.165142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.165451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.165782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.165930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.166034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.166342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.166645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.166874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.166996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.167125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.167397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.167665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.167846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.167977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.168097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.168124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.327 qpair failed and we were unable to recover it. 00:27:46.327 [2024-11-20 20:28:51.168227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.327 [2024-11-20 20:28:51.168330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.168355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.168477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.168605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.168630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.168756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.168909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.168934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.169060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.169369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.169637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.169859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.169983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.170146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.170439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.170766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.170914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.171081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.171245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.171273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.171390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.171511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.171536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.171640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.171767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.171793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.171913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.172152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.172397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.172698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.172854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.172985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.173251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.173498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.173797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.173977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.174118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.174215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.174241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.174337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.174465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.174490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.174613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.174764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.174789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.174918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.175171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.175442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.175726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.175901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.328 [2024-11-20 20:28:51.176026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.176145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.328 [2024-11-20 20:28:51.176196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.328 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.176293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.176415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.176440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.176592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.176717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.176742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.176847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.176972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.176997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.177123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.177247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.177272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.177372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.177498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.177524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.177624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.177725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.177750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.177851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.178196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.178485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.178773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.178930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.179086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.179230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.179275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.179420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.179565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.179590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.179689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.179813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.179838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.179995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.180241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.180540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.180801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.180919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.181045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.181331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.181580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.181879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.181980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.182116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.182420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.182743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.182864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.329 qpair failed and we were unable to recover it. 00:27:46.329 [2024-11-20 20:28:51.182991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.329 [2024-11-20 20:28:51.183092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.183216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.183499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.183831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.183989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.184126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.184251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.184276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.184428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.184531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.184557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.184691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.184820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.184845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.184976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.185283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.185614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.185882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.185983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.186137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.186393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.186676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.186804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.186927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.187282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.187596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.187871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.187994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.188137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.188279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.188306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.188410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.188537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.188562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.188714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.188813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.188838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.188968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.189113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.189143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.189346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.189501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.189526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.189680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.189786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.189811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.189974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.190249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.190561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.190845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.190973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.191101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.191248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.330 [2024-11-20 20:28:51.191291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.330 qpair failed and we were unable to recover it. 00:27:46.330 [2024-11-20 20:28:51.191468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.191610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.191635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.191788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.191942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.191967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.192138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.192259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.192286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.192408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.192536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.192562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.192664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.192770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.192797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.192932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.193229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.193476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.193750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.193900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.194004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.194173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.194217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.194362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.194530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.194556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.194677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.194804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.194830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.194959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.195258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.195587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.195867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.195995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.196022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.196136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.196331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.196360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.196556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.196725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.196750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.196878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.197145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.197476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.197742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.197898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.198053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.198211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.198237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.198367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.198495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.198521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.198644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.198847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.198873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.199040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.199186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.199230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.199376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.199505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.199534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.199705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.199842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.199868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.331 qpair failed and we were unable to recover it. 00:27:46.331 [2024-11-20 20:28:51.200027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.331 [2024-11-20 20:28:51.200192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.200236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.200409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.200554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.200597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.200722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.200816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.200842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.200967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.201275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.201561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.201858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.201988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.202148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.202394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.202717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.202917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.203021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.203172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.203201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.203332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.203504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.203531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.203667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.203805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.203832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.203973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.204085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.204127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.204281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.204449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.204476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.204609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.204811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.204835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.204966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.205217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.205457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.205741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.205933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.206120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.206246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.206271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.206393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.206504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.206531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.206626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.206735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.206761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.206901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.207221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.207461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.207766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.207966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.208140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.208273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.208298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.208403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.208536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.332 [2024-11-20 20:28:51.208563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.332 qpair failed and we were unable to recover it. 00:27:46.332 [2024-11-20 20:28:51.208731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.208866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.208900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.209045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.209186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.209211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.209367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.209514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.209541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.209653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.209763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.209791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.209961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.210137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.210162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.210290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.210433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.210461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.210602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.210767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.210794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.210925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.211091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.211133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.211273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.211432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.211457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.211582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.211769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.211794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.211951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.212258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.212575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.212868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.212975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.213146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.213408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.213679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.213864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.213979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.214139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.214164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.214258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.214405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.214432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.214630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.214731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.214758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.214901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.215189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.215438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.215728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.215891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.216034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.216146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.216171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.216322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.216447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.216471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.216589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.216738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.216763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.216919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.217061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.217098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.333 qpair failed and we were unable to recover it. 00:27:46.333 [2024-11-20 20:28:51.217274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.333 [2024-11-20 20:28:51.217374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.217398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.217509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.217613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.217640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.217793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.217920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.217945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.218043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.218307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.218657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.218903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.218996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.219146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.219398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.219730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.219844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.219991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.220283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.220553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.220793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.220944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.221039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.221292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.221501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.221771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.221889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.221980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.222224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.222510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.222815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.222986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.223126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.223258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.223285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.223393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.223537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.223563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.223715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.223805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.223829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.334 qpair failed and we were unable to recover it. 00:27:46.334 [2024-11-20 20:28:51.223986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.334 [2024-11-20 20:28:51.224117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.224143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.224263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.224393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.224420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.224593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.224676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.224700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.224871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.225160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.225434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.225763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.225931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.226025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.226123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.226165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.226309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.226431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.226463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.226592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.226701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.226728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.226889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.227039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.227063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.227226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.227399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.227431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.227583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.227725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.227749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.227896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.228175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.228476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.228715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.228879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.228992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.229144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.229169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.229319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.229479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.229506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.229647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.229761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.229803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.229956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.230090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.230132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.230271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.230399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.230543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.230695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.230719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.230849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.231217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.231486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.231796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.231920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.232044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.232190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.232218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.232375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.232460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.335 [2024-11-20 20:28:51.232484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.335 qpair failed and we were unable to recover it. 00:27:46.335 [2024-11-20 20:28:51.232643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.232763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.232787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.232909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.233193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.233454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.233747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.233912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.234019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.234152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.234180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.234354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.234505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.234547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.234721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.234843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.234868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.235012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.235186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.235211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.235311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.235439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.235465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.235597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.235700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.235728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.235906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.236058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.236089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.236252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.236380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.236421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.236586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.236717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.236744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.236876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.237170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.237435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.237720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.237882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.238025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.238329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.238623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.238895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.238983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.239160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.239432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.239702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.239847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.239948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.240205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.240555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.336 [2024-11-20 20:28:51.240849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.240986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.336 [2024-11-20 20:28:51.241013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.336 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.241140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.241274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.241301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.241418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.241544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.241573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.241714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.241883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.241908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.242039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.242253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.242514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.242784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.242958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.243091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.243221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.243246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.243383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.243549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.243576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.243702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.243836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.243863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.244013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.244343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.244610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.244879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.244998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.245138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.245432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.245695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.245835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.245954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.246271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.246538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.246809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.246981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.247140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.247256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.247280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.247402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.247556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.247580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.247765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.247902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.247930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.248080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.248205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.248230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.248330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.248458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.248482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.248662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.248787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.248812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.248988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.249095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.249125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.337 qpair failed and we were unable to recover it. 00:27:46.337 [2024-11-20 20:28:51.249263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.337 [2024-11-20 20:28:51.249390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.249414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.249541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.249636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.249679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.249783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.249882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.249909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.250053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.250187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.250213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.250338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.250517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.250544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.250723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.250878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.250902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.251024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.251337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.251552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.251852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.251996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.252146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.252285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.252314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.252419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.252551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.252578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.252693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.252787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.252812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.252976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.253114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.253142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.253270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.253430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.253454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.253577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.253707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.253732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.253886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.254053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.254088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.254254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.254388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.254415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.254541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.254690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.254714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.254859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.255181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.255424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.255670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.255834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.255943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.256084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.256111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.256234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.256361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.256389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.338 [2024-11-20 20:28:51.256541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.256647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.338 [2024-11-20 20:28:51.256674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.338 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.256800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.256895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.256922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.257039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.257308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.257574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.257880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.257999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.258162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.258305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.258332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.258466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.258603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.258628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.258781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.258907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.258931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.259053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.259170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.259202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.259344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.259489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.259514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.259606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.259732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.259756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.259903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.260205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.260497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.260797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.260953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.261125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.261302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.261327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.261420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.261569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.261593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.261774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.261894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.261918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.262086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.262220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.262248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.262391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.262484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.262508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.262683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.262844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.262870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.263014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.263170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.263198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.263324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.263422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.263447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.263593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.263699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.263726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.263863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.264192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.264493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.264756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.264906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.339 qpair failed and we were unable to recover it. 00:27:46.339 [2024-11-20 20:28:51.265032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.339 [2024-11-20 20:28:51.265162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.265187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.265320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.265453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.265480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.265613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.265789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.265813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.265935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.266260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.266531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.266836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.266986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.267139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.267272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.267299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.267472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.267597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.267622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.267751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.267843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.267868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.268015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.268188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.268214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.268368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.268541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.268568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.268713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.268841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.268866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.268967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.269231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.269509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.269735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.269860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.270003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.270285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.270571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.270829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.270994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.271113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.271221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.271248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.271394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.271505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.271532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.271688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.271812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.271837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.271961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.272227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.272534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.272818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.272970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.340 [2024-11-20 20:28:51.273101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.273274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.340 [2024-11-20 20:28:51.273302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.340 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.273440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.273550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.273592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.273691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.273812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.273837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.273937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.274275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.274571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.274841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.274985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.275083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.275177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.275201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.275330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.275429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.275454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.275575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.275722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.275747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.275921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.276111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.276158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.276299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.276447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.276472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.276616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.276749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.276776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.276876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.277204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.277455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.277687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.277852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.277990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.278145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.278171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.278346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.278506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.278531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.278657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.278790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.278817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.278970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.279234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.279525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.279780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.279895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.280047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.280190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.280218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.280356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.280456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.280484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.280651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.280777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.280802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.280925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.281067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.281100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.281241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.281340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.281367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.341 qpair failed and we were unable to recover it. 00:27:46.341 [2024-11-20 20:28:51.281547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.281643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.341 [2024-11-20 20:28:51.281667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.281815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.281975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.282135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.282414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.282720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.282836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.282958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.283135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.283163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.283339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.283466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.283491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.283620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.283727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.283753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.283921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.284205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.284442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.284758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.284913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.285067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.285167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.285191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.285280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.285381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.285406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.285550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.285722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.285749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.285929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.286256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.286538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.286811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.286956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.287129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.287241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.287269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.287408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.287534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.287563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.287690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.287840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.287865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.288052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.288176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.288201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.288315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.288448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.288477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.288652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.288805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.288830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.288953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.289252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.289517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.289862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.289984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.290009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.342 qpair failed and we were unable to recover it. 00:27:46.342 [2024-11-20 20:28:51.290124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.342 [2024-11-20 20:28:51.290218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.290243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.290333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.290424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.290448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.290603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.290728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.290753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.290896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.291047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.291078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.291205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.291360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.291400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.291540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.291676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.291703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.291834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.292176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.292455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.292764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.292890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.292981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.293328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.293563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.293855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.293976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.294089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.294413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.294710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.294848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.294972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.295272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.295617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.295871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.295983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.296110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.296386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.296693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.296891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.297019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.297129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.297170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.343 qpair failed and we were unable to recover it. 00:27:46.343 [2024-11-20 20:28:51.297275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.343 [2024-11-20 20:28:51.297394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.297419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.297608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.297731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.297757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.297945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.298220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.298479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.298770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.298910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.299053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.299307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.299640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.299884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.299983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.300100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.300469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.300761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.300889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.300989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.301106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.301131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.301258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.301434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.301458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.301552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.301673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.301698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.301873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.302165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.302416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.302731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.302863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.302993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.303134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.303162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.303299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.303425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.303449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.303601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.303756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.303784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.303915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.304252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.304580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.304801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.304952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.305103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.305235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.305260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.305355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.305472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.344 [2024-11-20 20:28:51.305497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.344 qpair failed and we were unable to recover it. 00:27:46.344 [2024-11-20 20:28:51.305618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.305766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.305793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.305965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.306230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.306541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.306840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.306994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.307127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.307283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.307307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.307481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.307592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.307619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.307768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.307920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.307945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.308125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.308286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.308313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.308421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.308584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.308608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.308727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.308822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.308847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.308997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.309125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.309153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.309289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.309428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.309456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.309570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.309693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.309717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.309898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.310221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.310531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.310835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.310988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.311124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.311393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.311635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.311877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.311998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.312147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.312441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.312694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.312884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.313029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.313190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.313215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.313365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.313527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.313555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.313698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.313825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.313852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.345 [2024-11-20 20:28:51.313974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.314096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.345 [2024-11-20 20:28:51.314122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.345 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.314286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.314401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.314425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.314550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.314722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.314749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.314855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.314949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.314974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.315076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.315332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.315571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.315822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.315968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.316098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.316247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.316271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.316397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.316519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.316544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.316680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.316821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.316864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.317015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.317174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.317203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.317332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.317455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.317479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.317651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.317780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.317807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.317967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.318300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.318635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.318874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.318976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.319154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.319419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.319691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.319854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.320030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.320138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.320163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.320284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.320396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.320423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.320569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.320735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.320763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.320936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.321089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.321132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.321266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.321410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.346 [2024-11-20 20:28:51.321434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.346 qpair failed and we were unable to recover it. 00:27:46.346 [2024-11-20 20:28:51.321540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.321631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.321661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-20 20:28:51.321776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.321901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.321925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-20 20:28:51.322084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.322235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.322262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-20 20:28:51.322397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-20 20:28:51.322504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.322531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-20 20:28:51.322694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.322781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.322805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-20 20:28:51.322938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-20 20:28:51.323235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-20 20:28:51.323553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-20 20:28:51.323804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.323930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-20 20:28:51.324033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.324203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-20 20:28:51.324231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.324353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.324499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.324524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.324659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.324776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.324800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.324922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.325253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.325509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.325800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-20 20:28:51.325926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-20 20:28:51.326079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.326196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.326220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-20 20:28:51.326357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.326465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.326493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-20 20:28:51.326597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.326736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.326763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-20 20:28:51.326898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.327092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.327118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-20 20:28:51.327247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.327370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.327399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-20 20:28:51.327507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-20 20:28:51.327668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.327695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.327868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.327955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.327980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.328118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.328226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.328253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.328388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.328488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.328514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.328669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.328803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.328827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.328932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.329040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.329067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.329216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.329354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.329382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.329528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.329654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.329678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.329857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.330002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.330026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-20 20:28:51.330142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.330247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-20 20:28:51.330273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.330401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.330496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.330521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.330697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.330802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.330829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.331001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.331125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.331151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.331279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.331394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.331419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.331584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.331735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.331759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.331884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.332057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.332093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-20 20:28:51.332221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.332343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-20 20:28:51.332368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.332541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.332671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.332698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.332849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.332979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.333108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.333374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.333710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.333871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.334006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.334113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.334138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-20 20:28:51.334282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-20 20:28:51.334383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.334410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.334520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.334656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.334683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.334857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.334952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.334976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.335112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.335247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.335275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.335416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.335555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.335584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.335769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.335868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.335892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.336035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.336213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.336238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.336361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.336494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.336526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-20 20:28:51.336680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-20 20:28:51.336800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.336824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-20 20:28:51.336966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-20 20:28:51.337300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-20 20:28:51.337601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-20 20:28:51.337823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.337975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.338003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-20 20:28:51.338119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.338231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-20 20:28:51.338256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.338385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.338504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.338528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.338678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.338827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.338852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.339002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.339320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.339597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.339837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.339976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.340003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.340165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.340255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.340280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-20 20:28:51.340382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.340535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-20 20:28:51.340562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.340693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.340855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.340882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.341032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.341299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.341582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.341854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.341972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.342148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.342262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.342289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.638 qpair failed and we were unable to recover it. 00:27:46.638 [2024-11-20 20:28:51.342421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.638 [2024-11-20 20:28:51.342519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.342546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.342716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.342817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.342841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.342990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.343128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.343157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.343295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.343459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.343486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.343621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.343709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.343733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.343884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.344193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.344474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.639 qpair failed and we were unable to recover it. 00:27:46.639 [2024-11-20 20:28:51.344679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.639 [2024-11-20 20:28:51.344790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.344814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.344911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.345189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.345437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.345678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.345825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.345921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.346167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.346504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.640 [2024-11-20 20:28:51.346821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.640 [2024-11-20 20:28:51.346950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.640 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.347046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.347354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.347626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.347875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.347997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.348168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.348507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.348790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.348955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.349089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.349267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.641 [2024-11-20 20:28:51.349294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.641 qpair failed and we were unable to recover it. 00:27:46.641 [2024-11-20 20:28:51.349438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.349590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.349632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.642 qpair failed and we were unable to recover it. 00:27:46.642 [2024-11-20 20:28:51.349767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.349955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.349980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.642 qpair failed and we were unable to recover it. 00:27:46.642 [2024-11-20 20:28:51.350129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.350222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.350247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.642 qpair failed and we were unable to recover it. 00:27:46.642 [2024-11-20 20:28:51.350402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.350552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.350577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.642 qpair failed and we were unable to recover it. 00:27:46.642 [2024-11-20 20:28:51.350714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.350893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.642 [2024-11-20 20:28:51.350918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.642 qpair failed and we were unable to recover it. 00:27:46.642 [2024-11-20 20:28:51.351084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.351190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.351222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.351361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.351461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.351485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.351619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.351790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.351817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.351924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.352199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.352461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.352713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.352870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.643 qpair failed and we were unable to recover it. 00:27:46.643 [2024-11-20 20:28:51.353021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.643 [2024-11-20 20:28:51.353146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.353171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.353314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.353456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.353483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.353647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.353748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.353777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.353926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.354078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.354104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.354253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.354389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.354416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.354593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.354739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.354763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.354921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.355216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.355508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.644 [2024-11-20 20:28:51.355760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.644 [2024-11-20 20:28:51.355906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.644 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.356023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.356316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.356529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.356815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.356979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.357081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.357212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.357255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.357403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.357502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.357528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.645 [2024-11-20 20:28:51.357657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.357798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.645 [2024-11-20 20:28:51.357840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.645 qpair failed and we were unable to recover it. 00:27:46.646 [2024-11-20 20:28:51.357944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.646 [2024-11-20 20:28:51.358090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.646 [2024-11-20 20:28:51.358119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.646 qpair failed and we were unable to recover it. 00:27:46.646 [2024-11-20 20:28:51.358295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.646 [2024-11-20 20:28:51.358446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.646 [2024-11-20 20:28:51.358488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.646 qpair failed and we were unable to recover it. 00:27:46.646 [2024-11-20 20:28:51.358636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.646 [2024-11-20 20:28:51.358755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.646 [2024-11-20 20:28:51.358779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.647 qpair failed and we were unable to recover it. 00:27:46.647 [2024-11-20 20:28:51.358913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.647 qpair failed and we were unable to recover it. 00:27:46.647 [2024-11-20 20:28:51.359167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.647 qpair failed and we were unable to recover it. 00:27:46.647 [2024-11-20 20:28:51.359425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.647 qpair failed and we were unable to recover it. 00:27:46.647 [2024-11-20 20:28:51.359686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.647 [2024-11-20 20:28:51.359804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.359829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.648 qpair failed and we were unable to recover it. 00:27:46.648 [2024-11-20 20:28:51.359933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.648 qpair failed and we were unable to recover it. 00:27:46.648 [2024-11-20 20:28:51.360161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.648 qpair failed and we were unable to recover it. 00:27:46.648 [2024-11-20 20:28:51.360423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.648 qpair failed and we were unable to recover it. 00:27:46.648 [2024-11-20 20:28:51.360739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.360916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.648 qpair failed and we were unable to recover it. 00:27:46.648 [2024-11-20 20:28:51.361090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.648 [2024-11-20 20:28:51.361270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.361295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.649 qpair failed and we were unable to recover it. 00:27:46.649 [2024-11-20 20:28:51.361449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.361564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.361606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.649 qpair failed and we were unable to recover it. 00:27:46.649 [2024-11-20 20:28:51.361769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.361883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.361907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.649 qpair failed and we were unable to recover it. 00:27:46.649 [2024-11-20 20:28:51.362107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.362236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.362262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.649 qpair failed and we were unable to recover it. 00:27:46.649 [2024-11-20 20:28:51.362404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.362514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.362541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.649 qpair failed and we were unable to recover it. 00:27:46.649 [2024-11-20 20:28:51.362691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.362807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.649 [2024-11-20 20:28:51.362831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.650 qpair failed and we were unable to recover it. 00:27:46.650 [2024-11-20 20:28:51.362974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.363116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.363145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.650 qpair failed and we were unable to recover it. 00:27:46.650 [2024-11-20 20:28:51.363285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.363416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.363443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.650 qpair failed and we were unable to recover it. 00:27:46.650 [2024-11-20 20:28:51.363619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.363712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.363736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.650 qpair failed and we were unable to recover it. 00:27:46.650 [2024-11-20 20:28:51.363909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.364037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.364061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.650 qpair failed and we were unable to recover it. 00:27:46.650 [2024-11-20 20:28:51.364192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.364362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.650 [2024-11-20 20:28:51.364389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.650 qpair failed and we were unable to recover it. 00:27:46.651 [2024-11-20 20:28:51.364530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.364656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.364680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.651 qpair failed and we were unable to recover it. 00:27:46.651 [2024-11-20 20:28:51.364791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.364896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.364922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.651 qpair failed and we were unable to recover it. 00:27:46.651 [2024-11-20 20:28:51.365061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.651 qpair failed and we were unable to recover it. 00:27:46.651 [2024-11-20 20:28:51.365340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.651 qpair failed and we were unable to recover it. 00:27:46.651 [2024-11-20 20:28:51.365600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.651 qpair failed and we were unable to recover it. 00:27:46.651 [2024-11-20 20:28:51.365874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.365989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.651 [2024-11-20 20:28:51.366035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.652 qpair failed and we were unable to recover it. 00:27:46.652 [2024-11-20 20:28:51.366174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.652 [2024-11-20 20:28:51.366261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.652 [2024-11-20 20:28:51.366285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.652 qpair failed and we were unable to recover it. 00:27:46.652 [2024-11-20 20:28:51.366390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.652 [2024-11-20 20:28:51.366551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.652 [2024-11-20 20:28:51.366578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.652 qpair failed and we were unable to recover it. 00:27:46.652 [2024-11-20 20:28:51.366714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.652 [2024-11-20 20:28:51.366846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.652 [2024-11-20 20:28:51.366874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.652 qpair failed and we were unable to recover it. 00:27:46.652 [2024-11-20 20:28:51.366992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.653 qpair failed and we were unable to recover it. 00:27:46.653 [2024-11-20 20:28:51.367226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.653 qpair failed and we were unable to recover it. 00:27:46.653 [2024-11-20 20:28:51.367578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.653 qpair failed and we were unable to recover it. 00:27:46.653 [2024-11-20 20:28:51.367860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.367987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.368011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.653 qpair failed and we were unable to recover it. 00:27:46.653 [2024-11-20 20:28:51.368184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.653 [2024-11-20 20:28:51.368285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.368314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.654 qpair failed and we were unable to recover it. 00:27:46.654 [2024-11-20 20:28:51.368460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.368586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.368611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.654 qpair failed and we were unable to recover it. 00:27:46.654 [2024-11-20 20:28:51.368735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.368830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.368859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.654 qpair failed and we were unable to recover it. 00:27:46.654 [2024-11-20 20:28:51.368980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.369102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.369127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.654 qpair failed and we were unable to recover it. 00:27:46.654 [2024-11-20 20:28:51.369224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.369349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.654 [2024-11-20 20:28:51.369392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.654 qpair failed and we were unable to recover it. 00:27:46.654 [2024-11-20 20:28:51.369517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.369609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.369634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.655 qpair failed and we were unable to recover it. 00:27:46.655 [2024-11-20 20:28:51.369760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.369878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.369920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.655 qpair failed and we were unable to recover it. 00:27:46.655 [2024-11-20 20:28:51.370079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.370242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.370266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.655 qpair failed and we were unable to recover it. 00:27:46.655 [2024-11-20 20:28:51.370390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.370512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.370536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.655 qpair failed and we were unable to recover it. 00:27:46.655 [2024-11-20 20:28:51.370674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.370811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.655 [2024-11-20 20:28:51.370853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.655 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.371005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.656 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.371288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.656 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.371511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.656 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.371733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.371879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.656 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.372033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.372163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.372205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.656 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.372306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.372491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.372515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.656 qpair failed and we were unable to recover it. 00:27:46.656 [2024-11-20 20:28:51.372606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.656 [2024-11-20 20:28:51.372769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.657 [2024-11-20 20:28:51.372796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.657 qpair failed and we were unable to recover it. 00:27:46.657 [2024-11-20 20:28:51.372936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.657 [2024-11-20 20:28:51.373027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.657 [2024-11-20 20:28:51.373051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.657 qpair failed and we were unable to recover it. 00:27:46.657 [2024-11-20 20:28:51.373174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.657 [2024-11-20 20:28:51.373304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.657 [2024-11-20 20:28:51.373332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.657 qpair failed and we were unable to recover it. 00:27:46.657 [2024-11-20 20:28:51.373432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.657 [2024-11-20 20:28:51.373575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.658 [2024-11-20 20:28:51.373599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.658 qpair failed and we were unable to recover it. 00:27:46.658 [2024-11-20 20:28:51.373724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.658 [2024-11-20 20:28:51.373875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.658 [2024-11-20 20:28:51.373899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.658 qpair failed and we were unable to recover it. 00:27:46.658 [2024-11-20 20:28:51.374095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.658 [2024-11-20 20:28:51.374247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.658 [2024-11-20 20:28:51.374272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.659 qpair failed and we were unable to recover it. 00:27:46.659 [2024-11-20 20:28:51.374418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.659 [2024-11-20 20:28:51.374540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.659 [2024-11-20 20:28:51.374564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.659 qpair failed and we were unable to recover it. 00:27:46.659 [2024-11-20 20:28:51.374696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.659 [2024-11-20 20:28:51.374793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.659 [2024-11-20 20:28:51.374818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.659 qpair failed and we were unable to recover it. 00:27:46.659 [2024-11-20 20:28:51.374970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.659 [2024-11-20 20:28:51.375093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.660 qpair failed and we were unable to recover it. 00:27:46.660 [2024-11-20 20:28:51.375252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.660 qpair failed and we were unable to recover it. 00:27:46.660 [2024-11-20 20:28:51.375539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.660 qpair failed and we were unable to recover it. 00:27:46.660 [2024-11-20 20:28:51.375835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.375986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.660 qpair failed and we were unable to recover it. 00:27:46.660 [2024-11-20 20:28:51.376104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.660 [2024-11-20 20:28:51.376244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.376272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.661 qpair failed and we were unable to recover it. 00:27:46.661 [2024-11-20 20:28:51.376448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.376542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.376567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.661 qpair failed and we were unable to recover it. 00:27:46.661 [2024-11-20 20:28:51.376721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.376838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.376863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.661 qpair failed and we were unable to recover it. 00:27:46.661 [2024-11-20 20:28:51.377034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.377179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.377208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.661 qpair failed and we were unable to recover it. 00:27:46.661 [2024-11-20 20:28:51.377376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.377503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.377528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.661 qpair failed and we were unable to recover it. 00:27:46.661 [2024-11-20 20:28:51.377679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.661 [2024-11-20 20:28:51.377811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.377839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.662 qpair failed and we were unable to recover it. 00:27:46.662 [2024-11-20 20:28:51.377986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.662 qpair failed and we were unable to recover it. 00:27:46.662 [2024-11-20 20:28:51.378232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.662 qpair failed and we were unable to recover it. 00:27:46.662 [2024-11-20 20:28:51.378530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.662 qpair failed and we were unable to recover it. 00:27:46.662 [2024-11-20 20:28:51.378881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.378999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.379023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.662 qpair failed and we were unable to recover it. 00:27:46.662 [2024-11-20 20:28:51.379178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.662 [2024-11-20 20:28:51.379302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.379327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.663 qpair failed and we were unable to recover it. 00:27:46.663 [2024-11-20 20:28:51.379507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.379644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.379671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.663 qpair failed and we were unable to recover it. 00:27:46.663 [2024-11-20 20:28:51.379809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.379975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.380001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.663 qpair failed and we were unable to recover it. 00:27:46.663 [2024-11-20 20:28:51.380178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.380333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.663 [2024-11-20 20:28:51.380373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.663 qpair failed and we were unable to recover it. 00:27:46.664 [2024-11-20 20:28:51.380539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.380677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.380704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.664 qpair failed and we were unable to recover it. 00:27:46.664 [2024-11-20 20:28:51.380808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.380955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.380995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.664 qpair failed and we were unable to recover it. 00:27:46.664 [2024-11-20 20:28:51.381093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.381190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.381214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.664 qpair failed and we were unable to recover it. 00:27:46.664 [2024-11-20 20:28:51.381317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.381435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.381460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.664 qpair failed and we were unable to recover it. 00:27:46.664 [2024-11-20 20:28:51.381584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.381726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.381753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.664 qpair failed and we were unable to recover it. 00:27:46.664 [2024-11-20 20:28:51.381895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.382075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.664 [2024-11-20 20:28:51.382100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.664 qpair failed and we were unable to recover it. 00:27:46.665 [2024-11-20 20:28:51.382194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.382293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.382318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.665 qpair failed and we were unable to recover it. 00:27:46.665 [2024-11-20 20:28:51.382418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.382510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.382534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.665 qpair failed and we were unable to recover it. 00:27:46.665 [2024-11-20 20:28:51.382673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.382813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.382837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.665 qpair failed and we were unable to recover it. 00:27:46.665 [2024-11-20 20:28:51.382963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.383118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.383147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.665 qpair failed and we were unable to recover it. 00:27:46.665 [2024-11-20 20:28:51.383290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.383418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.383445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.665 qpair failed and we were unable to recover it. 00:27:46.665 [2024-11-20 20:28:51.383566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.665 [2024-11-20 20:28:51.383691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.383720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.383844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.383942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.383984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.384119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.384256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.384281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.384436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.384607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.384634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.384753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.384870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.384895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.385001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.385241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.385497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.385819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.385966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.386059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.386228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.386252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.666 qpair failed and we were unable to recover it. 00:27:46.666 [2024-11-20 20:28:51.386373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.666 [2024-11-20 20:28:51.386518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.386559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.386684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.386780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.386804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.386890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.386986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.387160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.387426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.387693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.387888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.388040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.388376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.388669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.388886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.388987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.389011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.389139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.389244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.389270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.389420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.389575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.667 [2024-11-20 20:28:51.389600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.667 qpair failed and we were unable to recover it. 00:27:46.667 [2024-11-20 20:28:51.389753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.389937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.389962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.390091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.390179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.390204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.390334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.390449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.390474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.390626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.390760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.390787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.390923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.391181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.391458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.391705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.391877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.392024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.392170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.392199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.392332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.392428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.392469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.392589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.392739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.392763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.668 qpair failed and we were unable to recover it. 00:27:46.668 [2024-11-20 20:28:51.392957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.668 [2024-11-20 20:28:51.393082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.393253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.393541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.393835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.393994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.394111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.394221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.394248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.394426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.394705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.394756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.394897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.395160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.395415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.395781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.669 [2024-11-20 20:28:51.395933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.669 qpair failed and we were unable to recover it. 00:27:46.669 [2024-11-20 20:28:51.396085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.396229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.396256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.396410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.396534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.396558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.396756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.396855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.396879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.397032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.397176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.397203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.397364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.397507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.397535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.397682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.397807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.397831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.398000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.398276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.398598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.670 qpair failed and we were unable to recover it. 00:27:46.670 [2024-11-20 20:28:51.398904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.670 [2024-11-20 20:28:51.398999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.399155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.399460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.399778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.399942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.400056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.400185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.400210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.400349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.400484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.400511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.400644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.400777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.400801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.400925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.401182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.401474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.401794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.401938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.402060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.402160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.402184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.402286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.402442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.402466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.402634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.402725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.402749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.402871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.403221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.403448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.403739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.403863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.404020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.404140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.404166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.404314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.404491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.404516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.404644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.404770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.404795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.404918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.405198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.405405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.671 qpair failed and we were unable to recover it. 00:27:46.671 [2024-11-20 20:28:51.405607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.671 [2024-11-20 20:28:51.405709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.405733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.405824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.405947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.405974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.406078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.406192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.406219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.406338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.406495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.406522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.406633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.406785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.406810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.406954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.407231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.407475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.407786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.407979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.408089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.408220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.408247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.408459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.408647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.408674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.408838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.408979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.409129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.409369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.409678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.409837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.409949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.410192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.410495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.410761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.410889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.410991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.411153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.411181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.411333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.411481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.411505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.411644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.411793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.411818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.411945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.412066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.412099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.672 qpair failed and we were unable to recover it. 00:27:46.672 [2024-11-20 20:28:51.412227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.672 [2024-11-20 20:28:51.412369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.412397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.412522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.412616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.412640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.412759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.412901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.412928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.413080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.413211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.413240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.413380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.413486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.413513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.413661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.413784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.413808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.413946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.414255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.414537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.414785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.414936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.415101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.415236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.415264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.415427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.415538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.415565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.415714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.415872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.415896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.416052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.416237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.416296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.416434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.416535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.416561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.416739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.416899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.416927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.417081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.417232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.417257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.417388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.417520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.417544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.417687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.417851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.417879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.417980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.418119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.418147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.418333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.418451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.418475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.418630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.418745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.418769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.418920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.419219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.419481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.419752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.419870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.419962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.420081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.673 [2024-11-20 20:28:51.420126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.673 qpair failed and we were unable to recover it. 00:27:46.673 [2024-11-20 20:28:51.420223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.420403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.420427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.420548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.420713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.420740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.420889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.421170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.421485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.421786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.421976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.422114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.422239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.422263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.422362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.422504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.422531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.422669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.422834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.422861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.422997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.423270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.423518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.423807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.423958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.424105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.424269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.424296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.424445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.424593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.424617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.424738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.424850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.424877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.425049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.425182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.425208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.425375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.425530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.425555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.425666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.425805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.425830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.425980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.426254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.426501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.426827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.426976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.427117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.427390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.427652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.427792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.427916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.428209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.428509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.428829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.428972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.429125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.429253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.429293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.429460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.429561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.429588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.674 qpair failed and we were unable to recover it. 00:27:46.674 [2024-11-20 20:28:51.429744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.674 [2024-11-20 20:28:51.429876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.429900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.430035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.430260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.430548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.430786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.430930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.431057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.431250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.431283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.431426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.431549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.431573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.431671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.431832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.431860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.432166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.432192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.432343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.432529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.432553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.432688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.432789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.432813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.432962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.433099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.433126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.433322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.433620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.433670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.433828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.433951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.433976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.434076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.434224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.434248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.434403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.434551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.434575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.434730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.434835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.434862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.435044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.435171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.435197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.435380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.435505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.435530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.435721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.435814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.435838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.436000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.436226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.436512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.436797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.436967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.437102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.437235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.437278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.437398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.437561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.437588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.437724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.437851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.437876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.438022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.438173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.438198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.438344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.438480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.438507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.438693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.438846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.438870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.438959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.439277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.439517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.439803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.439954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.440085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.440235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.440259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.440408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.440577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.440604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.440764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.440873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.440901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.441033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.441352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.441608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.441850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.441983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.442145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.442419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.442735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.442892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.675 qpair failed and we were unable to recover it. 00:27:46.675 [2024-11-20 20:28:51.443053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.675 [2024-11-20 20:28:51.443172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.443201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.443367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.443472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.443500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.443655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.443790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.443815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.443936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.444227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.444506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.444775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.444894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.445057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.445227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.445252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.445379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.445523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.445550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.445681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.445818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.445861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.445970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.446240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.446457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.446777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.446926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.447057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.447308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.447614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.447901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.447998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.448150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.448437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.448689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.448881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.449015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.449141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.449169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.449314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.449434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.449459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.449642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.449734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.449762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.449873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.450144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.450443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.450760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.450955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.451080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.451169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.451193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.451310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.451433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.451457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.451586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.451702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.451727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.451875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.452163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.452456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.452796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.452941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.453266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.453396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.453421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.453529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.453696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.453723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.453877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.454237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.454512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.454831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.454973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.455099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.455225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.455252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.455373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.455497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.455521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.455652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.455799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.455825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.456004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.456122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.456147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.456298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.456438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.456480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.456574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.456721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.456745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.456894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.457051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.457083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.457236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.457327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.457352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.676 qpair failed and we were unable to recover it. 00:27:46.676 [2024-11-20 20:28:51.457499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.676 [2024-11-20 20:28:51.457617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.457644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.457782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.457904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.457928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.458066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.458228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.458256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.458374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.458520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.458545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.458654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.458778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.458803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.458939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.459156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.459399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.459609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.459856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.459977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.460127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.460401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.460702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.460841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.460983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.461233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.461443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.461702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.461868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.462013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.462139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.462164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.462263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.462437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.462464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.462670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.462805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.462832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.462970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.463078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.463107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.467223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.467388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.467419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.467569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.467720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.467747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.468008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.468218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.468247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.468397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.468547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.468572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.468718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.468843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.468868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.468996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.469136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.469165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.469301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.469419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.469461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.469565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.469704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.469731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.469881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.470184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.470426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.470704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.470861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.470961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.471242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.471570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.471889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.471999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.472179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.472474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.472767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.472945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.473078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.473214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.473239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.473363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.473515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.473540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.473692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.473859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.473884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.473972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.474095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.474121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.474250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.474399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.474426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.474583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.474705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.474729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.474911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.475083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.475112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.475236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.475367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.475394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.475546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.475667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.677 [2024-11-20 20:28:51.475691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.677 qpair failed and we were unable to recover it. 00:27:46.677 [2024-11-20 20:28:51.475816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.475936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.475961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.476132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.476259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.476284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.476411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.476516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.476559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.476733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.476835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.476862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.476978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.477263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.477514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.477846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.477974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.478123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.478271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.478296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.478439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.478544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.478572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.478715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.478849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.478884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.479047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.479158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.479186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.479312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.479464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.479488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.479636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.479748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.479772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.479941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.480324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.480610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.480829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.480974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.481078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.481395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.481604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.481874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.481998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.482115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.482422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.482693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.482819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.482954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.483225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.483532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.483812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.483942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.484032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.484164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.484206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.484363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.484485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.484509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.484683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.484819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.484847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.484994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.485159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.485185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.485334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.485468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.485509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.485610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.485755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.485779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.485924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.486209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.486506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.486751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.486944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.487050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.487183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.487208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.487314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.487440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.487464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.487578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.487712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.487739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.487915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.488103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.488132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.488305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.488426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.488451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.488544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.488663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.488697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.488867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.489010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.489037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.678 qpair failed and we were unable to recover it. 00:27:46.678 [2024-11-20 20:28:51.489150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.678 [2024-11-20 20:28:51.489253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.489280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.489392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.489558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.489585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.489708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.489863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.489887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.490033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.490355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.490612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.490890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.490992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.491190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.491457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.491722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.491874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.491977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.492241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.492526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.492833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.492994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.493165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.493295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.493319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.493425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.493540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.493564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.493706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.493877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.493902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.494025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.494175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.494204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.494333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.494487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.494511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.494629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.494734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.494761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.494907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.495234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.495523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.495757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.495920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.496061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.496179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.496207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.496368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.496491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.496515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.496644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.496762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.496787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.496891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.497223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.497520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.497827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.497970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.498108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.498250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.498285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.498419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.498596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.498620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.498744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.498934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.498958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.499080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.499181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.499205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.499329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.499421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.499462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.499605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.499792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.499816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.499948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.500266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.500504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.500775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.500905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.501025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.501272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.501493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.501740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.501886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.501993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.502240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.502561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.502895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.502998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.503022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.503121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.503244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.503268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.679 qpair failed and we were unable to recover it. 00:27:46.679 [2024-11-20 20:28:51.503362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.679 [2024-11-20 20:28:51.503489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.503514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.503637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.503730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.503754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.503864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.503956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.503998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.504103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.504283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.504307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.504433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.504552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.504577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.504701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.504827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.504853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.505007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.505322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.505624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.505877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.505982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.506137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.506399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.506731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.506877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.507024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.507291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.507601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.507837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.507987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.508136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.508399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.508747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.508902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.508995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.509126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.509151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.509255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.509439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.509463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.509585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.509712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.509740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.509920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.510198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.510450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.510712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.510875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.511009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.511275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.511508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.511794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.511961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.512126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.512262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.512288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.512431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.512557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.512587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.512730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.512877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.512904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.513065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.513188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.513216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.513352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.513470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.513510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.513678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.513826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.513851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.513946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.514240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.514545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.514812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.514952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.515126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.515287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.515314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.515422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.515605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.515630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.515739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.515913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.515940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.516090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.516221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.516246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.680 [2024-11-20 20:28:51.516421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.516571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.680 [2024-11-20 20:28:51.516595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.680 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.516720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.516865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.516892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.517009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.517327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.517580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.517825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.517965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.518132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.518291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.518319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.518445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.518567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.518591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.518721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.518856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.518880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.519024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.519190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.519215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.519304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.519490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.519517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.519655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.519784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.519809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.519968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.520109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.520137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.520265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.520368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.520395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.520529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.520700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.520725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.520850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.521184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.521488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.521752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.521932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.522031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.522221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.522247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.522372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.522497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.522524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.522627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.522756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.522783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.522913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.523239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.523445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.523726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.523929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.524057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.524184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.524211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.524329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.524484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.524508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.524649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.524756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.524783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.524899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.525232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.525495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.525751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.525929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.526114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.526277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.526304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.526466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.526586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.526611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.526739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.526833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.526857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.526948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.527315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.527592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.527830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.527948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.528078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.528182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.528207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.528330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.528469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.528498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.528663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.528799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.528827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.528974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.529267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.529526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.529785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.529917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.530034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.530188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.530214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.530406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.530531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.530556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.530712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.530874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.530898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.681 qpair failed and we were unable to recover it. 00:27:46.681 [2024-11-20 20:28:51.531022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.531181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.681 [2024-11-20 20:28:51.531210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.531326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.531478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.531503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.531610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.531749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.531776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.531913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.532170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.532504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.532825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.532950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.533089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.533188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.533215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.533360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.533483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.533507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.533668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.533761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.533786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.533948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.534258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.534554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.534841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.534988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.535154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.535284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.535311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.535419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.535590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.535614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.535713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.535899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.535924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.536053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.536161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.536186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.536315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.536436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.536461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.536588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.536732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.536761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.536875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.537236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.537506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.537746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.537869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.537999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.538280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.538502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.538863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.538999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.539130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.539394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.539619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.539826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.539968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.540104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.540372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.540602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.540835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.540961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.541101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.541211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.541239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.541419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.541547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.541571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.541697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.541836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.541864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.541970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.542093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.542132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.542248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.542408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.542435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.542573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.542692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.542716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.542893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.543227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.543483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.543688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.543839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.543955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.544086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.544114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.544259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.544399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.544426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.544565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.544679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.544706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.544851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.545009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.545056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.682 [2024-11-20 20:28:51.545195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.545301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.682 [2024-11-20 20:28:51.545329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.682 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.545489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.545639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.545663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.545812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.545936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.545960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.546086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.546213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.546237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.546425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.546548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.546572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.546751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.546835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.546860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.546978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.547265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.547535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.547818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.547966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.548122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.548215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.548242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.548365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.548512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.548536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.548663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.548765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.548789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.548944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.549226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.549467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.549665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.549801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.549938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.550231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.550485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.550813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.550982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.551126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.551234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.551262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.551394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.551530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.551557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.551703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.551808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.551832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.551932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.552059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.552093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.552261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.552402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.552430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.552592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.552760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.552788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.552927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.553082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.553108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.553256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.553388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.553415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.553621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.553810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.553837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.553994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.554249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.554534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.554889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.554995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.555167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.555439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.555649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.555841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.555970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.556311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.556616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.556841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.556976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.557091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.557421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.557701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.557877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.558026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.558156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.558183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.558315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.558414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.558441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.683 [2024-11-20 20:28:51.558582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.558707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.683 [2024-11-20 20:28:51.558731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.683 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.558857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.558997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.559139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.559380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.559685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.559814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.559929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.560258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.560494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.560805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.560971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.561116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.561212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.561237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.561390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.561495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.561521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.561626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.561723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.561765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.561876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.562232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.562485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.562818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.562970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.563101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.563191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.563215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.563341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.563460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.563484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.563572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.563732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.563759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.563870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.564155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.564399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.564690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.564824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.564927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.565237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.565502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.565839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.565982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.566141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.566304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.566331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.566466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.566569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.566610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.566706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.566865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.566890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.567007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.567178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.567203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.567332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.567548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.567601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.567712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.567823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.567864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.567996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.568149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.568191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.568320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.568476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.568500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.568631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.568728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.568770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.568871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.569222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.569467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.569732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.569877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.569987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.570257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.570551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.570856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.570997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.571179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.571430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.571712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.571871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.571998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.572167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.572196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.572327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.572485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.572512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.572628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.572760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.572785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.684 [2024-11-20 20:28:51.572950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.573136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.684 [2024-11-20 20:28:51.573161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.684 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.573258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.573349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.573375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.573524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.573639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.573667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.573818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.573940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.573964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.574081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.574174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.574202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.574389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.574487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.574516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.574641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.574790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.574830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.574986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.575289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.575519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.575868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.575977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.576157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.576403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.576703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.576866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.576991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.577279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.577539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.577834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.577996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.578139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.578259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.578283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.578382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.578476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.578500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.578609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.578711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.578738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.578875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.579165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.579487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.579741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.579938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.580043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.580286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.580548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.580789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.580987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.581104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.581251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.581281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.581395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.581539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.581563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.581690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.581784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.581809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.581981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.582247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.582515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.582755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.582907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.583036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.583305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.583549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.583836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.583985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.584115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.584351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.584575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.584825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.584969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.585099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.585222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.585247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.585382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.585529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.585553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.585661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.585770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.585798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.585948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.586133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.685 qpair failed and we were unable to recover it. 00:27:46.685 [2024-11-20 20:28:51.586256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.586440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.685 [2024-11-20 20:28:51.586464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.586616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.586735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.586761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.586904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.587161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.587477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.587777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.587962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.588122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.588276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.588300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.588426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.588549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.588574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.588714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.588856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.588888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.589028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.589175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.589203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.589303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.589408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.589436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.589577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.589674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.589698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.589851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.590171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.590521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.590783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.590903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.591060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.591193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.591220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.591351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.591504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.591529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.591653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.591829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.591861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.592038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.592173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.592214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.592330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.592498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.592526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.592670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.592841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.592869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.592977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.593275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.593537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.593836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.593983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.594192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.594497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.594802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.594961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.595141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.595269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.595295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.595426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.595541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.595565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.595651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.595773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.595797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.595917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.596231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.596466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.596735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.596888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.597042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.597185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.597214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.597374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.597463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.597488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.597604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.597739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.597767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.597946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.598079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.598104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.598225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.598368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.598396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.598507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.598649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.598677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.598855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.599199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.599451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.599653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.599866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.599994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.600146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.600448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.600666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.686 [2024-11-20 20:28:51.600822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.686 qpair failed and we were unable to recover it. 00:27:46.686 [2024-11-20 20:28:51.600973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.601140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.601167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.601315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.601435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.601460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.601607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.601767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.601798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.601965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.602231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.602540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.602863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.602994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.603104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.603279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.603303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.603428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.603530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.603572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.603696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.603851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.603881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.604019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.604120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.604149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.604257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.604399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.604423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.604581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.604742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.604767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.604916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.605238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.605552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.605818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.605936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.606059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.606156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.606180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.606324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.606423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.606450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.606642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.606739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.606768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.606912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.607171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.607471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.607773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.607900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.608002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.608280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.608543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.608843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.608992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.609125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.609266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.609293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.609403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.609527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.609551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.609714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.609859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.609886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.609986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.610281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.610560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.610863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.610980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.611119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.611393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.611649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.611793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.611989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.612274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.612554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.612839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.612994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.613182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.613317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.613345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.613462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.613592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.613619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.613746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.613872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.613899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.614044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.614288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.614544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.614859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.614980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.615004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.615130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.615227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.615251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:46.687 qpair failed and we were unable to recover it. 00:27:46.687 [2024-11-20 20:28:51.615416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.687 [2024-11-20 20:28:51.615601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.615634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.615751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.615895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.615924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.616067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.616236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.616264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.616388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.616513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.616538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.616663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.616793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.616820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.616955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.617243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.617564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.617856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.617989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.618118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.618404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.618723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.618846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.618970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.619230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.619527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.619857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.619970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.620082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.620191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.620218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.620355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.620460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.620487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.620604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.620738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.620766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.620917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.621146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.621433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.621740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.621932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.622048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.622176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.622202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.622347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.622454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.622484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.622626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.622782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.622807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.622934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.623277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.623527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.623853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.623986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.624156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.624465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.624750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.624923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.625042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.625204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.625229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.625350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.625457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.625484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.625640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.625737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.625761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.625870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.626147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.626452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.626697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.626847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.626991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.627114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.627143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.627284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.627452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.627505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.627669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.627804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.627832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.627955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.628088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.628115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.628287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.628460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.628485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.628638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.628831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.688 [2024-11-20 20:28:51.628856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.688 qpair failed and we were unable to recover it. 00:27:46.688 [2024-11-20 20:28:51.629012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.629161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.629190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.629318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.629424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.629449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.629547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.629693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.629720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.629887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.630194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.630478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.630722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.630870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.630991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.631221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.631532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.631841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.631982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.632154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.632476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.632811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.632961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.633159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.633283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.633313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.633517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.633693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.633717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.633845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.633958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.633986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.634153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.634251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.634276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.634380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.634524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.634552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.634722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.634872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.634899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.635049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.635177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.635204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.635329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.635454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.635479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.635612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.635782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.635810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.635977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.636237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.636549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.636810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.636983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.637100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.637240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.637264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.637424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.637605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.637631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.637780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.637907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.637931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.638029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.638186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.638214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.638393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.638521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.638545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.638707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.638865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.638891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.639017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.639154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.639180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.639346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.639509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.639534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.639692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.639828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.639855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.639968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.640224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.640444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.640736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.640896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.641001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.641150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.641179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.641322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.641448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.641473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.641595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.641723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.641752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.641917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.642202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.642548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.642847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.642987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.643163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.643466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.689 [2024-11-20 20:28:51.643709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.689 [2024-11-20 20:28:51.643823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.689 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.643934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.644267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.644542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.644822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.644977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.645107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.645265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.645290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.645424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.645521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.645546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.645700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.645816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.645844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.646005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.646233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.646439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.646704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.646842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.646992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.647230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.647525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.970 qpair failed and we were unable to recover it. 00:27:46.970 [2024-11-20 20:28:51.647821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.970 [2024-11-20 20:28:51.647934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.647962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.648127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.648279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.648320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.648419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.648551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.648578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.648687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.648792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.648819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.648921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.649238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.649484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.649756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.649919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.650033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.650186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.650212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.650342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.650467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.650493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.650650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.650784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.650812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.650952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.651216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.651500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.651775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.651903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.652047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.652159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.652187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.652365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.652484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.652508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.652603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.652704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.652730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.652880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.653211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.653511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.653821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.653976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.654095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.654232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.654257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.654429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.654526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.654553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.654674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.654775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.654801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.654922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.655271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.655554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.655832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.655999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.656026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.656151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.656258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.656282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.656402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.656532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.656559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.971 qpair failed and we were unable to recover it. 00:27:46.971 [2024-11-20 20:28:51.656701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.971 [2024-11-20 20:28:51.656832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.656860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.657024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.657287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.657583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.657886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.657983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.658126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.658451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.658702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.658867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.659024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.659151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.659176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.659328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.659503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.659530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.659719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.659846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.659888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.660038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.660166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.660192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.660317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.660455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.660483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.660618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.660753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.660781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.660959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.661058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.661110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.661293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.661399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.661444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.661599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.661765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.661791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.661899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.662157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.662458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.662751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.662919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.663077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.663177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.663202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.663296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.663450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.663474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.663623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.663757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.663798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.663940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.664247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.664515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.664826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.664979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.665082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.665227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.665255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.665432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.665562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.665588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.972 qpair failed and we were unable to recover it. 00:27:46.972 [2024-11-20 20:28:51.665706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.972 [2024-11-20 20:28:51.665834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.665860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.666028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.666167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.666196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.666315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.666456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.666484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.666650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.666784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.666812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.666977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.667067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.667098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.667264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.667422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.667493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.667621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.667772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.667797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.667982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.668133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.668159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.668322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.668450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.668476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.668630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.668748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.668776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.668894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.669250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.669560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.669849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.669993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.670107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.670252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.670279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.670409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.670530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.670555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.670707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.670833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.670858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.670983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.671299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.671604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.671880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.671982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.672138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.672457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.672836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.672988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.673109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.673385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.673622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.673855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.673991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.674179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.674450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.674739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.674936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.973 qpair failed and we were unable to recover it. 00:27:46.973 [2024-11-20 20:28:51.675086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.973 [2024-11-20 20:28:51.675218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.675245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.675390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.675489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.675514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.675639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.675759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.675785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.675885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.676206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.676515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.676776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.676942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.677045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.677216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.677245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.677359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.677490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.677517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.677663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.677784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.677813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.677970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.678095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.678121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.678252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.678515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.678567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.678695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.678799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.678841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.678966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.679184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.679447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.679752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.679882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.680025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.680285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.680559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.680835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.680995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.681198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.681500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.681788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.681943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.682067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.682224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.682266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.974 qpair failed and we were unable to recover it. 00:27:46.974 [2024-11-20 20:28:51.682424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.974 [2024-11-20 20:28:51.682543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.682584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.682693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.682830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.682858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.683026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.683178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.683203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.683355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.683503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.683530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.683690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.683819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.683848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.683970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.684259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.684525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.684818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.684950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.685076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.685187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.685216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.685330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.685496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.685525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.685701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.685793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.685818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.685920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.686199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.686491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.686781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.686952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.687103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.687264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.687306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.687439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.687549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.687578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.687737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.687869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.687894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.688045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.688166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.688194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.688307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.688433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.688458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.688643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.688781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.688809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.688912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.689051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.689109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.689218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.689358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.689385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.689553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.689724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.689752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.689890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.690238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.690571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.690857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.690988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.691013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.691141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.691242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.691267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.691452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.691679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.691736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.975 qpair failed and we were unable to recover it. 00:27:46.975 [2024-11-20 20:28:51.691902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.975 [2024-11-20 20:28:51.692033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.692060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.692241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.692367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.692409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.692556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.692707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.692732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.692878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.693185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.693457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.693713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.693885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.693991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.694269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.694558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.694778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.694958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.695096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.695235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.695263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.695401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.695536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.695563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.695702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.695821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.695846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.696034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.696176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.696204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.696429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.696620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.696649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.696798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.696951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.696975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.697108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.697235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.697260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.697390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.697519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.697548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.697653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.697763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.697788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.697897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.698247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.698522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.698782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.698952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.699101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.699237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.699261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.699360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.699487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.699511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.699679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.699828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.699853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.699943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.700212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.700484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.700726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.976 [2024-11-20 20:28:51.700852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.976 qpair failed and we were unable to recover it. 00:27:46.976 [2024-11-20 20:28:51.700974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.701258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.701509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.701850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.701986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.702136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.702441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.702715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.702837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.702927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.703197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.703510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.703784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.703901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.703994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.704173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.704202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.704312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.704543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.704597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.704776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.704921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.704950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.705084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.705235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.705260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.705408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.705557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.705583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.705702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.705847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.705875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.706009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.706171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.706200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.706344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.706465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.706489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.706617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.706712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.706738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.706876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.707021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.707047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.707213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.707362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.707387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.707541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.707665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.707691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.707880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.708183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.708454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.708751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.708880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.709028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.709320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.709564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.709830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.977 [2024-11-20 20:28:51.709947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.977 qpair failed and we were unable to recover it. 00:27:46.977 [2024-11-20 20:28:51.710043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.710286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.710524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.710811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.710965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.711097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.711247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.711272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.711422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.711530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.711559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.711721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.711823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.711850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.712001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.712156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.712181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.712353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.712485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.712513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.712676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.712786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.712828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.712953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.713276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.713528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.713825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.713990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.714127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.714289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.714316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.714483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.714609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.714636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.714782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.714918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.714946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.715095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.715187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.715212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.715362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.715509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.715537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.715677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.715770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.715795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.715919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.716052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.716092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.716263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.716461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.716519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.716661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.716790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.716818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.716964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.717339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.717585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.717873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.717988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.718107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.718255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.718280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.718398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.718570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.718598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.718758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.718882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.718907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.978 qpair failed and we were unable to recover it. 00:27:46.978 [2024-11-20 20:28:51.719035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.719170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.978 [2024-11-20 20:28:51.719196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.719290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.719395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.719420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.719563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.719671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.719700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.719849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.720159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.720431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.720721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.720860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.721026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.721162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.721190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.721291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.721429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.721459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.721639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.721732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.721756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.721899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.722255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.722539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.722844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.722990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.723089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.723248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.723273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.723397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.723499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.723528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.723648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.723779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.723806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.723930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.724244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.724496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.724784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.724959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.725056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.725221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.725247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.725401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.725507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.725540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.725691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.725781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.725807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.725961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.726258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.726555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.979 qpair failed and we were unable to recover it. 00:27:46.979 [2024-11-20 20:28:51.726828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.726981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.979 [2024-11-20 20:28:51.727005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.727156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.727331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.727359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.727518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.727642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.727683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.727824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.727991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.728130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.728374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.728735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.728927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.729061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.729373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.729611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.729853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.729974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.730096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.730241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.730268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.730374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.730479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.730507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.730653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.730796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.730824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.730971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.731268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.731530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.731834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.731996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.732127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.732253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.732279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.732427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.732528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.732556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.732721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.732828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.732856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.733021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.733165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.733194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.733315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.733445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.733471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.733593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.733759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.733784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.733903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.734009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.734037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.734161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.734326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.734353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.734504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.734653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.734678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.734877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.735133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.735436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.735752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.735946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.980 qpair failed and we were unable to recover it. 00:27:46.980 [2024-11-20 20:28:51.736054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.736185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.980 [2024-11-20 20:28:51.736213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.736326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.736427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.736456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.736591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.736693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.736720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.736864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.736954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.736978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.737176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.737270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.737294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.737423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.737559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.737586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.737759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.737875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.737901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.738026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.738155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.738183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.738328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.738496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.738521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.738672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.738789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.738818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.738982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.739299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.739535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.739838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.739981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.740191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.740468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.740726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.740900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.741050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.741201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.741229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.741381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.741527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.741552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.741651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.741776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.741801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.741952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.742262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.742539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.742835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.742989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.743171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.743479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.743770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.743927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.744049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.744289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.744542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.744840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.744982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.745007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.981 qpair failed and we were unable to recover it. 00:27:46.981 [2024-11-20 20:28:51.745162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.745281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.981 [2024-11-20 20:28:51.745320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.745456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.745604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.745630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.745725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.745824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.745850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.745945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.746226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.746489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.746750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.746888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.747018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.747171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.747197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.747300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.747452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.747478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.747601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.747701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.747727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.747871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.748199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.748483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.748763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.748915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.749075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.749179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.749207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.749342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.749501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.749529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.749693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.749813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.749854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.749966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.750226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.750557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.750831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.750980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.751126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.751273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.751299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.751451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.751611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.751637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.751792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.751963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.751990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.752141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.752238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.752264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.752419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.752547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.752576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.752695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.752831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.752860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.752996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.753260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.753494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.753768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.753961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.982 qpair failed and we were unable to recover it. 00:27:46.982 [2024-11-20 20:28:51.754103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.754233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.982 [2024-11-20 20:28:51.754261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.754405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.754495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.754520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.754669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.754804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.754832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.754939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.755254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.755557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.755858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.755997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.756132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.756539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.756972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.757066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.757201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.757229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.757387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.757510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.757535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.757655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.757794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.757821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.757965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.758093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.758119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.758270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.758393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.758420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.758562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.758706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.758734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.758875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.759176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.759409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.759658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.759825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.759920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.760218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.760454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.760735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.760903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.761081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.761259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.761284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.761391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.761513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.761539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.761656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.761769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.761797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.983 [2024-11-20 20:28:51.761971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.762067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.983 [2024-11-20 20:28:51.762118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.983 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.762278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.762375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.762401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.762527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.762619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.762644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.762765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.762930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.762958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.763101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.763246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.763274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.763420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.763545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.763570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.763666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.763794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.763820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.763968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.764132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.764160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.764289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.764453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.764481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.764589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.764750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.764778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.764899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.765149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.765397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.765717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.765910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.766029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.766159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.766185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.766303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.766469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.766495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.766614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.766709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.766734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.766888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.767183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.767461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.767770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.767957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.768080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.768207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.768231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.768333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.768459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.768484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.768610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.768705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.768730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.768863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.769165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.769422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.769675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.769835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.770002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.770137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.770165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.770279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.770449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.770475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.770599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.770722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.984 [2024-11-20 20:28:51.770747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.984 qpair failed and we were unable to recover it. 00:27:46.984 [2024-11-20 20:28:51.770864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.770965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.770993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.771161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.771323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.771351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.771457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.771563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.771591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.771741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.771866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.771891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.772042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.772193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.772221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.772360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.772495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.772529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.772665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.772828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.772856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.772995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.773119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.773144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.773324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.773427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.773456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.773591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.773727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.773754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.773866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.774168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.774464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.774701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.774892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.775025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.775308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.775572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.775845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.775992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.776100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.776198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.776222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.776387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.776473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.776497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.776596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.776742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.776767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.776955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.777208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.777436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.777761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.777948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.778136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.778441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.778491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.778601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.778705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.778733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.778856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.778954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.778979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.779107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.779207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.779233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.779363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.779505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.779532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.779670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.779802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.985 [2024-11-20 20:28:51.779831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.985 qpair failed and we were unable to recover it. 00:27:46.985 [2024-11-20 20:28:51.779948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.780098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.780125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.780263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.780441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.780467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.780621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.780741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.780768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.780917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.781074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.781099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.781226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.781382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.781406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.781599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.781736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.781764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.781876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.782233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.782538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.782836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.782997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.783167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.783454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.783703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.783855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.784026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.784152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.784178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.784322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.784455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.784484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.784646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.784741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.784765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.784893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.785165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.785490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.785796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.785914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.786038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.786144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.786169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.786304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.786450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.786475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.786630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.786778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.786806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.786912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.787207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.787514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.787775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.787951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.788119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.788258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.788285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.788423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.788548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.788573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.788696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.788836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.788866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.986 [2024-11-20 20:28:51.789007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.789152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.986 [2024-11-20 20:28:51.789179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.986 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.789281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.789446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.789473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.789643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.789734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.789758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.789934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.790040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.790101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.790220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.790449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.790510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.790624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.790760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.790790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.790963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.791088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.791115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.791270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.791406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.791434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.791605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.791733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.791760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.791898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.792208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.792520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.792794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.792985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.793125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.793291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.793316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.793414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.793567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.793591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.793724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.793823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.793851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.793962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.794111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.794136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.794264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.794410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.794438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.794606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.794706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.794734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.794874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.795207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.795496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.795751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.795874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.796046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.796183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.796210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.796313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.796422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.796449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.796632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.796726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.796751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.796882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.797028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.797053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.797158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.797251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.797276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.987 qpair failed and we were unable to recover it. 00:27:46.987 [2024-11-20 20:28:51.797380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.987 [2024-11-20 20:28:51.797469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.797494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.797626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.797723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.797767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.797922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.798235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.798539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.798842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.798991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.799172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.799512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.799811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.799983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.800120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.800255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.800285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.800429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.800579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.800620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.800754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.800863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.800892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.800998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.801244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.801537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.801834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.801990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.802112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.802287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.802315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.802466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.802596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.802623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.802753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.802851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.802877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.802997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.803337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.803578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.803866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.803989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.804145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.804382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.804635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.804813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.804963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.805266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.805539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.805806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.805942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.806062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.806189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.806216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.988 qpair failed and we were unable to recover it. 00:27:46.988 [2024-11-20 20:28:51.806337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.988 [2024-11-20 20:28:51.806432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.806458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.806551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.806644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.806687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.806822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.806990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.807142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.807469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.807772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.807914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.808051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.808211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.808237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.808363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.808514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.808539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.808694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.808830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.808857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.809004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.809139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.809164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.809289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.809433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.809461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.809608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.809704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.809729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.809866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.810201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.810504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.810774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.810928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.811117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.811277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.811302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.811425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.811568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.811593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.811687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.811872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.811898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.812029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.812163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.812188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.812367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.812469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.812498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.812670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.812849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.812874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.812996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.813317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.813532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.813840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.813974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.814082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.814189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.814224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.814405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.814495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.814520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.814702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.814854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.814879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.815037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.815181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.815209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.815352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.815491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.815518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.989 qpair failed and we were unable to recover it. 00:27:46.989 [2024-11-20 20:28:51.815640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.989 [2024-11-20 20:28:51.815791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.815815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.815938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.816245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.816615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.816849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.816998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.817120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.817254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.817286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.817434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.817541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.817568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.817715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.817817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.817843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.817948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.818246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.818545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.818793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.818955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.819081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.819174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.819199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.819332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.819482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.819507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.819600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.819775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.819803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.819955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.820230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.820527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.820839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.820988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.821124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.821468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.821710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.821857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.822034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.822304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.822590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.822805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.822979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.823098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.823245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.823272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.823384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.823551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.823579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.823725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.823843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.823868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.823989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.824118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.824147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.824281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.824428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.824454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.990 qpair failed and we were unable to recover it. 00:27:46.990 [2024-11-20 20:28:51.824567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.990 [2024-11-20 20:28:51.824673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.824701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.824852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.824977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.825120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.825369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.825635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.825797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.825968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.826096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.826123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.826305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.826431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.826456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.826581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.826740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.826769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.826929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.827062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.827098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.827268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.827391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.827416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.827555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.827692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.827721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.827867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.828191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.828500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.828821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.828977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.829105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.829244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.829272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.829405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.829512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.829541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.829686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.829785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.829811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.829963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.830098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.830127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.830340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.830486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.830514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.830649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.830758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.830783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.830901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.831170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.831493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.831804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.831928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.832064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.832199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.832224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.832351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.832578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.832606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.832771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.832906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.991 [2024-11-20 20:28:51.832934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.991 qpair failed and we were unable to recover it. 00:27:46.991 [2024-11-20 20:28:51.833046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.833207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.833233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.833332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.833461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.833486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.833708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.833814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.833855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.833958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.834208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.834504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.834780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.834936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.835046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.835304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.835620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.835863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.835992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.836236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.836548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.836818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.836972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.837073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.837197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.837223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.837371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.837512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.837541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.837692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.837815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.837840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.837944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.838241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.838517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.838893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.838998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.839176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.839483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.839747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.839912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.840054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.840227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.840255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.840412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.840506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.840531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.840637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.840767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.840794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.840944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.841216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.841502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.841769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.992 [2024-11-20 20:28:51.841941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.992 qpair failed and we were unable to recover it. 00:27:46.992 [2024-11-20 20:28:51.842050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.842231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.842260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.842365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.842478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.842502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.842626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.842747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.842771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.842900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.843165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.843467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.843763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.843880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.843975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.844257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.844523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.844857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.844985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.845137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.845260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.845284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.845410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.845530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.845559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.845660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.845823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.845849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.845975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.846244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.846552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.846830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.846992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.847120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.847223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.847248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.847377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.847468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.847494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.847616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.847731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.847761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.847897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.848244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.848476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.848747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.848892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.849004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.849152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.849180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.849328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.849459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.849483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.849577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.849724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.849749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.849863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.850001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.850029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.850157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.850258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.850287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.850441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.850565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.993 [2024-11-20 20:28:51.850589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.993 qpair failed and we were unable to recover it. 00:27:46.993 [2024-11-20 20:28:51.850764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.850909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.850935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.851044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.851335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.851576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.851787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.851941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.852085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.852215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.852240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.852378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.852547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.852574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.852702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.852826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.852851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.852976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.853122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.853151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.853287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.853444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.853503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.853609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.853736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.853762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.853887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.854201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.854528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.854826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.854993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.855089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.855208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.855232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.855346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.855480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.855505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.855650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.855788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.855815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.855947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.856220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.856467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.856801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.856989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.857141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.857292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.857316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.857432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.857525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.857549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.857668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.857828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.857856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.857991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.858134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.858161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.858300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.858417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.858445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.858592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.858691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.858716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.858856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.859017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.859044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.859156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.859306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.859330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.994 qpair failed and we were unable to recover it. 00:27:46.994 [2024-11-20 20:28:51.859445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.994 [2024-11-20 20:28:51.859608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.859635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.859757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.859885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.859909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.860005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.860188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.860216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.860370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.860460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.860485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.860606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.860722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.860749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.860904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.861131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.861163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.861265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.861415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.861440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.861687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.861880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.861907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.862022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.862278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.862530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.862838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.862974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.863102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.863261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.863285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.863437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.863557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.863581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.863766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.863917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.863942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.864066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.864241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.864273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.864405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.864534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.864558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.864655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.864754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.864778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.864898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.865146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.865457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.865744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.865890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.866039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.866186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.866213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.866380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.866475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.866499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.866618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.866752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.866793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.866915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.867052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.867089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.867221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.867365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.867391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.867556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.867692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.867720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.995 qpair failed and we were unable to recover it. 00:27:46.995 [2024-11-20 20:28:51.867831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.868005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.995 [2024-11-20 20:28:51.868029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.868139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.868278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.868302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.868408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.868533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.868557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.868730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.868863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.868891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.869004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.869300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.869542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.869851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.869974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.870153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.870452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.870771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.870933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.871099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.871297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.871324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.871493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.871630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.871657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.871778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.871903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.871928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.872059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.872208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.872232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.872341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.872499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.872526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.872711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.872836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.872860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.872959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.873116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.873141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.873266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.873442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.873469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.873606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.873760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.873784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.873909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.874243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.874512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.874786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.874952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.875086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.875345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.875598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.875880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.875989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.876181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.876535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.876811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.996 [2024-11-20 20:28:51.876973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.996 qpair failed and we were unable to recover it. 00:27:46.996 [2024-11-20 20:28:51.877097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.877203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.877228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.877361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.877486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.877513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.877661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.877801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.877824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.877948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.878097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.878122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.878246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.878413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.878442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.878587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.878724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.878752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.878897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.879233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.879572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.879842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.879980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.880132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.880338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.880644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.880806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.880912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.881210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.881488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.881836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.881998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.882148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.882449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.882692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.882834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.882958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.883148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.883176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.883290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.883478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.883502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.883627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.883750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.883774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.883899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.884215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.884483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.884776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.884898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.885063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.885193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.885220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.885331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.885497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.885521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.885623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.885722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.885748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.997 [2024-11-20 20:28:51.885993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.886141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.997 [2024-11-20 20:28:51.886167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.997 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.886292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.886414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.886439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.886563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.886740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.886765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.886888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.887143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.887502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.887819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.887958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.888155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.888256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.888281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.888436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.888586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.888626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.888785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.888904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.888932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.889086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.889227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.889254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.889357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.889456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.889482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.889627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.889776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.889800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.889957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.890100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.890128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.890297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.890417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.890460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.890633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.890818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.890845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.890995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.891117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.891141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.891295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.891417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.891445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.891591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.891716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.891744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.891918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.892284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.892591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.892842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.892992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.893092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.893361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.893620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.893879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.893978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.894180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.894453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.894748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.894941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.895107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.895203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.895229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.998 [2024-11-20 20:28:51.895376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.895572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.998 [2024-11-20 20:28:51.895600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.998 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.895766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.895864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.895890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.896083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.896211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.896238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.896415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.896645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.896672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.896817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.896973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.897136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.897396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.897711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.897882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.897970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.898255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.898597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.898856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.898994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.899121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.899268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.899297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.899427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.899552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.899578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.899706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.899908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.899933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.900056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.900220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.900248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.900412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.900539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.900564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.900691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.900805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.900829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.900979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.901157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.901186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.901332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.901481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.901505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.901620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.901730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.901760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.901907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.902244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.902506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.902781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.902919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.903072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.903226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.903251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.903412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.903545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.903572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.903720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.903855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.903883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.904046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.904159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.904189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.904315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.904444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.904472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.904618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.904761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.904786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:46.999 [2024-11-20 20:28:51.904885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.905012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.999 [2024-11-20 20:28:51.905039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:46.999 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.905141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.905296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.905321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.905448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.905578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.905604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.905722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.905889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.905917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.906022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.906174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.906203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.906372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.906510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.906546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.906669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.906791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.906816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.906962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.907270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.907572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.907827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.907952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.908116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.908233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.908261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.908360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.908501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.908529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.908667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.908802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.908830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.908946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.909315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.909543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.909815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.909976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.910166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.910434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.910748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.910921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.911074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.911221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.911249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.911439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.911542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.911567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.911687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.911780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.911822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.911969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.912196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.912441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.912669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.912798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.000 [2024-11-20 20:28:51.912961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.913062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.000 [2024-11-20 20:28:51.913097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.000 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.913237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.913385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.913410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.913562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.913684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.913710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.913865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.913972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.914139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.914459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.914670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.914843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.914954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.915267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.915505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.915804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.915987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.916136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.916226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.916251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.916397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.916529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.916557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.916652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.916813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.916841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.916986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.917247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.917503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.917739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.917883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.918017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.918266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.918570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.918841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.918996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.919144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.919270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.919295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.919472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.919619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.919645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.919764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.919863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.919890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.919983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.920250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.920581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.920846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.920986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.921093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.921199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.921242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.921370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.921459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.921484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.001 qpair failed and we were unable to recover it. 00:27:47.001 [2024-11-20 20:28:51.921591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.921731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.001 [2024-11-20 20:28:51.921756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.921883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.922168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.922443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.922724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.922842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.922931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.923180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.923442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.923699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.923856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.924025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.924270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.924512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.924797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.924931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.925110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.925209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.925234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.925372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.925469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.925497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.925636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.925763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.925789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.925911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.926273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.926541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.926814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3280748 Killed "${NVMF_APP[@]}" "$@" 00:27:47.002 [2024-11-20 20:28:51.926924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.926950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.927055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.927168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 20:28:51 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:47.002 [2024-11-20 20:28:51.927194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.927314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 20:28:51 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:47.002 [2024-11-20 20:28:51.927444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.927469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 20:28:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 20:28:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:47.002 [2024-11-20 20:28:51.927623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 20:28:51 -- common/autotest_common.sh@10 -- # set +x 00:27:47.002 [2024-11-20 20:28:51.927771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.927799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.927942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.928255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.928542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.928772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.928925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.929057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.929163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.929189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.929334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.929437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.929465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.929587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.929693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.002 [2024-11-20 20:28:51.929721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.002 qpair failed and we were unable to recover it. 00:27:47.002 [2024-11-20 20:28:51.929829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.929939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.929968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.930120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.930222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.930247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.930339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.930456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.930481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.930644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.930770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.930795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.930931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.931104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.931133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 20:28:51 -- nvmf/common.sh@469 -- # nvmfpid=3281450 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 20:28:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:47.003 [2024-11-20 20:28:51.931280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 20:28:51 -- nvmf/common.sh@470 -- # waitforlisten 3281450 00:27:47.003 [2024-11-20 20:28:51.931417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.931443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 20:28:51 -- common/autotest_common.sh@829 -- # '[' -z 3281450 ']' 00:27:47.003 [2024-11-20 20:28:51.931540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 20:28:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:47.003 [2024-11-20 20:28:51.931632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.931658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 20:28:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:47.003 [2024-11-20 20:28:51.931794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 20:28:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:47.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:47.003 [2024-11-20 20:28:51.931901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 20:28:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:47.003 [2024-11-20 20:28:51.931927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 20:28:51 -- common/autotest_common.sh@10 -- # set +x 00:27:47.003 [2024-11-20 20:28:51.932072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.932334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.932575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.932839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.932998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.933143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.933248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.933277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.933399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.933529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.933557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.933676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.933791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.933817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.933945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.934173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.934458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.934730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.934881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.935026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.935318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.935596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.935824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.935983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.936103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.936231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.936257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.936386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.936508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.936537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.936665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.936818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.936844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.937002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.937118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.937144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.937297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.937416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.937444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.003 [2024-11-20 20:28:51.937547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.937677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.003 [2024-11-20 20:28:51.937705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.003 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.937835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.937940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.937965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.938149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.938284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.938312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.938422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.938561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.938589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.938763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.938890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.938915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.939004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.939272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.939547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.939794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.939957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.940105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.940228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.940253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.940427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.940594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.940620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.940715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.940848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.940876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.940982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.941295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.941578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.941815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.941953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.942102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.942230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.942259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.942386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.942516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.942542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.942630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.942759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.942788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.942932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.943204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.943513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.943789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.943932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.944085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.944178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.944203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.944349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.944454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.004 [2024-11-20 20:28:51.944482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.004 qpair failed and we were unable to recover it. 00:27:47.004 [2024-11-20 20:28:51.944651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.944747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.944772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.944873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.944998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.945132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.945468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.945745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.945918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.946097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.946240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.946267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.946369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.946484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.946511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.946613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.946712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.946753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.946874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.947164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.947493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.947746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.947915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.948049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.948194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.948221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.948351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.948454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.948480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.948613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.948751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.948784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.948923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.949154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.949398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.949669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.949795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.949903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.950201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.950429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.950680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.950902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.950991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.951157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.951434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.951660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.951775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.951904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.952186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.952454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.952708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.005 [2024-11-20 20:28:51.952823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.005 qpair failed and we were unable to recover it. 00:27:47.005 [2024-11-20 20:28:51.952943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.953205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.953464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.953769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.953899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.953993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.954253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.954491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.954775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.954890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.954991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.955242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.955486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.955774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.955895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.955990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.956266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.956511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.956831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.956960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.957092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.957323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.957577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.957822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.957952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.958109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.958325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.958598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.958848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.958975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.959109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.959240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.959264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.959397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.959526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.959550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.959677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.959774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.959798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.959932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.960023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.960046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.960202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.960327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.006 [2024-11-20 20:28:51.960353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.006 qpair failed and we were unable to recover it. 00:27:47.006 [2024-11-20 20:28:51.960480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.960610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.960635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.960735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.960858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.960887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.960984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.961217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.961471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.961718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.961868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.962000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.962249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.962496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.962733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.962881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.962975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.963207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.963489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.963769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.963918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.964014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.964314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.964541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.964779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.964930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.965051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.965338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.965577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.965847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.965996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.966138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.966450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.966674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.966821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.966926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.967185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.967483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.967780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.967920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.968044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.968158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.968183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.968290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.968416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.007 [2024-11-20 20:28:51.968440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.007 qpair failed and we were unable to recover it. 00:27:47.007 [2024-11-20 20:28:51.968575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.968677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.968702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.968812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.968907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.968931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.969082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.969215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.969240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.969368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.969491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.969515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.969637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.969763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.969788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.969908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.970181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.970430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.970696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.970846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.970971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.971260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.971521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.971790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.971935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.972039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.972266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.972537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.972785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.972956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.973082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.973302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973364] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:47.008 [2024-11-20 20:28:51.973427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973430] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:47.008 [2024-11-20 20:28:51.973451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.973573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.973847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.973996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.974116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.974224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.974248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.974401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.974523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.974547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.974667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.974764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.974790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.974881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.975008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.975033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.008 qpair failed and we were unable to recover it. 00:27:47.008 [2024-11-20 20:28:51.975133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.008 [2024-11-20 20:28:51.975259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.975284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.975429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.975522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.975548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.975666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.975865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.975890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.976019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.976279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.976548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.976799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.976913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.977035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.977298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.977586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.977804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.977966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.978100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.978348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.978628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.978890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.978987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.979123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.979356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.979632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.979864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.979993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.980149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.980418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.980675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.980821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.980925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.981184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.981434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.981693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.981846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.981979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.982201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.982483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.982780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.982932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.009 qpair failed and we were unable to recover it. 00:27:47.009 [2024-11-20 20:28:51.983044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.009 [2024-11-20 20:28:51.983143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.010 qpair failed and we were unable to recover it. 00:27:47.010 [2024-11-20 20:28:51.983292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.010 qpair failed and we were unable to recover it. 00:27:47.010 [2024-11-20 20:28:51.983540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.010 qpair failed and we were unable to recover it. 00:27:47.010 [2024-11-20 20:28:51.983789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.983939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.010 qpair failed and we were unable to recover it. 00:27:47.010 [2024-11-20 20:28:51.984037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.984143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.984169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.010 qpair failed and we were unable to recover it. 00:27:47.010 [2024-11-20 20:28:51.984264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.984358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.010 [2024-11-20 20:28:51.984383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.010 qpair failed and we were unable to recover it. 00:27:47.010 [2024-11-20 20:28:51.984478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.984598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.984625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.984752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.984906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.984931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.985054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.985341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.985590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.985858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.985984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.986112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.986341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.986582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.986827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.986982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.987106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.987360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.987605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.987853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.987977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.988103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.988345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.988591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.988856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.988979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.989003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.293 [2024-11-20 20:28:51.989105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.989199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.293 [2024-11-20 20:28:51.989225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.293 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.989322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.989476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.989501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.989606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.989699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.989724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.989849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.989973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.989998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.990096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.990224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.990249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.990376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.990506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.990531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.990653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.990782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.990806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.990903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.991148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.991400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.991691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.991836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.991961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.992210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.992474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.992694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.992845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.992967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.993238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.993495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.993757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.993879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.993986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.994268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.994539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.994791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.994936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.995089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.995365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.995621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.995869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.995990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.996117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.996206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.996232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.996357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.996473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.996497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.294 qpair failed and we were unable to recover it. 00:27:47.294 [2024-11-20 20:28:51.996618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.294 [2024-11-20 20:28:51.996715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.996738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.996837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.996968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.996992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.997110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.997234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.997264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.997363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.997465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.997490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.997643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.997742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.997766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.997870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.998132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.998395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.998652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.998902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.998993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.999139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.999410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.999658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:51.999796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:51.999898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.000195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.000462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.000701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.000822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.000947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.001201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.001532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.001838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.001953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.002085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.002213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.002238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.002340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.002464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.002495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.002630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.002754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.002778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.002881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.003215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.003465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.003740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.003901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.295 qpair failed and we were unable to recover it. 00:27:47.295 [2024-11-20 20:28:52.003993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.295 [2024-11-20 20:28:52.004117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.004142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.004249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.004372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.004398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.004562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.004712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.004736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.004841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.004995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.005147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.005422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.005700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.005826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.005954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.006204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.006490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.006739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.006886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.006991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.007213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.007460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.007766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.007912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.008040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.008267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.008494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.008796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.008919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.009044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.009192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.009217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.009370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.009522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.009547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.009698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.009800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.009825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.009934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.010205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.010431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.010699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.010822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.010928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.011054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.296 [2024-11-20 20:28:52.011084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.011185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.011304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.011330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.296 [2024-11-20 20:28:52.011441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.011538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.296 [2024-11-20 20:28:52.011564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.296 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.011718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.011841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.011865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.011964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.012231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.012517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.012800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.012946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.013067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.013168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.013193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.013293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.013416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.013440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.013672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.013776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.013800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.013898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.014222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.014513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.014778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.014919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.015050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.015311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.015613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.015833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.015947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.016048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.016343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.016568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.016831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.016957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.017087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.017177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.017202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.017356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.017475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.017500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.017601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.017753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.017778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.297 [2024-11-20 20:28:52.017918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.018041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.297 [2024-11-20 20:28:52.018066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.297 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.018196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.018298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.018323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.018415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.018535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.018560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.018692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.018811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.018835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.018961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.019216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.019473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.019722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.019847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.019952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.020229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.020501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.020750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.020900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.021002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.021279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.021595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.021814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.021988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.022116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.022238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.022262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.022362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.022488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.022514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.022652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.022776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.022801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.022915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.023177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.023450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.023714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.023824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.023949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.024191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.024410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.024661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.024810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.024909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.025038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.025063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.025179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.025284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.025309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.298 qpair failed and we were unable to recover it. 00:27:47.298 [2024-11-20 20:28:52.025409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.298 [2024-11-20 20:28:52.025504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.025529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.025651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.025743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.025768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.025925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.026164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.026405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.026663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.026814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.026916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.027285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.027532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.027797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.027997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.028142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.028366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.028599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.028867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.028975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.029115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.029399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.029673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.029882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.029998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.030109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.030355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.030583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.030797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.030942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.031066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.031299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.031563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.031806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.031961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.032081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.032343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.032585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.299 qpair failed and we were unable to recover it. 00:27:47.299 [2024-11-20 20:28:52.032822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.299 [2024-11-20 20:28:52.032914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.032939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.033065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.033203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.033228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.033383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.033534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.033559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.033680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.033783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.033808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.033933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.034178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.034433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.034691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.034848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.034976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.035249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.035525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.035749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.035906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.036012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.036244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.036543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.036757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.036897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.036997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.037295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.037577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.037860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.037993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.038113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.038363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.038612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.038881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.038983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.039133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.039374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.039631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.039784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.039916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.040051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.040081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.040178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.040300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.300 [2024-11-20 20:28:52.040324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.300 qpair failed and we were unable to recover it. 00:27:47.300 [2024-11-20 20:28:52.040425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.040539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.040563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.040672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.040766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.040792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.040882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.041155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.041426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.041689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.041846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.041939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.042207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.042473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.042766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.042897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.043020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.043297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.043511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.043816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.043977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.044090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.044311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.044586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:47.301 [2024-11-20 20:28:52.044685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.044847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.044994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.045132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.045228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.045253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.045376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.045503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.045527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.045661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.045784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.045809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.045904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.046180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.046399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.046644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.046797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.046896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.047236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.047460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.301 qpair failed and we were unable to recover it. 00:27:47.301 [2024-11-20 20:28:52.047788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.301 [2024-11-20 20:28:52.047928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.048055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.048287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.048528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.048828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.048956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.049110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.049327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.049582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.049836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.049993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.050134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.050265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.050290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.050424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.050554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.050578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.050670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.050803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.050828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.050950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.051208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.051444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.051697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.051867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.051972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.052236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.052463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.052738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.052883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.052988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.053270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.053542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.053799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.053924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.054016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.054109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.054134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.302 qpair failed and we were unable to recover it. 00:27:47.302 [2024-11-20 20:28:52.054232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.302 [2024-11-20 20:28:52.054350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.054375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.054467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.054579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.054604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.054727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.054824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.054849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.054975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.055229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.055474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.055713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.055866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.056021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.056333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.056643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.056892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.056997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.057160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.057411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.057686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.057863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.057959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.058215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.058481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.058733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.058850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.058958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.059230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.059531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.059823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.059957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.060048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.060307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.060617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.060859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.060972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.061080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.061201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.061225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.061357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.061490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.061515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.303 qpair failed and we were unable to recover it. 00:27:47.303 [2024-11-20 20:28:52.061644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.061740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.303 [2024-11-20 20:28:52.061765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.061879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.062187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.062434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.062736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.062898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.063020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.063157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.063182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.063337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.063440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.063464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.063608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.063732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.063757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.063926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.064219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.064515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.064771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.064922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.065048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.065157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.065184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.065289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.065399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.065424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.065631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.065779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.065805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.065898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.066163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.066417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.066754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.066896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.067016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.067340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.067556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.067786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.067957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.068085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.068319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.068570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.068825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.068950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.069084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.069237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.069262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.069359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.069486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.069511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.304 qpair failed and we were unable to recover it. 00:27:47.304 [2024-11-20 20:28:52.069643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.304 [2024-11-20 20:28:52.069738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.069764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.069889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.069986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.070166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.070406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.070636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.070872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.070992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.071095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.071371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.071614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.071867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.071990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.072109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.072330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.072562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.072780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.072909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.073003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.073275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.073546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.073793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.073918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.074078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.074298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.074527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.074818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.074940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.075056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.075299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.075545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.075770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.075913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.076014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.076123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.076149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.076257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.076383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.076408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.305 [2024-11-20 20:28:52.076503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.076601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.305 [2024-11-20 20:28:52.076627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.305 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.076759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.076888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.076917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.077017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.077302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.077535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.077812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.077932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.078080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.078372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.078582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.078869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.078993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.079116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.079373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.079628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.079853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.079981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.080104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.080342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.080588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.080746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.080852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.081156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.081427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.081711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.081863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.081964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.082213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.082473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.082693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.082836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.082968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.083228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.083452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.083704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.083834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.306 qpair failed and we were unable to recover it. 00:27:47.306 [2024-11-20 20:28:52.083963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.084059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.306 [2024-11-20 20:28:52.084093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.084202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.084324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.084350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.084456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.084607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.084636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.084731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.084858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.084882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.084976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.085236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.085484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.085725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.085898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.085996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.086246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.086484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.086713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.086837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.086939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.087196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.087444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.087716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.087844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.087942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.088205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.088476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.088756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.088871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.089002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.089229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.089451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.089707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.089832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.089935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.090033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.090057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.307 [2024-11-20 20:28:52.090197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.090319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.307 [2024-11-20 20:28:52.090344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.307 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.090443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.090536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.090560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.090660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.090778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.090802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.090929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.091159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.091436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.091710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.091859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.091984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.092282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.092562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.092842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.092991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.093127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.093379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.093632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.093900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.093997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.094135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.094425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.094671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.094818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.094922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.095178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.095455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.095729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.095854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.095955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.096269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.096510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.096786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.096933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.097028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.097254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.097506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.308 qpair failed and we were unable to recover it. 00:27:47.308 [2024-11-20 20:28:52.097733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.308 [2024-11-20 20:28:52.097820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.097844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.097971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.098242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.098455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.098743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.098890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.098987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.099208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.099479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.099788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.099908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.100077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.100168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.100192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.100322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.100474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.100499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.100603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.100707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.100731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.100854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.101156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.101373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.101647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.101776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.101899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.102160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.102406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.102639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.102791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.102885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.103133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.103378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.103690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.103843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.103971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.104204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.104479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.104786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.104941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.105083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.105214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.309 [2024-11-20 20:28:52.105239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.309 qpair failed and we were unable to recover it. 00:27:47.309 [2024-11-20 20:28:52.105346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.105497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.105523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.105615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.105718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.105744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.105849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.105948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.105973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.106137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.106246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.106271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.106390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.106490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.106515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.106641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.106734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.106758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.106909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.107171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.107421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.107730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.107859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.107948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.108266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.108512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.108773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.108946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.109074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.109302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.109583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.109886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.109990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.110140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.110433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.110710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.110859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.110995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.111223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.111491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.111742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.111862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.111963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.112219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.112496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.310 qpair failed and we were unable to recover it. 00:27:47.310 [2024-11-20 20:28:52.112742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.310 [2024-11-20 20:28:52.112925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.113045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.113304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.113568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.113841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.113966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.114063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.114280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.114526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.114780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.114891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.115016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.115271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.115525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.115779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.115932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.116079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.116318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.116580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.116832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.116954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.117052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.117357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.117598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.117823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.117941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.118042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.118302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.118534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.118790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.118961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.311 [2024-11-20 20:28:52.119060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.119166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.311 [2024-11-20 20:28:52.119191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.311 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.119286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.119377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.119400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.119521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.119623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.119647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.119742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.119871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.119895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.120006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.120229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.120477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.120728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.120876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.121009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.121238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.121505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.121756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.121905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.122009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.122281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.122505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.122759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.122907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.123002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.123336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.123615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.123856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.123983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.124081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.124348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.124626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.124885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.124985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.125141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.125367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.125605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.125856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.125981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.126135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.126287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.126311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.312 qpair failed and we were unable to recover it. 00:27:47.312 [2024-11-20 20:28:52.126434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.312 [2024-11-20 20:28:52.126558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.126583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.126680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.126832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.126857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.126980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.127256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.127535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.127770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.127883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.127977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.128234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.128499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.128780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.128931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.129038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.129287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.129558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.129819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.129960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.130062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.130280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.130534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.130757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.130944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.131076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.131364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.131610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.131831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.131977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.132130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.132424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.132668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.132837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.132941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.133180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.133434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.313 [2024-11-20 20:28:52.133655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.313 [2024-11-20 20:28:52.133806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.313 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.133939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.134161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.134388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.134638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.134759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.134909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.135171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.135391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.135617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.135841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.135965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.136066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.136385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.136639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.136888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.136990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.137141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.137419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.137630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.137774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.137886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.138165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.138497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.138781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.138900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.139011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.139284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.139505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.139777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.139895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.140003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.140238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.140441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.140701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.314 [2024-11-20 20:28:52.140827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.314 qpair failed and we were unable to recover it. 00:27:47.314 [2024-11-20 20:28:52.140980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.141243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.141515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.141763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.141886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.141987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.142206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.142474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.142755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.142879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.142975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.143251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.143478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.143738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.143856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.143963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.144207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.144463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.144716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.144837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.144944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.145247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.145501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.145721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.145868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.146008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.146242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.146492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.146777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.146893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.146985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.147257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.147504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.147737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.147853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.315 qpair failed and we were unable to recover it. 00:27:47.315 [2024-11-20 20:28:52.147958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.315 [2024-11-20 20:28:52.148085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.148232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.148440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.148717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.148847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.148998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.149263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.149523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.149786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.149938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.150033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.150291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.150543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.150822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.150976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.151078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.151322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.151565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.151831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.151950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.152100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.152229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.152254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.152388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.152489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.152513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.152635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.152753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.152778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.152902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.153189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.153479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.153688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.153869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.153973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.154099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.154124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.154217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.154351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.154376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.316 [2024-11-20 20:28:52.154504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.154641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.316 [2024-11-20 20:28:52.154666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.316 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.154828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.154920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.154945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.155041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.155276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.155553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.155826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.155994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.156103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.156199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.156225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.156334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.156461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.156486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.156624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.156718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.156744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.156892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.157150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.157372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.157597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.157860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.157988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.158149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.158433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.158674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.158822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.158914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.159169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.159385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.159641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159639] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:47.317 [2024-11-20 20:28:52.159747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159755] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:47.317 [2024-11-20 20:28:52.159771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b9[2024-11-20 20:28:52.159773] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events0 with addr=10.0.0.2, port=4420 00:27:47.317 at runtime. 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.159788] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:47.317 [2024-11-20 20:28:52.159862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.159979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.159974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:47.317 [2024-11-20 20:28:52.160030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:47.317 [2024-11-20 20:28:52.160104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:47.317 [2024-11-20 20:28:52.160033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:47.317 [2024-11-20 20:28:52.160204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.160335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.160593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.160825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.160949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.317 [2024-11-20 20:28:52.161062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.161166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.317 [2024-11-20 20:28:52.161191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.317 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.161289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.161390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.161417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.161540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.161663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.161688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.161789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.161890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.161916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.162020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.162270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.162529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.162772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.162889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.162992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.163239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.163477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.163699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.163826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.163934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.164201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.164428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.164648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.164803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.164924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.165226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.165488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.165708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.165844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.165948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.166204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.166434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.166683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.166833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.166924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.167158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.167381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.167668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.167883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.167982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.318 [2024-11-20 20:28:52.168006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.318 qpair failed and we were unable to recover it. 00:27:47.318 [2024-11-20 20:28:52.168106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.168324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.168830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.168947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.169048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.169270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.169508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.169718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.169831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.169975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.170231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.170484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.170697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.170831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.170917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.171141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.171406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.171714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.171846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.171947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.172207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.172463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.172701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.172826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.172927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.173259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.173483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.173698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.173842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.173933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.174178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.174422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.174670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.319 qpair failed and we were unable to recover it. 00:27:47.319 [2024-11-20 20:28:52.174883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.174998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.319 [2024-11-20 20:28:52.175023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.175156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.175377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.175636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.175887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.175989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.176130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.176382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.176603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.176835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.176949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.177082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.177305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.177530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.177760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.177886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.177987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.178209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.178470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.178693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.178813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.178936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.179206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.179440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.179660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.179892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.179989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.180108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.180354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.180562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-20 20:28:52.180802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-20 20:28:52.180901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.180925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.181052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.181281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.181490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.181724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.181870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.181973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.182218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.182456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.182669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.182784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.182911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.183181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.183460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.183697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.183846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.183947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.184170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.184397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.184613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.184844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.184961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.185057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.185340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.185573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.185798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.185949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.186043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.186259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.186506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.186779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.186890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.186991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.187089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.187116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.187243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.187338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.187368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-20 20:28:52.187468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.187584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-20 20:28:52.187608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.187699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.187832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.187856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.187988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.188212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.188453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.188697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.188827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.188918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.189136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.189376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.189587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.189814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.189939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.190033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.190287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.190543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.190767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.190895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.190999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.191221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.191478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.191722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.191857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.191984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.192204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.192489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.192717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.192873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.192971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.193217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.193447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.193681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.193801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.193926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.194021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.194045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.194151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.194274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.194300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-20 20:28:52.194435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-20 20:28:52.194561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.194586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.194679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.194778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.194804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.194899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.194994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.195125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.195447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.195669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.195894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.195989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.196115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.196347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.196594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.196816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.196931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.197018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.197258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.197503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.197757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.197881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.197965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.198201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.198480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.198711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.198861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.198961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.199250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.199537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.199750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.199870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.199996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.200277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.200492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.200787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.200961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.201061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.201171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.201197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-20 20:28:52.201303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.201428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-20 20:28:52.201453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.201547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.201671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.201696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.201785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.201915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.201940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.202034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.202267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.202495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.202713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.202831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.202950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.203186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.203404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.203627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.203912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.203999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.204133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.204380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.204599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.204896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.204988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.205148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.205415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.205629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.205837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.205959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.206058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.206318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.206540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.206839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.206966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.207101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.207360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.207606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.207840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.207959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.208081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.208214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.208239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-20 20:28:52.208331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-20 20:28:52.208457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.208481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.208574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.208667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.208691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.208790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.208879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.208904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.209001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.209255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.209477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.209724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.209842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.209942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.210201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.210421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.210648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.210887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.210984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.211118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.211365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.211606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.211846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.211996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.212104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.212338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.212588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.212798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.212916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.213051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.213289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.213520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-20 20:28:52.213767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-20 20:28:52.213912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.214034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.214274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.214484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.214735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.214852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.214945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.215180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.215433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.215654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.215798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.215886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.216156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.216401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.216671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.216788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.216890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.217150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.217376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.217616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.217854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.217969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.218078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.218308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.218586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.218879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.218983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.219106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.219329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.219581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.219792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.219908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.220005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.220222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.220446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-20 20:28:52.220677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-20 20:28:52.220772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.220796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.220917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.221174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.221405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.221677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.221821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.221916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.222133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.222360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.222620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.222847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.222964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.223090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.223308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.223533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.223749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.223901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.223994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.224255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.224479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.224709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.224825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.224921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.225202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.225491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.225743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.225974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.226078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.226345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.226574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.226813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.226948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.227058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.227199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.227224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.227436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.227528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.227553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.227681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.227808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-20 20:28:52.227833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-20 20:28:52.227928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.228187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.228504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.228740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.228884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.228978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.229241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.229487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.229739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.229892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.229986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.230224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.230461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.230697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.230870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.230967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.231186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.231498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.231819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.231972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.232063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.232351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.232569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.232820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.232936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.233138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.233409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.233620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.233824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.233963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.234097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.234185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.234210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.234295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.234424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.234448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.234567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.234701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.234725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.234932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.235020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.235044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-20 20:28:52.235175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.235300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-20 20:28:52.235324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.235447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.235535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.235559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.235661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.235748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.235773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.235894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.236145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.236447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.236699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.236813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.236933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.237200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.237462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.237710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.237855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.237953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.238217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.238424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.238651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.238849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.238995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.239133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.239236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.239260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.239349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.239478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.239502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.239600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.239719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.239743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.239787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ade600 (9): Bad file descriptor 00:27:47.329 [2024-11-20 20:28:52.239938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.240208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.240460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.240703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.240826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.240955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.241181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.241390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.241607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.241856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.241981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.242006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.242156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.242254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-20 20:28:52.242279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-20 20:28:52.242489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.242628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.242658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.242785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.242886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.242912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.243007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.243276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.243486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.243694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.243840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.243934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.244230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.244489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.244821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.244957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.245061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.245286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.245558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.245781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.245902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.245997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.246242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.246466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.246750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.246863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.246956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.247215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.247497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.247763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.247913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.248032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.248129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.248154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.248248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.248368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.248393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-20 20:28:52.248514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.248632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-20 20:28:52.248657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.248744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.248836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.248860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.248984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.249262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.249466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.249705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.249859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.249998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.250277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.250491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.250719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.250866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.250959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.251224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.251470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.251742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.251856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.251974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.252066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.252098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.252229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.252337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.252364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.252469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.252681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.252706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.252805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.253176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.253429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.253699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.253875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.253998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.254241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.254457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.254701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.254853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.254950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.255183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.255442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.255704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.255857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-20 20:28:52.255959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-20 20:28:52.256053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.256175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.256387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.256595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.256756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.256860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.257138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.257370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.257567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.257716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.257915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.258292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.258538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.258757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.258878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.258978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.259200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.259412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.259618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.259894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.259989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.260120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.260477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.260747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.260863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.260986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.261229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.261445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.261688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.261797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-20 20:28:52.261920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-20 20:28:52.262041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.262205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.262473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.262677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.262805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.262937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.263211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.263524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.263801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.263951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.264045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.264301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.264534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.264767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.264882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.264977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.265217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.265441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.265680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.265903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.265992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.266142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.266359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.266604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.266822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.266951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.267046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.267263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.267498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.267727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.267844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.267944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.268062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.268092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-20 20:28:52.268180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.268275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-20 20:28:52.268299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.268390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.268485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.268509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.268607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.268728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.268752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.268845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.268939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.268963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.269058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.269300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.269541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.269786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.269898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.269990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.270348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.270593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.270790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.270904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.271034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.271260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.271472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.271743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.271855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.271951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.272174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.272417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.272629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.272847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.272991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.273096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.273343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.273574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.273821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.273966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-20 20:28:52.274059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.274206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-20 20:28:52.274230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.274381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.274477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.274501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.274608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.274698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.274723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.274816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.274904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.274929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.275035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.275257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.275467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.275724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.275871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.275993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.276219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.276433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.276645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.276796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.276889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.277185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.277432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.277666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.277874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.277992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.278118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.278367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.278599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.278868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.278992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.279102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.279232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.279257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.279380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.279529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.279553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.279682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.279775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.279799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.279898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.280046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.280077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.280167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.280258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.280283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.280408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.280501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-20 20:28:52.280525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-20 20:28:52.280656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.280742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.280766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.280888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.280970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.280994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.281125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.281342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.281574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.281836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.281989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.282122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.282366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.282642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.282872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.282982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.283077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.283350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.283590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.283855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.283994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.284094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.284310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.284520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.284726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.284869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.284965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.285234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.285443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.285747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.285864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.285991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.286078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.286104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.286202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.286292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-20 20:28:52.286317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-20 20:28:52.286406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.286500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.286524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.286622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.286709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.286733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.286848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.286944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.286968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.287065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.287321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.287590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.287812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.287933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.288025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.288272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.288512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.288786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.288931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.289055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.289302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.289545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.289802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.289922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.290019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.290262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.290509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.290722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.290842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.290942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.291159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.291377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.291650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.291824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.291918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.292131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.292373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.292593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.292777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.292914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.293004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.293028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.293126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.293213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.293238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.293336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.293430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-20 20:28:52.293454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-20 20:28:52.293546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.293641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.293666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.293780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.293866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.293891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.293982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.294201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.294423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.294650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.294895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.294992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.295107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.295320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.295524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.295788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.295909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.296032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.296248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.296491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.296744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.296871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.296965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.297222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.297429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.297697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.297842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.297935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.298192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.298413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.298684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.298883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.298998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.299114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.299210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.299239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-20 20:28:52.299330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-20 20:28:52.299456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.299481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.299578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.299667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.299691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.299818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.299932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.299956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.300046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.300264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.300496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.300748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.300901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.301008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.301267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.301490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.301739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.301885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.301981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.302232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.302511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.302715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.302836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.302932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.303261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.303506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.303723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.303865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.303954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.304183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.304421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.304654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.304870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.304985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.305085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.305202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.305227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-20 20:28:52.305343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-20 20:28:52.305435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-20 20:28:52.305460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.305578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.305693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.305719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.305843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.305944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.305968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.306056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.306332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.306535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.306750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.306895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.306993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.307247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.307496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.307766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.307885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.308003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.308100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.308126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.308220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.308342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.631 [2024-11-20 20:28:52.308367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.631 qpair failed and we were unable to recover it. 00:27:47.631 [2024-11-20 20:28:52.308457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.308546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.308571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.308662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.308755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.308779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.308883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.309137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.309358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.309619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.309866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.309987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.310115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.310329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.310566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.310805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.310935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.311037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.311274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.311559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.311760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.311910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.312027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.312289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.312527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.312798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.312948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.313081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.313295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.313588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.313810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.313930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.314033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.314138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.314163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.314288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.314375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.314400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.314486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.314579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.632 [2024-11-20 20:28:52.314603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.632 qpair failed and we were unable to recover it. 00:27:47.632 [2024-11-20 20:28:52.314689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.314807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.314831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.314920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.315176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.315385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.315645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.315865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.315980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.316102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.316376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.316638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.316900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.316996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.317120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.317367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.317604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.317805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.317948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.318047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.318263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.318467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.318718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.318834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.318958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.319188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.319424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.319650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.319793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.319911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.320192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.320395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.320638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.633 qpair failed and we were unable to recover it. 00:27:47.633 [2024-11-20 20:28:52.320877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.633 [2024-11-20 20:28:52.320974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.320999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.321091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.321321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.321572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.321778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.321899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.322019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.322230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.322451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.322738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.322886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.323007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.323224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.323457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.323675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.323793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.323883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.324165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.324414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.324617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.324835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.324977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.325080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.325301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.325501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.325771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.634 [2024-11-20 20:28:52.325911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.634 qpair failed and we were unable to recover it. 00:27:47.634 [2024-11-20 20:28:52.326011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.326245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.326483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.326726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.326836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.326936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.327148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.327400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.327640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.327796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.327901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.328162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.328408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.328641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.328849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.328989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.329085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.329307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.329545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.329759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.329866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.329955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.330225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.330457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.330679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.330855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.330950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.331045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.331083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.331174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.331291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.331315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.635 [2024-11-20 20:28:52.331411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.331506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.635 [2024-11-20 20:28:52.331531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.635 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.331655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.331775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.331800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.331894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.331982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.332099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.332328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.332536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.332772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.332880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.332974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.333213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.333424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.333683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.333802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.333898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.334156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.334388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.334629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.334829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.334978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.335091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.335307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.335522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.335747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.335867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.636 qpair failed and we were unable to recover it. 00:27:47.636 [2024-11-20 20:28:52.335984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.636 [2024-11-20 20:28:52.336106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.336263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.336490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.336704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.336842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.336946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.337219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.337455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.337698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.337824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.337914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.338153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.338360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.338579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.338843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.338960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.339049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.339280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.339523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.339763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.339903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.339997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.340219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.340439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.340653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.340798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.340913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.341029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.341054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.341187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.341272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.341297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.341394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.341487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.637 [2024-11-20 20:28:52.341512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.637 qpair failed and we were unable to recover it. 00:27:47.637 [2024-11-20 20:28:52.341633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.341722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.341747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.341839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.341939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.341964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.342078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.342294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.342509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.342727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.342868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.342966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.343254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.343514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.343722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.343865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.343986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.344207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.344443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.344666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.344811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.344898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.345121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.345386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.345622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.345869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.345990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.346116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.346208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.346232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.346329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.346421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.346446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.638 qpair failed and we were unable to recover it. 00:27:47.638 [2024-11-20 20:28:52.346537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.638 [2024-11-20 20:28:52.346661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.346686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.346774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.346872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.346896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.346994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.347212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.347426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.347652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.347794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.347911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.348139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.348355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.348566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.348834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.348952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.349080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.349319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.349515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.349736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.349857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.349980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.350213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.350448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.350654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.350802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.350929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.351202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.351442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.351686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.639 [2024-11-20 20:28:52.351862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.639 qpair failed and we were unable to recover it. 00:27:47.639 [2024-11-20 20:28:52.351955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.352174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.352369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.352601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.352850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.352991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.353115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.353333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.353574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.353809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.353923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.354009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.354249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.354456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.354663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.354815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.354912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.355134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.355412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.355655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.355874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.355998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.356143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.356415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.356617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.356880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.356998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.640 [2024-11-20 20:28:52.357099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.357187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.640 [2024-11-20 20:28:52.357211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.640 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.357307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.357415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.357439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.357530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.357651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.357676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.357766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.357857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.357881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.357979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.358247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.358460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.358670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.358814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.358909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.359158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.359430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.359667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.359864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.359979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.360093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.360301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.360550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.360750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.360900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.360988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.361238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.361476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.361731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.361852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.361973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.362065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.362101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.641 qpair failed and we were unable to recover it. 00:27:47.641 [2024-11-20 20:28:52.362194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.641 [2024-11-20 20:28:52.362288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.362439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.362644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.362880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.362993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.363119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.363348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.363621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.363860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.363979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.364110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.364321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.364562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.364824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.364933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.365056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.365274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.365491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.365762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.365913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.366038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.366170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.366195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.366286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.366404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.642 [2024-11-20 20:28:52.366429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.642 qpair failed and we were unable to recover it. 00:27:47.642 [2024-11-20 20:28:52.366565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.366687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.366712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.366806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.366893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.366917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.367023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.367302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.367508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.367726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.367871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.367961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.368232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.368469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.368672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.368794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.368924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.369147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.369357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.369587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.369816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.369930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.370036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.370273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.370517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.370731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.370860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.370947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.371212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.371443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.643 qpair failed and we were unable to recover it. 00:27:47.643 [2024-11-20 20:28:52.371713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.643 [2024-11-20 20:28:52.371833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.371987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.372208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.372456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.372655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.372878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.372997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.373090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.373349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.373562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.373802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.373948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.374101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.374301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.374535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.374739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.374845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.374947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.375190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.375415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.375628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.375834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.375945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.376087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.376290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.376521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.376747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.376891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.376979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.377065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.377095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.644 qpair failed and we were unable to recover it. 00:27:47.644 [2024-11-20 20:28:52.377187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.644 [2024-11-20 20:28:52.377311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.377336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.377426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.377543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.377568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.377662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.377758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.377784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.377908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.377999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.378149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.378406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.378739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.378850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.378949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.379213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.379434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.379691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.379834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.379959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.380203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.380417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.380658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.380797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.380926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.381157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.381366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.381606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.381853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.381975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.382076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.382289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.382495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.382764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.382915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.645 qpair failed and we were unable to recover it. 00:27:47.645 [2024-11-20 20:28:52.383041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.383222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.645 [2024-11-20 20:28:52.383248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.383347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.383480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.383505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.383596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.383693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.383717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.383865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.383961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.383987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.384089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.384333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.384558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.384784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.384938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.385029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.385243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.385516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.385752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.385867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.385971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.386236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.386449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.386692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.386809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.386907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.387123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.387370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.387586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.387791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.387900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.387991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.388084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.388122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.388223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.388343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.388368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.388467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.388561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.646 [2024-11-20 20:28:52.388585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.646 qpair failed and we were unable to recover it. 00:27:47.646 [2024-11-20 20:28:52.388672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.388795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.388819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.388940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.389156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.389379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.389591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.389823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.389943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.390063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.390340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.390604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.390807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.390936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.391026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.391243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.391472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.391709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.391851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.391942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.392180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.392410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.392645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.392756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.392886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.393124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.393329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.393572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.647 qpair failed and we were unable to recover it. 00:27:47.647 [2024-11-20 20:28:52.393808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.647 [2024-11-20 20:28:52.393926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.394010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.394261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.394477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.394695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.394813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.394904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.395121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.395358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.395575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.395809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.395931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.396079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.396293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.396494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.396727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.396843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.396960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.397178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.397418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.397640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.397873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.397998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.398023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.398111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.398209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.648 [2024-11-20 20:28:52.398234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.648 qpair failed and we were unable to recover it. 00:27:47.648 [2024-11-20 20:28:52.398323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.398444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.398469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.398591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.398676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.398701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.398852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.398947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.398971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.399061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.399302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.399572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.399821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.399947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.400040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.400280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.400484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.400684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.400798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.400925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.401144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.401372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.401599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.401816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.401923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.402029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.402283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.402494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.402769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.402891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.402996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.403121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.403147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.403239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.403363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.403387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.649 [2024-11-20 20:28:52.403476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.403570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.649 [2024-11-20 20:28:52.403595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.649 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.403683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.403770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.403795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.403885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.404131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.404332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.404577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.404787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.404905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.404994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.405267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.405505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.405741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.405857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.405957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.406229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.406496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.406709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.406825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.406923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.407175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.407386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.407654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.407796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.407887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.408158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.408372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.408614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.650 [2024-11-20 20:28:52.408858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.650 [2024-11-20 20:28:52.408998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.650 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.409087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.409281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.409501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.409745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.409859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.409956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.410168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.410404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.410669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.410794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.410895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.411145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.411393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.411607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.411831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.411944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.412048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.412285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.412505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.412739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.412856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.412983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.413205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.413453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.651 [2024-11-20 20:28:52.413690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.651 [2024-11-20 20:28:52.413809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.651 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.413907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.414135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.414351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.414592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.414855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.414995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.415091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.415303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.415577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.415796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.415917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.416010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.416250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.416498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.416730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.416843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.416935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.417149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.417346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.417638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.417783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.417881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.418199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.418422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.418670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.418816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.418951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.419175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.419398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.652 qpair failed and we were unable to recover it. 00:27:47.652 [2024-11-20 20:28:52.419641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.652 [2024-11-20 20:28:52.419755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.419854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.419953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.419977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.420077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.420324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.420545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.420741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.420883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.421007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.421218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.421455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.421697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.421904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.421999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.422119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.422354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.422604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.422812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.422927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.423019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.423231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.423477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.423686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.423901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.423990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.424119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.424386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.424591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.424846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.424959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.653 [2024-11-20 20:28:52.425051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.425148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.653 [2024-11-20 20:28:52.425175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.653 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.425305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.425407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.425431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.425553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.425647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.425672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.425784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.425878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.425907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.426001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.426251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.426460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.426701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.426913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.426999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.427139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.427377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.427594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.427803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.427953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.428107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.428358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.428595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.428832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.428953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.429037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.429130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.429155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.429257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.429348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.654 [2024-11-20 20:28:52.429373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.654 qpair failed and we were unable to recover it. 00:27:47.654 [2024-11-20 20:28:52.429494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.429587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.429611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.429700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.429794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.429819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.429920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.430155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.430365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.430571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.430779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.430886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.430984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.431242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.431466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.431717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.431835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.431928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.432178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.432392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.432637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.432847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.432996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.433089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.433342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.433624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.433830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.433951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.434042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.434272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.434511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.655 qpair failed and we were unable to recover it. 00:27:47.655 [2024-11-20 20:28:52.434720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.655 [2024-11-20 20:28:52.434830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.434926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.435193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.435432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.435634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.435860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.435976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.436108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.436348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.436597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.436828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.436950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.437042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.437321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.437532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.437750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.437901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.437990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.438196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.438440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.438676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.438794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.438918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.439189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.439460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.439698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.439846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.439933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.440028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.440052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.440186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.440307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.440331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.656 [2024-11-20 20:28:52.440450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.440546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.656 [2024-11-20 20:28:52.440570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.656 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.440665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.440779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.440804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.440923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.441132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.441336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.441563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.441810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.441930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.442085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.442295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.442504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.442747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.442863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.442980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.443226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.443468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.443714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.443890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.443985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.444194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.444447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.444677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.444893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.444989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.445013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.445105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.445204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.445229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.445315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.445445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.657 [2024-11-20 20:28:52.445470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.657 qpair failed and we were unable to recover it. 00:27:47.657 [2024-11-20 20:28:52.445589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.445714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.445738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.445828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.445921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.445947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.446040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.446286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.446503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.446716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.446844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.446936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.447195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.447436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.447666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.447780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.447877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.448127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.448340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.448588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.448826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.448972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.449067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.449283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.449528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.449773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.449887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.449982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.450227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.450429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.450657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.450804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.450930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.451051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.658 [2024-11-20 20:28:52.451080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.658 qpair failed and we were unable to recover it. 00:27:47.658 [2024-11-20 20:28:52.451177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.451389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.451648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.451855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.451973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.452107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.452321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.452582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.452783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.452896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.452993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.453264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.453483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.453699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.453812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.453937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.454179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.454419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.454658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.454784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.454885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.455146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.455354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.455562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.659 qpair failed and we were unable to recover it. 00:27:47.659 [2024-11-20 20:28:52.455778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.659 [2024-11-20 20:28:52.455892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.455981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.456224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.456427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.456649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.456878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.456990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.457082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.457303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.457557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.457769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.457944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.458033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.458308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.458511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.458746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.458888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.458988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.459202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.459439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.459669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.459775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.459901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.460145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.460413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.460649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-20 20:28:52.460766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.660 [2024-11-20 20:28:52.460858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.460953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.460977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.461099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.461340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.461595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.461831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.461977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.462078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.462345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.462560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.462779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.462920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.463019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.463227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.463494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.463729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.463842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.463954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.464203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.464408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.464649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.464880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.464998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.465093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.465395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.465627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.465871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.465987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.466012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.466126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.466217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.466241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.466366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.466485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.466509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-20 20:28:52.466605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-20 20:28:52.466694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.466718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.466836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.466930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.466955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.467045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.467291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.467545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.467747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.467867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.467965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.468212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.468452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.468693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.468804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.468923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.469170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.469420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.469663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.469835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.469927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.470156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.470381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.470592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.470835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.470987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.471111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.471382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.471615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.471820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.471970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.472061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.472172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.472196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-20 20:28:52.472285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.472407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-20 20:28:52.472431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.472525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.472654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.472678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.472775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.472868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.472893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.472982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.473215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.473424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.473642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.473850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.473979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.474095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.474304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.474500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.474780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.474894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.474992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.475268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.475469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.475678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.475830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.475931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.476176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.476405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.476668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.476811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.476912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.477247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.477474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.477685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.477798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-20 20:28:52.477919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-20 20:28:52.478012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.478168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.478417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.478679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.478804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.478895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.479177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.479451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.479684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.479802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.479952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.480216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.480434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.480669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.480897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.480989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.481113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.481332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.481568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.481766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.481876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.481973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.482205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.482481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.482701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.482865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.482964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.483247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.483506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.483726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.483877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.483973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.484105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-20 20:28:52.484131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-20 20:28:52.484226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.484318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.484344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.484453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.484579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.484604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.484697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.484821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.484846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.484943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.485204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.485492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.485740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.485850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.485947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.486225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.486496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.486717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.486870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.486964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.487197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.487435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.487659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.487770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.487893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.488012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.488037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.488183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.488286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.488312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.488440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.488529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-20 20:28:52.488554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-20 20:28:52.488653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.488770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.488795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.488894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.488988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.489152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.489427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.489635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.489776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.489902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.490183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.490397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.490617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.490798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.490892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.491159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.491411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.491682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.491834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.491931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.492163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.492402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.492618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.492830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.492941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.493147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.493244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.493270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.493428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.493522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.493547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.493644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.493798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.493824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.493926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.494018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.494043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-20 20:28:52.494172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.494299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-20 20:28:52.494324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.494423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.494543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.494570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.494694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.494792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.494817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.494921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.495162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.495407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.495657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.495810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.495928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.496146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.496370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.496692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.496844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.496975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.497187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.497432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.497709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.497831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.497924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.498152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.498424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.498633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.498754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.498884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.499138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.499463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.499665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.499838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-20 20:28:52.499962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.500054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-20 20:28:52.500084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.500179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.500451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.500658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.500892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.500984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.501109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.501391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.501640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.501782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.501909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.502269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.502540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.502764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.502908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.503000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.503278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.503498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.503748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.503870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.503968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.504216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.504430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.504663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.504789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.504888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.505131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.505399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.505638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.505869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.505995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.506023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.506131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.506334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.506359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-20 20:28:52.506458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-20 20:28:52.506577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.506603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.506727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.506853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.506880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.506980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.507227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.507465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.507707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.507934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.508026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.508247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.508503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.508782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.508898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.509032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.509332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.509573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.509803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.509954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.510081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.510297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.510536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.510739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.510857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.510966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.511287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.511493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.511799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.511949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.512074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.512279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.512304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.512403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.512495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.512521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.512622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.512740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-20 20:28:52.512765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-20 20:28:52.512865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.512990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.513143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.513351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.513592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.513826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.513970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.514065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.514305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.514548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.514765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.514915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.515035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.515290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.515549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.515757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.515872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.516006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.516342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.516612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.516849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.516993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.517100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.517338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.517554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.517790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.517906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-20 20:28:52.518000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.518097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-20 20:28:52.518123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.518212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.518363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.518388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.518487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.518610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.518637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.518733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.518818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.518844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.518943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.519193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.519436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.519674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.519799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.519926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.520146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.520399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.520651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.520771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.520899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.521133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.521381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.521588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.521829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.521948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.522075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.522173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.522198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.522322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.522415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.522441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-20 20:28:52.522531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.522631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-20 20:28:52.522657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.522754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.522850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.522877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.522969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.523207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.523485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.523732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.523847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.523943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.524160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.524378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.524621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.524827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.524942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.525041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.525290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.525523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.525799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.525927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.526052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.526293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.526510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.526744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.526895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.526997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.527236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.527454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.527663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.527815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.527902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.528006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.528033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-20 20:28:52.528134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.528222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-20 20:28:52.528247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.528348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.528498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.528524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.528618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.528822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.528847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.528948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.529169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.529411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.529717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.529832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.529929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.530158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.530383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.530657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.530800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.530899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.531151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.531368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.531570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.531806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.531951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.532044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.532278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.532519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.532726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.532854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.532954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.533237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.533456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-20 20:28:52.533690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-20 20:28:52.533836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.533928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.534154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.534432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.534644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.534786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.534882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.535123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.535342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.535590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.535805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.535919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.536016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.536231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.536467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.536711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.536829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.536959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.537189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.537401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.537650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.537887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.537984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.538101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.538323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.538568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.538777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.538925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-20 20:28:52.539021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-20 20:28:52.539117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.539235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.539476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.539697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.539852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.539947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.540160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.540398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.540618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.540835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.540978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.541080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.541311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.541558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.541778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.541899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.541992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.542211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.542457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.542709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.542839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.542933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.543144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.543361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.543630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.543845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.543961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.544081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.544180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.544204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-20 20:28:52.544296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-20 20:28:52.544394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.544422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.544546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.544645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.544669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.544787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.544917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.544941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.545034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.545258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.545479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.545724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.545839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.545968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.546196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.546443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.546686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.546799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.546927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.547162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.547403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.547627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.547833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.547982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.548081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.548324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.548565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.548784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.548902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-20 20:28:52.549002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-20 20:28:52.549102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.549225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.549468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.549713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.549857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.549945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.550204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.550455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.550719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.550841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.550973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.551220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.551435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.551665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.551902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.551996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.552143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.552386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.552600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.552858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.552978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.553134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.553347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.553590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.553801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.553914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.554010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.554251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.554495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.554721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-20 20:28:52.554874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-20 20:28:52.554996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.555235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.555476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.555695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.555811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.555906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.556131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.556357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.556577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.556836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.556959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.557045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.557261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.557485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.557715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.557857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.557954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.558170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.558390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.558652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.558900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.558993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.559111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.559320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.559544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.559790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.559909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.560032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.560135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.560160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-20 20:28:52.560256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.560382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-20 20:28:52.560406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.560496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.560616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.560640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.560735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.560829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.560854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.560951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.561197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.561473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.561691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.561817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.561921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.562176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.562401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.562634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.562755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.562880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.563131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.563354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.563577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.563790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.563915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.564014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.564255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.564464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.564717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.564833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.564929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.565241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.565503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.565743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.565862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.565987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.566225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.566438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.566686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.566801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-20 20:28:52.566926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-20 20:28:52.567038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.567191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.567466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.567693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.567904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.567988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.568112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.568364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.568613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.568830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.568953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.569046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.569267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.569494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.569742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.569854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.569953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.570171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.570380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.570605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.570845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.570971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.571074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.571316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.571543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.571785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.571900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.571996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.572225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.572472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.572710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.572865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.572962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.573238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.573452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.573722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-20 20:28:52.573848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-20 20:28:52.573942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.574164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.574431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.574678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.574829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.574922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.575173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.575412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.575637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.575852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.575970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.576076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.576326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.576616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.576866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.576987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.577081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.577334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.577583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.577831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.577958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.578049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.578301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.578548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.578765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.578889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.579018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.579140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.579165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.579267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.579393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.579417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.579515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.579638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-20 20:28:52.579663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-20 20:28:52.579785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.579904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.579928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.580091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.580321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.580561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.580836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.580959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.581051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.581298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.581516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.581736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.581861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.581960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.582223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.582471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.582681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.582802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.582927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.583183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.583407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.583621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.583746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.583928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.584180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.584395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.584610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.584857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.584979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.585088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.585302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.585550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.585788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.585902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.586005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.586278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.586515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-20 20:28:52.586791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-20 20:28:52.586918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.587036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.587285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.587535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.587800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.587927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.588022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.588273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.588481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.588728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.588854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.588961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.589187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.589421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.589687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.589840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.589941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.590175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.590458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.590770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.590892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.590986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.591231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.591467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.591711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.591860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.591980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.592263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.592546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.592768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.592886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-20 20:28:52.592984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-20 20:28:52.593142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.593321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.593535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.593783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.593909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.594004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.594256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.594500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.594774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.594893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.594992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.595275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.595494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.595707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.595827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.595981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.596205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.596436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.596677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.596828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.596924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.597177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.597406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.597652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.597904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.597996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.598128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.598358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.598629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.598850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.598971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.599078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.599326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.599578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-20 20:28:52.599826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-20 20:28:52.599944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.600072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.600286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.600499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.600768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.600889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.600988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.601194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.601398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.601680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.601831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.601927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.602144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.602388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.602666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.602807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.602907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.603149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.603374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.603614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.603856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.603976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.604081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.604330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.604582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.604861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.604978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.605100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.605323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.605600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.605812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.605971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.606093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.606303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.606571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.606851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.606968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.607058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.607291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.607509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-20 20:28:52.607727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-20 20:28:52.607876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.607900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.608024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.608230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.608470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.608676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.608791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.608875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.609171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.609393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.609637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.609872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.609984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.610076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.610290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.610523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.610733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.610852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.610978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.611234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.611478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.611696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.611850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.611947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.612169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.612422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.612695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.612838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.612960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.613047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-20 20:28:52.613079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-20 20:28:52.613236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.613338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.613363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.613490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.613602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.613628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.613757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.613845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.613870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.613971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.614236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.614469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.614684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.614808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.614953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.615180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.615427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.615668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.615813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.615906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.616174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.616385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.616595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.616837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.616965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.617066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.617166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.617191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-20 20:28:52.617280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-20 20:28:52.617379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.617404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.617493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.617585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.617611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.617703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.617804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.617830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.617932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.618186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.618407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.618621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.618872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.618990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.619093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.619336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.619545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.619767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.619890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.619983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.620252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.620465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.620689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.620810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.620902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.621126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.621374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.621587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.621797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.621908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.621995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.622099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.622124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.622220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.622314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.622339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.622432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.622555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-20 20:28:52.622580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-20 20:28:52.622667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.622791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.622815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.622906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.622992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.623128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.623366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.623619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.623867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.623995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.624117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.624364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.624579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.624877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.624999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.625122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.625344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.625552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.625765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.625915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.626012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.626312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.626517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.626730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.626846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.626972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.627243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.627465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.627671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-20 20:28:52.627784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-20 20:28:52.627874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.628131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.628402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.628614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.628831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.628946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.629098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.629304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.629634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.629851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.629970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.630060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.630291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.630521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.630783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.630897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.630996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.631224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.631473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.631683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.631819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.631910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.632195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.632450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.632715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.632827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.632945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.633046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.633088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.633234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.633334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.633360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-20 20:28:52.633455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.633577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-20 20:28:52.633600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.633693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.633789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.633813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.633914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.634130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.634373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.634583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.634844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.634985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.635103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.635203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-20 20:28:52.635228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-20 20:28:52.635325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.635423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.635448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.635545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.635633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.635658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.635782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.635934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.635959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.636100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.636348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.636554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.636774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.636919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.637054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.637338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.637549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.637763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.637882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.637992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.638234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.638476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.638709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.638826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.638946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.639180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.639422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.639640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.639907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.639999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.640119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.640403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.977 [2024-11-20 20:28:52.640626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.977 [2024-11-20 20:28:52.640776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.977 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.640868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.640975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.641116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.641387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.641627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.641901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.641992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.642118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.642374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.642594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.642845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.642973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.643062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.643290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.643508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.643752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.643896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.643995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.644255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.644501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.644716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.644839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.644935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.645225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.645484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.978 qpair failed and we were unable to recover it. 00:27:47.978 [2024-11-20 20:28:52.645728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.978 [2024-11-20 20:28:52.645843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.645975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.646188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.646457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.646681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.646812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.646912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.647140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.647406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.647607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.647872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.647991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.648147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.648358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.648574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.648788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.648929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.649026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.649234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.649452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.649700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.649820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.649944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.650177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.650401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.650647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.650868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.650991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.979 [2024-11-20 20:28:52.651083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.651182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.979 [2024-11-20 20:28:52.651206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.979 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.651312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.651416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.651444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.651541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.651669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.651694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.651789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.651886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.651911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.652031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.652270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.652520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.652721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.652870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.652960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.653191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.653480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.653725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.653877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.654003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.654228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.654438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.654659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.654784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.654885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.655142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.655364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.655601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.655848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.655965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.656057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.656166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.656191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.656292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.656400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.656425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.980 qpair failed and we were unable to recover it. 00:27:47.980 [2024-11-20 20:28:52.656547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.980 [2024-11-20 20:28:52.656668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.656693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.656790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.656884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.656909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.657030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.657274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.657497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.657706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.657853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.657943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.658187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.658442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.658681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.658893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.658987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.659114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.659329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.659607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.659883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.659998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.660096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.660356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.660631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.660864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.660980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.661067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.661285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.661512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.661754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.661872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.661972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.662064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.662095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.981 qpair failed and we were unable to recover it. 00:27:47.981 [2024-11-20 20:28:52.662189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.981 [2024-11-20 20:28:52.662313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.662337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.662469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.662566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.662590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.662686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.662780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.662805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.662937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.663145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.663392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.663603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.663825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.663942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.664075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.664293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.664490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.664737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.664877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.664973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.665207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.665453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.665741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.665890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.665988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.666205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.666400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.666633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.982 [2024-11-20 20:28:52.666751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.982 qpair failed and we were unable to recover it. 00:27:47.982 [2024-11-20 20:28:52.666903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.667128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.667427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.667696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.667839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.667928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.668152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.668370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.668574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.668808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.668922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.669015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.669259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.669475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.669688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.669844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.669936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.670187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.670428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.670648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.670776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.670903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.671173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.671454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.671665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.671860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.671966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.672057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.672181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.672206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.672305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.672432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.672456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.672548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.672705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.983 [2024-11-20 20:28:52.672730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.983 qpair failed and we were unable to recover it. 00:27:47.983 [2024-11-20 20:28:52.672824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.672919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.672945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.673078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.673289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.673563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.673811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.673968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.674064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.674352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.674567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.674792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.674937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.675033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.675260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.675526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.675742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.675858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.675950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.676264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.676504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.676719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.676837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.676928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.677176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.677412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.677629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.677843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.677990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.678108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.678256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.984 [2024-11-20 20:28:52.678280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.984 qpair failed and we were unable to recover it. 00:27:47.984 [2024-11-20 20:28:52.678389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.678481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.678504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.678630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.678727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.678752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.678850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.678945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.678972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.679065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.679550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.679762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.679908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.679998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.680211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.680459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.680700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.680819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.680917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.681153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.681408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.681627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.681854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.681997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.682093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.682331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.682581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.682826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.682940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.683067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.683294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.683516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.985 qpair failed and we were unable to recover it. 00:27:47.985 [2024-11-20 20:28:52.683726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.985 [2024-11-20 20:28:52.683844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.683869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.683976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.684224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.684462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.684677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.684825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.684930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.685168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.685438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.685749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.685866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.685968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.686206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.686480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.686752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.686903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.687002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.687249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.687469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.687709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.687860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.687985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.688199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.688451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.688673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.688801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.688928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.689051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.689082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.689186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.689281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.986 [2024-11-20 20:28:52.689306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.986 qpair failed and we were unable to recover it. 00:27:47.986 [2024-11-20 20:28:52.689441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.689531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.689555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.689691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.689813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.689837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.689929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.690149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.690392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.690635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.690853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.690997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.691089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.691329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.691549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.691802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.691923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.692008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.692226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.692474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.692742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.692887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.692982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.693242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.693451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.693655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.693797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.693892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.694157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.694401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.987 [2024-11-20 20:28:52.694648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.987 [2024-11-20 20:28:52.694771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.987 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.694870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.695148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.695389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.695633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.695851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.695972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.696065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.696320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.696563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.696802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.696922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.697020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.697238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.697479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.697714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.697833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.697961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.698198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.698402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.698670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.698817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.698918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.699010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.699034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.988 qpair failed and we were unable to recover it. 00:27:47.988 [2024-11-20 20:28:52.699132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.988 [2024-11-20 20:28:52.699228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.699354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.699585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.699851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.699968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.700102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.700358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.700560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.700831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.700949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.701051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.701307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.701563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.701807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.701925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.702019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.702217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.702429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.702662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.702906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.702999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.703128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.703362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.703602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.703838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.703983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.704087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.704178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.704203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.704290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.704375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.989 [2024-11-20 20:28:52.704399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.989 qpair failed and we were unable to recover it. 00:27:47.989 [2024-11-20 20:28:52.704523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.704616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.704642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.704748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.704837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.704863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.704966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.705209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.705414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.705666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.705792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.705949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.706193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.706387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.706584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.706831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.706940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.707040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.707299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.707558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.707773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.707898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.707999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.708226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.708523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.708760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.708907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.709056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.709272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.709539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.709756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.709917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.710013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.710102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.710127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.710220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.710344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.710369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.990 qpair failed and we were unable to recover it. 00:27:47.990 [2024-11-20 20:28:52.710468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.990 [2024-11-20 20:28:52.710559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.710583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.710679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.710770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.710795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.710894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.711184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.711419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.711625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.711851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.711970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.712067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.712285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.712487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.712712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.712833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.712931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.713234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.713479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.713725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.713873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.713995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.714221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.714470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.714689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.714812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.714910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.715125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.715368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.715579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.715788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.715934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.716057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.716168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.716192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.991 [2024-11-20 20:28:52.716284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.716375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.991 [2024-11-20 20:28:52.716399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.991 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.716489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.716616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.716641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.716731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.716825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.716850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.716975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.717221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.717466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.717697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.717819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.717936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.718196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.718451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.718650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.718763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.718887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.719131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.719330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.719547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.719760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.719909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.720006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.720219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.720436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.720658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.720784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.720901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.721001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.721027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.721160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.721251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.721275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.992 qpair failed and we were unable to recover it. 00:27:47.992 [2024-11-20 20:28:52.721370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.992 [2024-11-20 20:28:52.721472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.721497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.721596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.721695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.721719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.721816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.721905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.721929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.722049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.722281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.722528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.722735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.722850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.722969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.723186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.723455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.723667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.723906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.723998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.724163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.724369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.724607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.724825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.724947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.725074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.725175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.725199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.725287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.725433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.725459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.725552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.725669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.993 [2024-11-20 20:28:52.725694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.993 qpair failed and we were unable to recover it. 00:27:47.993 [2024-11-20 20:28:52.725812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.725895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.725918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.726017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.726254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.726464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.726729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.726879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.726968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.727244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.727449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.727679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.727827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.727955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.728163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.728404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.728629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.728869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.728998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.729092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.729335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.729570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.729813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.729940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.730049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.730298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.730518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.730750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.730905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.731011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.731117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.731143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.994 qpair failed and we were unable to recover it. 00:27:47.994 [2024-11-20 20:28:52.731247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.731356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.994 [2024-11-20 20:28:52.731381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.731485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.731611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.731637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.731732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.731832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.731857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.731985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.732248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.732490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.732725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.732845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.732946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.733182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.733442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.733659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.733802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.733956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.734165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.734437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.734679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.734798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.734929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.735180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.735390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.735613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.735838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.735985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.736082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.736181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.736205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.736305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.736401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.736428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.995 qpair failed and we were unable to recover it. 00:27:47.995 [2024-11-20 20:28:52.736529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.995 [2024-11-20 20:28:52.736647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.736672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.736775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.736871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.736896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.736995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.737241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.737502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.737721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.737848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.737935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.738261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.738495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.738749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.738864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.738965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.739239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.739485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.739747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.739872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.739963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.740212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.740478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.740717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.740831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.740921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.741229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.741440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.741708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.741857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.741957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.742182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.742421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.996 qpair failed and we were unable to recover it. 00:27:47.996 [2024-11-20 20:28:52.742624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.996 [2024-11-20 20:28:52.742746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.742771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.742876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.742961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.742987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.743141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.743373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.743611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.743854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.743998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.744114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.744342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.744581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.744820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.744996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.745093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.745331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.745570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.745798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.745945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.746037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.746278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.746514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.746719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.746841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.746945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.747226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.747427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.747668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.747811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.747967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.748083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.748109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.748228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.748322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.748348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.748451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.748549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.997 [2024-11-20 20:28:52.748574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.997 qpair failed and we were unable to recover it. 00:27:47.997 [2024-11-20 20:28:52.748673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.748790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.748814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.748910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.749174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.749414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.749620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.749831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.749944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.750066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.750308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.750549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.750790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.750940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.751037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.751258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.751507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.751721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.751834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.751930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.752182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.752436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.752682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.752800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.752923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.753167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.753382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.753633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.753871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.753990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.754013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.998 [2024-11-20 20:28:52.754125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.754220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.998 [2024-11-20 20:28:52.754245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.998 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.754345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.754472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.754498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.754592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.754715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.754740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.754837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.754952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.754978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.755080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.755308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.755556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.755789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.755915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.756016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.756250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.756499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.756724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.756867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.756964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.757169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.757378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.757657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.757775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.757872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.758134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.758389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.758636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.758861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.758982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:47.999 qpair failed and we were unable to recover it. 00:27:47.999 [2024-11-20 20:28:52.759106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.999 [2024-11-20 20:28:52.759197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.759317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.759581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.759847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.759974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.760076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.760324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.760549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.760792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.760936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.761031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.761255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.761522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.761764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.761875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.761992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.762227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.762470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.762680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.762804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.762897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.763142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.763372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.763575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.763787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.763910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.764012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.764272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.764525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-20 20:28:52.764759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-20 20:28:52.764880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.764977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.765255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.765498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.765740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.765888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.765991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.766259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.766499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.766757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.766869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.766991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.767236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.767465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.767707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.767834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.767927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.768182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.768397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.768604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.768834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.768950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.769043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.769323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.769539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.769749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.769887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.769976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.770098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.770123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.770210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.770307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.770331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-20 20:28:52.770430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-20 20:28:52.770529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.770552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.770653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.770776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.770802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.770920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.771137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.771387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.771601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.771825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.771943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.772057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.772297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.772507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.772749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.772869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.773020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.773235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.773477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.773708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.773846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.773951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.774195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.774397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.774651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.774859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.774983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.775112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.775362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.775583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.775802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.775954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-20 20:28:52.776051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.776143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-20 20:28:52.776170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.776284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.776366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.776391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.776497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.776589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.776613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.776708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.776831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.776855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.776958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.777190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.777463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.777678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.777803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.777930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.778185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.778402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.778602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.778831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.778957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.779102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.779315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.779542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.779768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.779911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.780008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.780287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.780508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.780749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.780896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.780994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.781223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.781463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-20 20:28:52.781669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-20 20:28:52.781792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.781816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.781901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.781991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.782131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.782383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.782599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.782832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.782976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.783075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.783321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.783534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.783775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.783894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.783996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.784239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.784518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.784762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.784906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.784998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.785238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.785462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.785704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.785850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-20 20:28:52.785956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.786085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-20 20:28:52.786112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.786201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.786422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.786656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.786896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.786992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.787107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.787338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.787589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.787833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.787974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.788066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.788306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.788517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.788763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.788882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.788998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.789234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.789472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.789691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.789809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.789939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.790206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.790459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.790668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.790821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.790915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.791007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.791033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.791144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.791267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.791293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-20 20:28:52.791389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.791481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-20 20:28:52.791506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.791603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.791702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.791727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.791825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.791926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.791950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.792074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.792325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.792567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.792812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.792964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.793089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.793341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.793576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.793822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.793971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.794059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.794269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.794514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.794726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.794844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.794935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.795203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.795407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.795631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.795901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.795986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.796118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.796361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.796577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.796827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.796971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.797101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.797207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.797231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-20 20:28:52.797353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-20 20:28:52.797453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.797478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.797571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.797693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.797718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.797846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.797942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.797970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.798061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.798308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.798581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.798820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.798934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.799052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.799303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.799529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.799766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.799883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.799974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.800226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.800477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.800696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.800813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.800907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.801131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.801372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.801607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.801873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.801992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.802082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.802206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.802231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.802326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.802449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-20 20:28:52.802473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-20 20:28:52.802603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.802695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.802723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.802812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.802900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.802924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.803024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.803241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.803469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.803693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.803839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.803937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.804151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.804385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.804631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.804875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.804997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.805121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.805360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.805614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.805886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.805977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.806098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.806342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.806575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.806812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.806960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.807061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.807303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.807540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-20 20:28:52.807799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-20 20:28:52.807911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.808011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.808248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.808484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.808723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.808841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.808957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.809164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.809405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.809645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.809789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.809891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.810142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.810361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.810618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.810789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.810911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.811191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.811395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.811611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.811847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.811972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.812082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.812318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.812566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.812815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.812932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.813032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.813300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.813549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.813785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.813896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-20 20:28:52.813989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-20 20:28:52.814083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.814225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.814474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.814731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.814847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.814942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.815190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.815433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.815701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.815819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.815912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.816130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.816379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.816584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.816821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.816936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.817031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.817303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.817556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.817781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.817913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.818004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.818252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.818509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.818749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-20 20:28:52.818861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-20 20:28:52.818952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.819176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.819398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.819671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.819876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.819986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.820082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.820327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.820541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.820795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.820918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.821014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.821270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.821507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.821712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.821828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.821947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.822197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.822408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.822661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.822808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.822904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.823150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.823361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.823590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.823825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.823939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-20 20:28:52.824081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-20 20:28:52.824174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.824287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.824539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.824738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.824845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.824939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.825200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.825415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.825663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.825877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.825985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.826083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.826327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.826582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.826817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.826932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.827019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.827275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.827492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.827698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.827901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.827990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.828142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.828419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.828631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.828874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.828995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.829020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-20 20:28:52.829141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.829228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-20 20:28:52.829253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.829340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.829430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.829454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.829555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.829645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.829669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.829772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.829892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.829917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.830006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.830215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.830456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.830693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.830838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.830967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.831191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.831431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.831671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.831816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.831916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.832173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.832493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.832704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.832859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.832985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.833247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.833520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.833781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.833900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.833994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.834242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.834451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-20 20:28:52.834687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-20 20:28:52.834836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.834923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.835145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.835384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.835625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.835843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.835991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.836112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.836357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.836555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.836801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.836918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.837041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.837258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.837464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.837680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.837795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.837899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.838146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.838403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.838621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.838847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.838959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.839081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.839301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.839537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.839754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.839877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.840012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.840107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-20 20:28:52.840132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-20 20:28:52.840236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.840359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.840383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.840500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.840616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.840645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.840736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.840831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.840855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.840976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.841219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.841433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.841674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.841817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.841909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.842165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.842431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.842676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.842794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.842946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.843178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.843445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.843650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.843775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.843879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.844157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.844376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.844615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.844855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.844977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.845101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.845342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.845594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-20 20:28:52.845830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-20 20:28:52.845975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.846067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.846287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.846516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.846753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.846868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.846967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.847246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.847488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.847696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.847809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.847934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.848174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.848397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.848630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.848875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.848990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.849108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.849318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.849540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.849815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.849936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.850060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.850184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.850208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.850315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.850415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.850441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.850537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.850662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-20 20:28:52.850688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-20 20:28:52.850838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.850958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.850982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.851115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.851335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.851555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.851766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.851888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.852011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.852227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.852439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.852664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.852832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.852925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.853175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.853400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.853627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.853884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.853996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.854093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.854393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.854660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.854878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.854997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.855135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.855405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.855627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.855855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.855979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.856003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-20 20:28:52.856098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-20 20:28:52.856190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.856314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.856549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.856792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.856938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.857026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.857278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.857495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.857702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.857821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.857948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.858173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.858377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.858629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.858847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.858991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.859084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.859298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.859501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.859775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.859893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.859990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.860208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.860442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.860705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.860826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.860928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.861197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.861463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.861723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.861846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.862008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.862098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.862123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-20 20:28:52.862226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-20 20:28:52.862352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.862379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.862473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.862570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.862595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.862718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.862813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.862837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.862933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.863190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.863425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.863633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.863869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.863992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.864106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.864313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.864522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.864799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.864922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.865047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.865296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.865533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.865758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.865885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.865983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.866234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.866495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.866726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.866872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.866987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.867214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.867463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-20 20:28:52.867730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-20 20:28:52.867843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.867959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.868232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.868451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.868686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.868834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.868933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.869196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.869437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.869664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.869868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.869984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.870083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.870301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.870507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.870732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.870879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.870966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.871183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.871420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.871660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.871808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.871934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.872168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.872382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.872615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.872835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.872957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.873051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.873179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.873204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-20 20:28:52.873325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-20 20:28:52.873421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.873445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.873543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.873657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.873682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.873773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.873887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.873912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.874013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.874286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.874493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.874704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.874831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.874950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.875195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.875395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.875628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.875849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.875972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.876065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.876281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.876509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.876785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.876938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.877028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.877284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.877555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.877779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.877924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.878014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.878104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.878129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.878228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.878317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-20 20:28:52.878341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-20 20:28:52.878465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.878553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.878578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.878669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.878759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.878790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.878891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.878977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.879097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.879336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.879540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.879771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.879889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.879978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.880232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.880481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.880721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.880844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.880968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.881188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.881459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.881662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.881877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.881998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.882096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.882303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.882562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.882778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.882892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.883013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.883245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.883495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-20 20:28:52.883714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-20 20:28:52.883864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.883990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.884231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.884479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.884722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.884840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.884931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.885186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.885410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.885644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.885878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.885988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.886128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.886397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.886601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.886816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.886966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.887147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.887399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.887610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.887838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.887991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.888085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.888308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.888550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.888781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.888899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.888985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.889222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.889433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.889664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.889811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.889930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.890026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.890049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-20 20:28:52.890146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-20 20:28:52.890242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.890365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.890571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.890789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.890928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.891024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.891264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.891467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.891683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.891803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.891897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.892141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.892376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.892646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.892796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.892895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.893155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.893393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.893613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.893854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.893973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.894095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.894224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.894250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.894349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.894464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.894489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.894607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.894724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.894750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.894844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.895175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.895418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.895668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.895907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.895996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.896022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.896153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.896281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.896306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-20 20:28:52.896413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.896538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-20 20:28:52.896562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.896686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.896771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.896797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.896889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.896984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.897109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.897359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.897642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.897760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.897861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.898139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.898345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.898558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.898799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.898921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.899049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.899276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.899482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.899701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.899849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.899943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.900205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.900459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.900813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.900965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.901060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.901323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.901596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.901801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.901948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.902062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.902343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.902568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.902778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.902911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.903037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.903162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-20 20:28:52.903188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-20 20:28:52.903290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.903410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.903435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.903554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.903640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.903666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.903768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.903857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.903882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.904005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.904221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.904464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.904701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.904818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.904941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.905272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.905585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.905795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.905915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.906022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.906243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.906490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.906749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.906872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.906965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.907188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.907459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.907664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.907826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.907978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.908190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.908411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.908619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.908866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.908993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-20 20:28:52.909117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-20 20:28:52.909217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.909244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.909373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.909576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.909601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.909694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.909822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.909847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.909966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.910206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.910414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.910671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.910820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.910921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.911242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.911510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.911723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.911866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.911958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.912204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd824000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.912454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.912672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.912895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.912984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.913102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.913335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.913615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.913833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.913948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.914080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.914293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.914547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.914781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.914930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.915016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.915250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.915505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.915732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.915850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-20 20:28:52.915971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.916065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-20 20:28:52.916095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.916191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.916391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.916612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.916851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.916966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.917093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.917341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.917600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.917877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.917998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.918094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.918311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.918524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.918744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.918889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.918986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.919201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.919438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.919684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.919803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.919930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.920186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.920439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.920685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.920805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.920908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.921157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.921377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.921585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.921815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.921941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.922040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.922287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.922493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.922745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.922855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.922948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.923042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.923066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-20 20:28:52.923181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.923310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-20 20:28:52.923336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.923456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.923583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.923609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.923703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.923822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.923848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.923946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.924169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.924386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.924596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.924843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.924965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.925092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.925316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.925554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.925770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.925890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.925985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.926204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.926430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.926669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.926886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.926977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.927101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.927388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.927610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.927830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.927949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.928040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.928326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.928598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.928818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.928938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.929040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.929306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.929548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.929754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.929907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.930003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.930131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.930158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-20 20:28:52.930251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-20 20:28:52.930347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.930372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.930475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.930562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.930588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.930708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.930833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.930858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.930945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.931217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.931461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.931704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.931827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.931921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.932141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.932357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.932628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.932825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.932940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.933061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.933264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.933475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.933817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.933912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.934133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.934347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.934563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.934808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.934927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.935057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.935275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.935475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.935690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.935834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.935925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.936016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.936040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.936179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.936281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.936306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-20 20:28:52.936397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.936492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-20 20:28:52.936518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.936644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.936751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.936777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.936869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.936958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.936983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.937100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.937301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.937536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.937750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.937898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.938000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.938219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.938457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.938707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.938852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.938947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.939178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.939390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.939631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.939844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.939967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.940072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.940172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.940198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.940292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.940386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.940412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.940501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.940617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-20 20:28:52.940641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-20 20:28:52.940730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.940821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.940846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.940956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.941196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.941427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.941670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.941874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.941994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.942091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.942378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.942653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.942895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.942994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.943113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.943330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.943544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.943821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.943939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.944027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.944233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.944460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.944670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.944792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.944887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.945145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.945351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-20 20:28:52.945655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-20 20:28:52.945772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.945867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.945963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.945990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.946083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.946290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.946524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.946736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.946847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.946941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.947176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.947389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.947638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.947888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.947999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.948092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.948313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.948557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.948800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.948941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.949029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.949268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.949479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.949759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.949907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.950002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.950262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.950523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.950758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.950878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.951013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.951226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.951469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.951713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.951827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.951955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.952051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.952083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-20 20:28:52.952209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.952308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-20 20:28:52.952335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.952459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.952549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.952578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.952705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.952793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.952817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.952944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.953183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.953398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.953664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.953810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.953935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.954158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.954373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.954643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.954897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.954995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.955123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.955334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.955605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.955857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.955971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.956098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.956343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.956580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.956824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.956936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.957038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.957280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.957487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.957689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.957807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.957932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.958216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.958421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.958629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.958865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.958987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-20 20:28:52.959089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-20 20:28:52.959214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.959331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.959573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.959794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.959916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.960007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.960291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.960537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.960767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.960918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.961016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.961252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.961489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.961758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.961883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.961978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.962230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.962479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.962686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.962803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.962923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.963162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.963414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.963680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.963793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.963888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.964133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.964378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.964596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.964850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.964964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.965067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.965372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.965612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-20 20:28:52.965830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-20 20:28:52.965945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.966065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.966298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.966518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.966734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.966849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.966951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.967232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.967517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.967770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.967918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.968015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.968233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.968446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.968656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.968869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.969115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.969346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.969596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.969749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.969875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.970153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.970363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.970582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.970846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.970966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.971051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.971160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.971187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.971314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.971414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.971439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-20 20:28:52.971542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-20 20:28:52.971674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.971699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.971825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.971920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.971945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.972043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.972301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.972520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.972758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.972897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.972981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.973230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.973471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.973729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.973854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.973940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.974168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.974385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.974677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.974805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.974928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.975163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.975376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.975589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.975807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.975929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.976023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.976289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.976513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.976784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.976925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.977019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.977273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.977545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.977762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.977884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.977982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.978079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.978105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-20 20:28:52.978202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.978289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-20 20:28:52.978313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.978410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.978501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.978525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.978658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.978745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.978770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.978895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.978989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.979142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.979359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.979600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.979808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.979924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.980043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.980278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.980571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.980816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.980948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.981048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.981308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.981558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.981788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.981908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.982021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.982239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.982470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.982704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.982911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.982998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.983144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd830000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.983448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.983686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.983825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.983917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.984194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.984443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.984693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.984882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.985007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.985113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.985139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-20 20:28:52.985232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-20 20:28:52.985319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.985344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.985435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.985528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.985554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.985640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.985758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.985784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.985896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.986201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.986476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.986718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.986859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.986952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.987211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.987446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.987739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.987866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-20 20:28:52.987963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.988094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-20 20:28:52.988120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.308 [2024-11-20 20:28:52.988219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.988306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.988332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.988459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.988558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.988585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.988791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.988892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.988924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.989016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.989248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.989465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.989796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.989945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.990044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.990304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.990526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.990749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.990861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.990987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.991231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.991458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.991709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.991830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.991921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.992172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.992432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.992654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.992778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.992889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.993170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.993390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.993662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.993781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.993907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.994147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.994361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.994575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.994850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.994966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.309 qpair failed and we were unable to recover it. 00:27:48.309 [2024-11-20 20:28:52.995061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.309 [2024-11-20 20:28:52.995167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.995318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.995557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.995777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.995911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.996000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.996247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.996511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.996713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.996844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.996936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.997186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.997402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.997647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.997848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.997962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.998078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.998290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.998508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.998719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.998836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.998939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.999177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.999380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.999613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:52.999817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:52.999934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.000026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.000244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.000487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.000750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.000880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.000977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.001081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.001108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.001208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.001299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.001324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.310 qpair failed and we were unable to recover it. 00:27:48.310 [2024-11-20 20:28:53.001434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.001531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.310 [2024-11-20 20:28:53.001555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.001645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.001737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.001761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.001881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.001982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.002104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.002327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.002546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.002849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.002959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.003059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.003299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.003515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.003724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.003869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.003969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.004190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.004449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.004671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.004810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.004902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.005166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.005419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.005654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.005865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.005975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.006082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.006296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.006544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.006773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.006916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.007046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.007290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.007498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.007732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.007871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.007970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.008091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.008117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.311 qpair failed and we were unable to recover it. 00:27:48.311 [2024-11-20 20:28:53.008213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.311 [2024-11-20 20:28:53.008308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.008333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.008454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.008548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.008573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.008663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.008758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.008784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.008884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.009158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.009372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.009576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.009795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.009914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.010008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.010105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.010130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.010238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.010335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.010359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 20:28:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:48.312 [2024-11-20 20:28:53.010462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 20:28:53 -- common/autotest_common.sh@862 -- # return 0 00:27:48.312 [2024-11-20 20:28:53.010561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.010585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 20:28:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:48.312 [2024-11-20 20:28:53.010711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 20:28:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:48.312 [2024-11-20 20:28:53.010808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.010833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.312 [2024-11-20 20:28:53.010933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.011175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.011422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.011666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.011781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.011908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.012128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.012344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.012584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.012822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.012948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.013043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.013308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.013579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.013822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.013974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.014064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.014330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.014535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.312 qpair failed and we were unable to recover it. 00:27:48.312 [2024-11-20 20:28:53.014823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.312 [2024-11-20 20:28:53.014917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.014947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.015048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.015335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.015552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.015775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.015894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.015988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.016234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.016492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.016757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.016917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.017054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.017280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.017513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.017753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.017898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.018000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.018216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.018455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.018692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.018839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.018941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.019186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.019400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.019611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.019897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.019991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.020016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.020121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.020211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.020235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.313 qpair failed and we were unable to recover it. 00:27:48.313 [2024-11-20 20:28:53.020341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.020437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.313 [2024-11-20 20:28:53.020462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.020552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.020636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.020661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.020759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.020884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.020909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.021029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.021293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.021511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.021813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.021932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.022027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.022317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.022540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.022772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.022891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.023007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.023230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.023512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.023737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.023855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.023980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.024210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.024457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.024659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.024910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.024998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.025164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.025406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.025625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.025867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.025986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.026133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.026358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.026584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.026823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.026966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.027060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.027158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.314 [2024-11-20 20:28:53.027188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.314 qpair failed and we were unable to recover it. 00:27:48.314 [2024-11-20 20:28:53.027287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.027371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.027396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.027500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.027582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.027607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.027701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.027800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.027825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.027946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.028175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.028393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.028598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.028838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.028962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.029058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.029281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.029519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.029751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.029898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.030028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.030262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 20:28:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:48.315 [2024-11-20 20:28:53.030483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 20:28:53 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:48.315 [2024-11-20 20:28:53.030695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 20:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.315 [2024-11-20 20:28:53.030791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.030816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.315 [2024-11-20 20:28:53.030925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.031176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.031448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.031648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.031763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.031879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.032160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.032404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.032614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.032842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.032992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.033119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.033334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.315 [2024-11-20 20:28:53.033634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.315 [2024-11-20 20:28:53.033788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.315 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.033875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.034137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.034382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.034607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.034845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.034990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.035139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.035392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.035613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.035824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.035939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.036038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.036340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.036545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.036767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.036912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.037018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.037236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.037525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.037769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.037907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.038034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.038270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.038513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.038730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.038847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.038968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.039182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.039403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.039676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.039799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.039936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.040035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.040060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.040156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.040283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.316 [2024-11-20 20:28:53.040307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.316 qpair failed and we were unable to recover it. 00:27:48.316 [2024-11-20 20:28:53.040442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.040529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.040554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.040648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.040743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.040768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.040864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.040984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.041109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.041392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.041638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.041756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.041882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.042157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.042400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.042624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.042772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.042891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.043159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.043409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.043618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.043867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.043989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.044123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.044335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.044579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.044849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.044959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.045055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.045315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.045557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.045773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.045918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.046045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.046264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.046516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.046734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.046854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.046974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.047079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.047105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.317 [2024-11-20 20:28:53.047207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.047300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.317 [2024-11-20 20:28:53.047325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.317 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.047454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.047552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.047576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.047675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.047765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.047789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.047888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.047986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.048115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.048365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.048632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.048868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.048991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.049127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.049348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.049622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.049771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.049883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.050178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.050445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.050689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.050829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.050956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.051199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.051463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.051722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.051858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.051958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.052194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.052435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.052640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.052900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.052990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.053015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.053146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 Malloc0 00:27:48.318 [2024-11-20 20:28:53.053253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.053277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.318 qpair failed and we were unable to recover it. 00:27:48.318 [2024-11-20 20:28:53.053376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.053500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.318 [2024-11-20 20:28:53.053524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 20:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.319 [2024-11-20 20:28:53.053621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.053717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.053742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 20:28:53 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.053861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 20:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.319 [2024-11-20 20:28:53.053959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.053984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.319 [2024-11-20 20:28:53.054093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.054327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.054549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.054793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.054916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.055039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.055295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.055510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.055718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.055841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.055966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.056224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.056478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.056743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056830] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:48.319 [2024-11-20 20:28:53.056872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.056897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.057023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.057244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.057493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.057706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.057868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.057994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.058210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.058455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.058685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.058841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.058978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.059200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.059435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.059668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.059889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.059980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.060004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.319 qpair failed and we were unable to recover it. 00:27:48.319 [2024-11-20 20:28:53.060136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.319 [2024-11-20 20:28:53.060237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.060261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.060388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.060480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.060505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.060663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.060758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.060783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.060907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.061196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.061417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.061669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.061827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.061917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.062193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.062419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.062689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.062839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.062934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.063189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.063400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.063669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.063793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.063920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.064177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.064420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.064661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.064891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.064983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 20:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.320 [2024-11-20 20:28:53.065106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 20:28:53 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:48.320 [2024-11-20 20:28:53.065235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.065333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 20:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.320 [2024-11-20 20:28:53.065461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.065584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.065856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.065970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.066101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.066366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.066616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.066862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.066984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.320 qpair failed and we were unable to recover it. 00:27:48.320 [2024-11-20 20:28:53.067111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.320 [2024-11-20 20:28:53.067207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.067329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.067556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.067799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.067926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.068016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.068247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.068477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.068737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.068855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.068958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.069192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.069424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.069629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.069794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.069940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.070178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.070410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.070669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.070894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.070994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.071122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.071336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.071608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.071726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.071855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.072151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.072458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.072708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.072827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.072932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.073058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.073093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 20:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.321 [2024-11-20 20:28:53.073196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 20:28:53 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:48.321 [2024-11-20 20:28:53.073286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.073312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 20:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.321 [2024-11-20 20:28:53.073458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.321 [2024-11-20 20:28:53.073550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.073576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.073670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.073813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.321 [2024-11-20 20:28:53.073839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.321 qpair failed and we were unable to recover it. 00:27:48.321 [2024-11-20 20:28:53.073939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.074184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.074410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.074661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.074864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.074990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.075221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.075478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.075707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.075825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.075931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.076229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.076442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.076659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.076810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.076910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.077166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.077444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.077667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.077820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.077915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.078195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.078421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.078692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.078810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.078931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.079211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.079441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.079720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.079846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.322 [2024-11-20 20:28:53.079968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.080099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.322 [2024-11-20 20:28:53.080135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.322 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.080341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.080475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.080501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.080606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.080710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.080736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.080830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.080957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.080983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.081093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 20:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.323 [2024-11-20 20:28:53.081191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.081217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 20:28:53 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:48.323 [2024-11-20 20:28:53.081310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 20:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.323 [2024-11-20 20:28:53.081430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.081455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.081551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.323 [2024-11-20 20:28:53.081677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.081703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.081793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.081895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.081920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.082026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.082289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.082550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.082795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.082916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.083013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.083235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.083491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.083753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.083902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd828000b90 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.084007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.084237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.084488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.084792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.084902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad0cb0 with addr=10.0.0.2, port=4420 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.085029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.323 [2024-11-20 20:28:53.085148] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:48.323 [2024-11-20 20:28:53.087842] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:27:48.323 [2024-11-20 20:28:53.087917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ad0cb0 (107): Transport endpoint is not connected 00:27:48.323 [2024-11-20 20:28:53.088000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 20:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.323 20:28:53 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:48.323 20:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.323 20:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:48.323 20:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.323 20:28:53 -- host/target_disconnect.sh@58 -- # wait 3280904 00:27:48.323 [2024-11-20 20:28:53.097488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.323 [2024-11-20 20:28:53.097621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.323 [2024-11-20 20:28:53.097654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.323 [2024-11-20 20:28:53.097670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.323 [2024-11-20 20:28:53.097682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.323 [2024-11-20 20:28:53.097712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.107440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.323 [2024-11-20 20:28:53.107548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.323 [2024-11-20 20:28:53.107575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.323 [2024-11-20 20:28:53.107589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.323 [2024-11-20 20:28:53.107602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.323 [2024-11-20 20:28:53.107630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.323 qpair failed and we were unable to recover it. 00:27:48.323 [2024-11-20 20:28:53.117435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.323 [2024-11-20 20:28:53.117545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.323 [2024-11-20 20:28:53.117571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.323 [2024-11-20 20:28:53.117585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.323 [2024-11-20 20:28:53.117598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.117626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.127376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.127481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.127506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.127520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.127533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.127561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.137462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.137574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.137598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.137612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.137625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.137659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.147438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.147541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.147566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.147580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.147593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.147621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.157463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.157568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.157592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.157607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.157620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.157648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.167646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.167762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.167787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.167801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.167813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.167841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.177540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.177646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.177671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.177686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.177698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.177727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.187617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.187738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.187769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.187784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.187796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.187824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.197656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.197761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.197786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.197800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.197813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.197840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.207626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.207723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.207748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.207762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.207774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.207802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.217756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.217850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.217876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.217890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.217902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.217930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.227655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.227759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.227784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.227798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.227816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.227845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.237698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.237802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.237828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.237841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.237853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.237881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.247705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.324 [2024-11-20 20:28:53.247806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.324 [2024-11-20 20:28:53.247832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.324 [2024-11-20 20:28:53.247846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.324 [2024-11-20 20:28:53.247858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.324 [2024-11-20 20:28:53.247886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.324 qpair failed and we were unable to recover it. 00:27:48.324 [2024-11-20 20:28:53.257740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.257891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.257917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.257931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.257944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.257972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.267852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.267951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.267976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.267991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.268003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.268031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.277809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.277922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.277950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.277965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.277978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.278007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.287825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.287930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.287956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.287970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.287983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.288011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.297842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.297946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.297971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.297985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.297997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.298025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.307894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.308014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.308040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.308054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.308066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.308102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.317908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.318013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.318037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.318051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.318079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.318111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.325 [2024-11-20 20:28:53.327950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.325 [2024-11-20 20:28:53.328055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.325 [2024-11-20 20:28:53.328087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.325 [2024-11-20 20:28:53.328102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.325 [2024-11-20 20:28:53.328115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.325 [2024-11-20 20:28:53.328142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.325 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-20 20:28:53.338048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.585 [2024-11-20 20:28:53.338192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.585 [2024-11-20 20:28:53.338219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.585 [2024-11-20 20:28:53.338234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.585 [2024-11-20 20:28:53.338247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.585 [2024-11-20 20:28:53.338276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-20 20:28:53.347995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.585 [2024-11-20 20:28:53.348105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.585 [2024-11-20 20:28:53.348131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.585 [2024-11-20 20:28:53.348145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.585 [2024-11-20 20:28:53.348158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.585 [2024-11-20 20:28:53.348187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-20 20:28:53.358037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.585 [2024-11-20 20:28:53.358154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.585 [2024-11-20 20:28:53.358179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.585 [2024-11-20 20:28:53.358192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.585 [2024-11-20 20:28:53.358205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.585 [2024-11-20 20:28:53.358233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-20 20:28:53.368076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.585 [2024-11-20 20:28:53.368219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.585 [2024-11-20 20:28:53.368244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.585 [2024-11-20 20:28:53.368259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.585 [2024-11-20 20:28:53.368272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.585 [2024-11-20 20:28:53.368300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-20 20:28:53.378111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.585 [2024-11-20 20:28:53.378207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.585 [2024-11-20 20:28:53.378233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.585 [2024-11-20 20:28:53.378248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.585 [2024-11-20 20:28:53.378261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.585 [2024-11-20 20:28:53.378289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.388141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.388233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.388259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.388273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.388285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.388314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.398159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.398266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.398291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.398305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.398318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.398346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.408208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.408325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.408350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.408364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.408382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.408411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.418263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.418359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.418384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.418397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.418410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.418438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.428229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.428319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.428344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.428358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.428370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.428398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.438293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.438405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.438430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.438444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.438457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.438485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.448286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.448391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.448416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.448430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.448443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.448471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.458317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.458421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.458446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.458460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.458472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.458501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.468440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.468572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.468597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.468611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.468624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.468652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.478395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.478496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.478521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.478535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.478548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.478575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.488436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.488559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.488584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.488598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.488610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.488639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.498469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.498572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.498597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.498611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.498629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.498658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.508539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.586 [2024-11-20 20:28:53.508640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.586 [2024-11-20 20:28:53.508666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.586 [2024-11-20 20:28:53.508680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.586 [2024-11-20 20:28:53.508693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.586 [2024-11-20 20:28:53.508720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-20 20:28:53.518485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.518601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.518626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.518640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.518653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.518681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.528502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.528596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.528622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.528636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.528648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.528675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.538569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.538669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.538694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.538708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.538720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.538748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.548608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.548707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.548732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.548747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.548759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.548787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.558689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.558794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.558818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.558832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.558844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.558875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.568674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.568774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.568798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.568812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.568824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.568852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.578742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.578885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.578910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.578925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.578937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.578965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.588694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.588790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.588815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.588836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.588850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.588878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.598775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.598888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.598912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.598927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.598939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.598967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.608778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.608881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.608907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.608921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.608934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.608961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-20 20:28:53.618802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.587 [2024-11-20 20:28:53.618904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.587 [2024-11-20 20:28:53.618930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.587 [2024-11-20 20:28:53.618944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.587 [2024-11-20 20:28:53.618956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.587 [2024-11-20 20:28:53.618986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.628834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.628934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.628960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.628974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.628987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.629015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.638889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.638997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.639022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.639036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.639048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.639083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.648888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.649024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.649050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.649064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.649084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.649113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.658929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.659024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.659049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.659063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.659085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.659113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.668926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.669025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.669049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.669063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.669086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.669115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.678971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.679123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.679148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.679169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.679183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.679210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.689051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.847 [2024-11-20 20:28:53.689160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.847 [2024-11-20 20:28:53.689186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.847 [2024-11-20 20:28:53.689200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.847 [2024-11-20 20:28:53.689212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.847 [2024-11-20 20:28:53.689241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.847 qpair failed and we were unable to recover it. 00:27:48.847 [2024-11-20 20:28:53.699025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.699133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.699159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.699173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.699186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.699214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.709062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.709166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.709191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.709205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.709218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.709245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.719106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.719215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.719240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.719254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.719266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.719294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.729145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.729258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.729283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.729297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.729309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.729337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.739175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.739273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.739298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.739312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.739324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.739352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.749182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.749299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.749324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.749338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.749350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.749380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.759240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.759361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.759386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.759400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.759413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.759441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.769257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.769361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.769386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.769406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.769420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.769448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.779319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.779425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.779452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.779466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.779483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.779513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.789315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.789414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.789440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.789454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.789467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.789496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.799370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.799485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.799510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.799524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.799537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.799566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.809393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.809494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.809518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.809532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.809547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.809577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.819363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.819508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.819534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.819548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.848 [2024-11-20 20:28:53.819560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.848 [2024-11-20 20:28:53.819588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.848 qpair failed and we were unable to recover it. 00:27:48.848 [2024-11-20 20:28:53.829413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.848 [2024-11-20 20:28:53.829514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.848 [2024-11-20 20:28:53.829539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.848 [2024-11-20 20:28:53.829553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.849 [2024-11-20 20:28:53.829566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.849 [2024-11-20 20:28:53.829594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.849 qpair failed and we were unable to recover it. 00:27:48.849 [2024-11-20 20:28:53.839491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.849 [2024-11-20 20:28:53.839597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.849 [2024-11-20 20:28:53.839621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.849 [2024-11-20 20:28:53.839635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.849 [2024-11-20 20:28:53.839647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.849 [2024-11-20 20:28:53.839675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.849 qpair failed and we were unable to recover it. 00:27:48.849 [2024-11-20 20:28:53.849451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.849 [2024-11-20 20:28:53.849546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.849 [2024-11-20 20:28:53.849571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.849 [2024-11-20 20:28:53.849585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.849 [2024-11-20 20:28:53.849597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.849 [2024-11-20 20:28:53.849627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.849 qpair failed and we were unable to recover it. 00:27:48.849 [2024-11-20 20:28:53.859514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.849 [2024-11-20 20:28:53.859627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.849 [2024-11-20 20:28:53.859653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.849 [2024-11-20 20:28:53.859676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.849 [2024-11-20 20:28:53.859689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.849 [2024-11-20 20:28:53.859718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.849 qpair failed and we were unable to recover it. 00:27:48.849 [2024-11-20 20:28:53.869508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.849 [2024-11-20 20:28:53.869614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.849 [2024-11-20 20:28:53.869639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.849 [2024-11-20 20:28:53.869653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.849 [2024-11-20 20:28:53.869666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.849 [2024-11-20 20:28:53.869693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.849 qpair failed and we were unable to recover it. 00:27:48.849 [2024-11-20 20:28:53.879590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.849 [2024-11-20 20:28:53.879699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.849 [2024-11-20 20:28:53.879725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.849 [2024-11-20 20:28:53.879738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.849 [2024-11-20 20:28:53.879751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:48.849 [2024-11-20 20:28:53.879779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.849 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-20 20:28:53.889619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.108 [2024-11-20 20:28:53.889747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.108 [2024-11-20 20:28:53.889773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.108 [2024-11-20 20:28:53.889787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.108 [2024-11-20 20:28:53.889799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.108 [2024-11-20 20:28:53.889827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-20 20:28:53.899637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.108 [2024-11-20 20:28:53.899739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.108 [2024-11-20 20:28:53.899765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.108 [2024-11-20 20:28:53.899779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.899792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.899820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.909662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.909791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.909816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.909830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.909843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.909870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.919679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.919809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.919833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.919847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.919860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.919888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.929740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.929870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.929894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.929908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.929920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.929948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.939742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.939858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.939883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.939897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.939908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.939936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.949770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.949909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.949941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.949957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.949973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.950004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.959813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.959921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.959946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.959960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.959973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.960001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.969830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.969932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.969957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.969971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.969984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.970011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.979874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.979981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.980006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.980020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.980033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.980060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.989857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:53.989955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:53.989980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:53.989994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:53.990006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:53.990036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:53.999929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:54.000037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:54.000062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:54.000085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:54.000099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:54.000127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:54.009966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:54.010075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:54.010101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:54.010115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:54.010127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:54.010155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:54.020091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:54.020223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:54.020251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:54.020266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:54.020279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:54.020308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-20 20:28:54.029991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.109 [2024-11-20 20:28:54.030095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.109 [2024-11-20 20:28:54.030121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.109 [2024-11-20 20:28:54.030135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.109 [2024-11-20 20:28:54.030147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.109 [2024-11-20 20:28:54.030176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.040085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.040184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.040214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.040230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.040242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.040271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.050047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.050155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.050181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.050195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.050207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.050236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.060105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.060203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.060227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.060241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.060253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.060280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.070136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.070229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.070254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.070268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.070280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.070308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.080156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.080260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.080286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.080300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.080312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.080346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.090185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.090287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.090312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.090326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.090338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.090367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.100220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.100321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.100347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.100360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.100373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.100401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.110242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.110346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.110371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.110385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.110398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.110426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.120341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.120453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.120479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.120493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.120506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.120535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.130294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.130408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.130438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.130454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.130466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.130495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-20 20:28:54.140366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.110 [2024-11-20 20:28:54.140481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.110 [2024-11-20 20:28:54.140506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.110 [2024-11-20 20:28:54.140520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.110 [2024-11-20 20:28:54.140532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.110 [2024-11-20 20:28:54.140560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.150365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.150470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.150495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.150509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.150522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.150550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.160391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.160497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.160522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.160536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.160549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.160576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.170422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.170528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.170553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.170567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.170580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.170614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.180434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.180537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.180563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.180577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.180589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.180617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.190498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.190595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.190620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.190634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.190646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.190675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.200554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.200688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.200714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.200728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.200742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.200769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.210525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.210639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.210664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.210677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.210690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.210719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.220618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.220754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.220787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.220803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.220816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.220844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.230668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.230775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.230800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.372 [2024-11-20 20:28:54.230814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.372 [2024-11-20 20:28:54.230827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.372 [2024-11-20 20:28:54.230855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.372 qpair failed and we were unable to recover it. 00:27:49.372 [2024-11-20 20:28:54.240648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.372 [2024-11-20 20:28:54.240761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.372 [2024-11-20 20:28:54.240787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.240801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.240813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.240842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.250720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.250822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.250847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.250861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.250873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.250903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.260700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.260798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.260824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.260838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.260850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.260884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.270724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.270826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.270855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.270870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.270883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.270911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.280772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.280911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.280937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.280951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.280963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.280992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.290779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.290884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.290909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.290923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.290935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.290963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.300823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.300919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.300944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.300958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.300971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.300999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.310821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.310942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.310972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.310987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.311000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.311028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.320861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.320966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.320995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.321009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.321022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.321051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.330970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.331090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.331117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.331133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.331149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.331181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.340909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.341020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.341046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.341060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.341081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.341111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.350970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.351077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.351102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.351117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.351129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.351163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.360970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.361083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.361108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.361122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.373 [2024-11-20 20:28:54.361133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.373 [2024-11-20 20:28:54.361162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.373 qpair failed and we were unable to recover it. 00:27:49.373 [2024-11-20 20:28:54.370998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.373 [2024-11-20 20:28:54.371108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.373 [2024-11-20 20:28:54.371133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.373 [2024-11-20 20:28:54.371147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.374 [2024-11-20 20:28:54.371160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.374 [2024-11-20 20:28:54.371190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.374 qpair failed and we were unable to recover it. 00:27:49.374 [2024-11-20 20:28:54.381009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.374 [2024-11-20 20:28:54.381103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.374 [2024-11-20 20:28:54.381128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.374 [2024-11-20 20:28:54.381143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.374 [2024-11-20 20:28:54.381156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.374 [2024-11-20 20:28:54.381183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.374 qpair failed and we were unable to recover it. 00:27:49.374 [2024-11-20 20:28:54.391105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.374 [2024-11-20 20:28:54.391205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.374 [2024-11-20 20:28:54.391229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.374 [2024-11-20 20:28:54.391244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.374 [2024-11-20 20:28:54.391256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.374 [2024-11-20 20:28:54.391284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.374 qpair failed and we were unable to recover it. 00:27:49.374 [2024-11-20 20:28:54.401102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.374 [2024-11-20 20:28:54.401208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.374 [2024-11-20 20:28:54.401239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.374 [2024-11-20 20:28:54.401253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.374 [2024-11-20 20:28:54.401266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.374 [2024-11-20 20:28:54.401293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.374 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.411126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.411227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.411253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.411267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.411279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.411307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.421157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.421259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.421284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.421298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.421310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.421337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.431176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.431272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.431297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.431311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.431323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.431351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.441253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.441367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.441394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.441409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.441428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.441458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.451225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.451352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.451378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.451392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.451404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.451433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.461292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.461395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.461421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.461435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.461448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.461477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.471314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.471410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.471436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.471449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.471462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.471490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.481343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.481463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.481488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.481502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.481514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.481542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.491383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.491506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.491531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.491545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.491558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.491586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.501508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.501608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.501633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.501647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.501660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.501689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.636 qpair failed and we were unable to recover it. 00:27:49.636 [2024-11-20 20:28:54.511412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.636 [2024-11-20 20:28:54.511507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.636 [2024-11-20 20:28:54.511532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.636 [2024-11-20 20:28:54.511546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.636 [2024-11-20 20:28:54.511559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.636 [2024-11-20 20:28:54.511586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.521460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.521561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.521586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.521599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.521612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.521640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.531567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.531670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.531695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.531708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.531727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.531755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.541526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.541678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.541703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.541718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.541730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.541758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.551526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.551617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.551642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.551656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.551668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.551698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.561596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.561728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.561753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.561767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.561780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.561807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.571618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.571733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.571758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.571772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.571785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.571813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.581607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.581713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.581738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.581752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.581764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.581792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.591691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.591791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.591817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.591831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.591843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.591870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.601707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.601812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.601837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.601851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.601864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.601891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.611743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.611875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.611900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.611914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.611928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.611958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.621756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.621856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.621881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.621895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.621915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.621945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.631817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.631911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.631936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.631950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.631962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.631992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.641836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.637 [2024-11-20 20:28:54.641947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.637 [2024-11-20 20:28:54.641972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.637 [2024-11-20 20:28:54.641986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.637 [2024-11-20 20:28:54.641998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.637 [2024-11-20 20:28:54.642026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.637 qpair failed and we were unable to recover it. 00:27:49.637 [2024-11-20 20:28:54.651899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.638 [2024-11-20 20:28:54.651998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.638 [2024-11-20 20:28:54.652024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.638 [2024-11-20 20:28:54.652037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.638 [2024-11-20 20:28:54.652050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.638 [2024-11-20 20:28:54.652085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.638 qpair failed and we were unable to recover it. 00:27:49.638 [2024-11-20 20:28:54.661916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.638 [2024-11-20 20:28:54.662024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.638 [2024-11-20 20:28:54.662050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.638 [2024-11-20 20:28:54.662064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.638 [2024-11-20 20:28:54.662084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.638 [2024-11-20 20:28:54.662113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.638 qpair failed and we were unable to recover it. 00:27:49.898 [2024-11-20 20:28:54.671948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.898 [2024-11-20 20:28:54.672058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.898 [2024-11-20 20:28:54.672091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.898 [2024-11-20 20:28:54.672107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.898 [2024-11-20 20:28:54.672119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.898 [2024-11-20 20:28:54.672148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.898 qpair failed and we were unable to recover it. 00:27:49.898 [2024-11-20 20:28:54.681985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.898 [2024-11-20 20:28:54.682100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.898 [2024-11-20 20:28:54.682125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.898 [2024-11-20 20:28:54.682139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.682153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.682181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.692000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.692116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.692141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.692155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.692168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.692197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.702104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.702208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.702233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.702247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.702260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.702287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.712101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.712249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.712273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.712287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.712305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.712334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.722109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.722217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.722242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.722256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.722269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.722296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.732086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.732189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.732214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.732228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.732241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.732269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.742141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.742259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.742285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.742298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.742310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.742338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.752185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.752310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.752335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.752350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.752362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.752390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.762243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.762345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.762370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.762385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.762397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.762425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.772223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.772328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.772353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.772368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.772380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.772408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.782230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.782335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.782360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.782374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.782386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.782415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.792300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.792401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.792425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.792439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.792452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.792481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.802306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.802430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.802455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.802476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.802489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.802517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.899 qpair failed and we were unable to recover it. 00:27:49.899 [2024-11-20 20:28:54.812332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.899 [2024-11-20 20:28:54.812431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.899 [2024-11-20 20:28:54.812456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.899 [2024-11-20 20:28:54.812471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.899 [2024-11-20 20:28:54.812483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.899 [2024-11-20 20:28:54.812511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.822349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.822448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.822473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.822488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.822500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.822528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.832373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.832472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.832497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.832512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.832524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.832553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.842426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.842538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.842562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.842576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.842589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.842616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.852521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.852651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.852677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.852690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.852703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.852731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.862484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.862582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.862607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.862621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.862633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.862661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.872532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.872638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.872666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.872680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.872693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.872722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.882563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.882665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.882691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.882705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.882718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.882749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.892537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.892644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.892670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.892690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.892703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.892733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.902612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.902715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.902740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.902754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.902767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.902795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.912612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.912710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.912736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.912750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.912762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.912792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.922669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.922774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.922799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.922813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.922825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.922854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:49.900 [2024-11-20 20:28:54.932730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.900 [2024-11-20 20:28:54.932845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.900 [2024-11-20 20:28:54.932869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.900 [2024-11-20 20:28:54.932884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.900 [2024-11-20 20:28:54.932896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:49.900 [2024-11-20 20:28:54.932924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:49.900 qpair failed and we were unable to recover it. 00:27:50.160 [2024-11-20 20:28:54.942767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.160 [2024-11-20 20:28:54.942893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.160 [2024-11-20 20:28:54.942918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.160 [2024-11-20 20:28:54.942932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.160 [2024-11-20 20:28:54.942944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.160 [2024-11-20 20:28:54.942972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.160 qpair failed and we were unable to recover it. 00:27:50.160 [2024-11-20 20:28:54.952739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.160 [2024-11-20 20:28:54.952854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.160 [2024-11-20 20:28:54.952879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.160 [2024-11-20 20:28:54.952893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.160 [2024-11-20 20:28:54.952905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.160 [2024-11-20 20:28:54.952933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.160 qpair failed and we were unable to recover it. 00:27:50.160 [2024-11-20 20:28:54.962800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.160 [2024-11-20 20:28:54.962947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:54.962973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:54.962987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:54.962999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:54.963027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:54.972798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:54.972900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:54.972925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:54.972940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:54.972952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:54.972980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:54.982903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:54.983004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:54.983031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:54.983053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:54.983067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:54.983108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:54.992857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:54.992957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:54.992982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:54.992996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:54.993009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:54.993037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.002917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.003033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.003059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.003082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.003097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.003125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.012914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.013017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.013042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.013056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.013076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.013107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.022940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.023040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.023065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.023092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.023105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.023134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.032997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.033130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.033155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.033169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.033183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.033213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.043022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.043138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.043163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.043178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.043190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.043218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.053038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.053163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.053189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.053203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.053216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.053244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.063087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.063197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.063221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.063234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.063246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.063273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.073123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.073232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.073257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.073278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.073292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.073321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.083130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.083234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.083259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.083273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.161 [2024-11-20 20:28:55.083286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.161 [2024-11-20 20:28:55.083314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.161 qpair failed and we were unable to recover it. 00:27:50.161 [2024-11-20 20:28:55.093180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.161 [2024-11-20 20:28:55.093296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.161 [2024-11-20 20:28:55.093321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.161 [2024-11-20 20:28:55.093336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.093348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.093377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.103271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.103367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.103392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.103406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.103419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.103446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.113214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.113315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.113339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.113353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.113366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.113396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.123275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.123384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.123409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.123423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.123437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.123464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.133293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.133396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.133420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.133434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.133447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.133475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.143316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.143421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.143446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.143460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.143473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.143500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.153346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.153447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.153472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.153488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.153501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.153529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.163396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.163503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.163536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.163552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.163565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.163594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.173420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.173537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.173564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.173578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.173591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.173620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.183415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.183518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.183543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.183557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.183570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.183599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.162 [2024-11-20 20:28:55.193580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.162 [2024-11-20 20:28:55.193708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.162 [2024-11-20 20:28:55.193733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.162 [2024-11-20 20:28:55.193747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.162 [2024-11-20 20:28:55.193760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.162 [2024-11-20 20:28:55.193791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.162 qpair failed and we were unable to recover it. 00:27:50.422 [2024-11-20 20:28:55.203563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.422 [2024-11-20 20:28:55.203705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.422 [2024-11-20 20:28:55.203730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.422 [2024-11-20 20:28:55.203745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.422 [2024-11-20 20:28:55.203757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.422 [2024-11-20 20:28:55.203786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.422 qpair failed and we were unable to recover it. 00:27:50.422 [2024-11-20 20:28:55.213537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.422 [2024-11-20 20:28:55.213636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.422 [2024-11-20 20:28:55.213661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.422 [2024-11-20 20:28:55.213674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.422 [2024-11-20 20:28:55.213686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.422 [2024-11-20 20:28:55.213715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.422 qpair failed and we were unable to recover it. 00:27:50.422 [2024-11-20 20:28:55.223597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.422 [2024-11-20 20:28:55.223701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.422 [2024-11-20 20:28:55.223726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.422 [2024-11-20 20:28:55.223740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.422 [2024-11-20 20:28:55.223752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.422 [2024-11-20 20:28:55.223781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.422 qpair failed and we were unable to recover it. 00:27:50.422 [2024-11-20 20:28:55.233571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.422 [2024-11-20 20:28:55.233670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.422 [2024-11-20 20:28:55.233695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.422 [2024-11-20 20:28:55.233709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.422 [2024-11-20 20:28:55.233721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.422 [2024-11-20 20:28:55.233749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.422 qpair failed and we were unable to recover it. 00:27:50.422 [2024-11-20 20:28:55.243633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.422 [2024-11-20 20:28:55.243736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.422 [2024-11-20 20:28:55.243763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.422 [2024-11-20 20:28:55.243777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.422 [2024-11-20 20:28:55.243790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.422 [2024-11-20 20:28:55.243819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.422 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.253615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.253718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.253749] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.253765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.253778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.253807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.263735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.263834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.263859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.263873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.263886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.263914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.273659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.273758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.273782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.273796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.273808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.273836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.283713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.283819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.283845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.283859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.283872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.283900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.293769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.293887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.293913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.293927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.293939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.293973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.303780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.303882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.303908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.303922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.303934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.303962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.313785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.313881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.313906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.313920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.313933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.313961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.323852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.323995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.324020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.324034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.324046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.324079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.333852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.333952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.333978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.333992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.334005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.334032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.343878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.343977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.344010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.344025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.344038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.344066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.353908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.354006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.354031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.354045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.354057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.354094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.363967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.364078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.364104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.364119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.364131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.364160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.373957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.374063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.374098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.423 [2024-11-20 20:28:55.374113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.423 [2024-11-20 20:28:55.374126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.423 [2024-11-20 20:28:55.374155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.423 qpair failed and we were unable to recover it. 00:27:50.423 [2024-11-20 20:28:55.383981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.423 [2024-11-20 20:28:55.384098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.423 [2024-11-20 20:28:55.384124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.384138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.384151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.384185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.394050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.394160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.394186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.394200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.394212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.394241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.404084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.404193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.404218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.404231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.404244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.404272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.414162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.414261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.414286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.414300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.414312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.414340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.424164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.424266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.424291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.424305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.424317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.424345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.434148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.434252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.434282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.434297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.434310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.434338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.444273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.444419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.444444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.444458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.444470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.444498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.424 [2024-11-20 20:28:55.454188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.424 [2024-11-20 20:28:55.454285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.424 [2024-11-20 20:28:55.454310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.424 [2024-11-20 20:28:55.454324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.424 [2024-11-20 20:28:55.454336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.424 [2024-11-20 20:28:55.454364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.424 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.464221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.464340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.464366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.464381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.464393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.464421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.474320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.474429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.474454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.474468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.474482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.474516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.484289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.484412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.484437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.484451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.484464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.484491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.494304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.494419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.494444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.494458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.494472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.494500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.504357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.504458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.504482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.504496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.504509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.504537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.514366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.514470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.514495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.514509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.514521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.514549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.524404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.524507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.524540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.684 [2024-11-20 20:28:55.524556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.684 [2024-11-20 20:28:55.524568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.684 [2024-11-20 20:28:55.524597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.684 qpair failed and we were unable to recover it. 00:27:50.684 [2024-11-20 20:28:55.534414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.684 [2024-11-20 20:28:55.534543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.684 [2024-11-20 20:28:55.534569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.534583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.534595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.534623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.544528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.544637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.544662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.544677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.544689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.544717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.554523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.554646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.554671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.554686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.554698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.554725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.564512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.564629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.564654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.564668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.564681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.564716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.574539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.574677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.574702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.574716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.574728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.574757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.584563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.584690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.584715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.584729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.584742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.584769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.594612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.594736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.594764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.594779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.594792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.594821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.604747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.604851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.604876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.604890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.604903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.604931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.614671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.614768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.614799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.614814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.614826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.614855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.624712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.624814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.624840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.624854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.624867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.624895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.634727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.634841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.634867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.634881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.634893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.634921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.644728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.644829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.644854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.644869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.644882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.644909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.654754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.654881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.654905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.654920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.654938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.685 [2024-11-20 20:28:55.654967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.685 qpair failed and we were unable to recover it. 00:27:50.685 [2024-11-20 20:28:55.664819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.685 [2024-11-20 20:28:55.664917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.685 [2024-11-20 20:28:55.664942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.685 [2024-11-20 20:28:55.664957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.685 [2024-11-20 20:28:55.664969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.686 [2024-11-20 20:28:55.664997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.686 qpair failed and we were unable to recover it. 00:27:50.686 [2024-11-20 20:28:55.674814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.686 [2024-11-20 20:28:55.674934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.686 [2024-11-20 20:28:55.674959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.686 [2024-11-20 20:28:55.674973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.686 [2024-11-20 20:28:55.674985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.686 [2024-11-20 20:28:55.675013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.686 qpair failed and we were unable to recover it. 00:27:50.686 [2024-11-20 20:28:55.684848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.686 [2024-11-20 20:28:55.684971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.686 [2024-11-20 20:28:55.684996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.686 [2024-11-20 20:28:55.685010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.686 [2024-11-20 20:28:55.685023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.686 [2024-11-20 20:28:55.685051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.686 qpair failed and we were unable to recover it. 00:27:50.686 [2024-11-20 20:28:55.694905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.686 [2024-11-20 20:28:55.695001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.686 [2024-11-20 20:28:55.695026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.686 [2024-11-20 20:28:55.695040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.686 [2024-11-20 20:28:55.695052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.686 [2024-11-20 20:28:55.695087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.686 qpair failed and we were unable to recover it. 00:27:50.686 [2024-11-20 20:28:55.704967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.686 [2024-11-20 20:28:55.705081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.686 [2024-11-20 20:28:55.705108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.686 [2024-11-20 20:28:55.705122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.686 [2024-11-20 20:28:55.705135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.686 [2024-11-20 20:28:55.705163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.686 qpair failed and we were unable to recover it. 00:27:50.686 [2024-11-20 20:28:55.714964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.686 [2024-11-20 20:28:55.715063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.686 [2024-11-20 20:28:55.715095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.686 [2024-11-20 20:28:55.715110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.686 [2024-11-20 20:28:55.715122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.686 [2024-11-20 20:28:55.715151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.686 qpair failed and we were unable to recover it. 00:27:50.946 [2024-11-20 20:28:55.724990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.946 [2024-11-20 20:28:55.725101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.946 [2024-11-20 20:28:55.725126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.946 [2024-11-20 20:28:55.725141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.946 [2024-11-20 20:28:55.725153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.946 [2024-11-20 20:28:55.725182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.946 qpair failed and we were unable to recover it. 00:27:50.946 [2024-11-20 20:28:55.735016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.946 [2024-11-20 20:28:55.735127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.946 [2024-11-20 20:28:55.735152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.946 [2024-11-20 20:28:55.735166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.946 [2024-11-20 20:28:55.735179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.946 [2024-11-20 20:28:55.735207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.946 qpair failed and we were unable to recover it. 00:27:50.946 [2024-11-20 20:28:55.745081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.946 [2024-11-20 20:28:55.745177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.946 [2024-11-20 20:28:55.745202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.946 [2024-11-20 20:28:55.745216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.946 [2024-11-20 20:28:55.745234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.946 [2024-11-20 20:28:55.745263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.946 qpair failed and we were unable to recover it. 00:27:50.946 [2024-11-20 20:28:55.755087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.946 [2024-11-20 20:28:55.755209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.946 [2024-11-20 20:28:55.755234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.946 [2024-11-20 20:28:55.755248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.946 [2024-11-20 20:28:55.755261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.946 [2024-11-20 20:28:55.755289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.946 qpair failed and we were unable to recover it. 00:27:50.946 [2024-11-20 20:28:55.765085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.946 [2024-11-20 20:28:55.765195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.946 [2024-11-20 20:28:55.765219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.765234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.765246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.765274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.775135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.775276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.775300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.775313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.775326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.775355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.785138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.785235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.785260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.785274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.785287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.785314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.795172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.795272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.795297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.795311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.795323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.795351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.805239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.805358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.805383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.805397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.805410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.805437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.815313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.815439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.815464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.815478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.815490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.815518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.825243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.825341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.825366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.825379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.825392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.825422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.835306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.835423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.835448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.835462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.835480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.835508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.845361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.845470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.845495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.845510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.845522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.845549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.855348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.855447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.855472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.855486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.855498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.855526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.865419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.865517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.865542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.865556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.865569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.865596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.875391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.875480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.875505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.875518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.875531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.875558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.885414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.885527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.885552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.885566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.885578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.885606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.947 qpair failed and we were unable to recover it. 00:27:50.947 [2024-11-20 20:28:55.895487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.947 [2024-11-20 20:28:55.895589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.947 [2024-11-20 20:28:55.895613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.947 [2024-11-20 20:28:55.895627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.947 [2024-11-20 20:28:55.895640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.947 [2024-11-20 20:28:55.895669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.905589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.905692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.905717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.905731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.905744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.905772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.915549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.915648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.915673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.915687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.915701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.915729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.925623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.925732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.925757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.925770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.925789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.925817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.935559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.935656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.935681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.935694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.935707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.935735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.945667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.945772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.945797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.945811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.945822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.945850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.955704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.955800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.955828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.955842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.955855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.955884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.965674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.965777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.965802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.965816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.965828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.965856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:50.948 [2024-11-20 20:28:55.975713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.948 [2024-11-20 20:28:55.975841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.948 [2024-11-20 20:28:55.975866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.948 [2024-11-20 20:28:55.975879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.948 [2024-11-20 20:28:55.975892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:50.948 [2024-11-20 20:28:55.975920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:50.948 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:55.985732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:55.985891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:55.985916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:55.985941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:55.985953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:55.985981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:55.995739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:55.995890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:55.995915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:55.995929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:55.995941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:55.995969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.005803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.005908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.005933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.005947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.005960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.005987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.015805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.015902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.015927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.015947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.015961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.015989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.025833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.025968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.025993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.026007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.026020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.026047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.035881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.036004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.036031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.036046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.036058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.036099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.045894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.045997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.046022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.046038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.046052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.046087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.055943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.056065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.056097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.056111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.056123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.056152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.065975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.066111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.066135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.066150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.066161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.066189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.075999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.209 [2024-11-20 20:28:56.076121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.209 [2024-11-20 20:28:56.076146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.209 [2024-11-20 20:28:56.076160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.209 [2024-11-20 20:28:56.076172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.209 [2024-11-20 20:28:56.076201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.209 qpair failed and we were unable to recover it. 00:27:51.209 [2024-11-20 20:28:56.086105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.086211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.086236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.086250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.086263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.086291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.096037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.096152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.096177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.096191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.096203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.096233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.106067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.106169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.106195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.106215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.106228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.106256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.116117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.116216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.116241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.116255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.116268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.116296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.126155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.126294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.126319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.126333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.126345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.126373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.136260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.136376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.136401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.136415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.136428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.136455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.146186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.146288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.146313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.146328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.146341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.146369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.156268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.156387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.156412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.156426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.156439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.156466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.166278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.166395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.166419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.166433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.166445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.166473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.176299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.176393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.176417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.176430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.176443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.176471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.186367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.186474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.186499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.210 [2024-11-20 20:28:56.186512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.210 [2024-11-20 20:28:56.186525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.210 [2024-11-20 20:28:56.186552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.210 qpair failed and we were unable to recover it. 00:27:51.210 [2024-11-20 20:28:56.196459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.210 [2024-11-20 20:28:56.196586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.210 [2024-11-20 20:28:56.196611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.211 [2024-11-20 20:28:56.196631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.211 [2024-11-20 20:28:56.196644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.211 [2024-11-20 20:28:56.196675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.211 qpair failed and we were unable to recover it. 00:27:51.211 [2024-11-20 20:28:56.206508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.211 [2024-11-20 20:28:56.206630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.211 [2024-11-20 20:28:56.206655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.211 [2024-11-20 20:28:56.206669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.211 [2024-11-20 20:28:56.206681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.211 [2024-11-20 20:28:56.206710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.211 qpair failed and we were unable to recover it. 00:27:51.211 [2024-11-20 20:28:56.216509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.211 [2024-11-20 20:28:56.216646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.211 [2024-11-20 20:28:56.216672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.211 [2024-11-20 20:28:56.216687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.211 [2024-11-20 20:28:56.216700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.211 [2024-11-20 20:28:56.216728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.211 qpair failed and we were unable to recover it. 00:27:51.211 [2024-11-20 20:28:56.226437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.211 [2024-11-20 20:28:56.226532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.211 [2024-11-20 20:28:56.226557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.211 [2024-11-20 20:28:56.226572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.211 [2024-11-20 20:28:56.226584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.211 [2024-11-20 20:28:56.226612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.211 qpair failed and we were unable to recover it. 00:27:51.211 [2024-11-20 20:28:56.236504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.211 [2024-11-20 20:28:56.236638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.211 [2024-11-20 20:28:56.236662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.211 [2024-11-20 20:28:56.236676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.211 [2024-11-20 20:28:56.236689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.211 [2024-11-20 20:28:56.236718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.211 qpair failed and we were unable to recover it. 00:27:51.471 [2024-11-20 20:28:56.246543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.471 [2024-11-20 20:28:56.246656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.471 [2024-11-20 20:28:56.246681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.471 [2024-11-20 20:28:56.246695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.471 [2024-11-20 20:28:56.246708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.471 [2024-11-20 20:28:56.246736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.471 qpair failed and we were unable to recover it. 00:27:51.471 [2024-11-20 20:28:56.256577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.471 [2024-11-20 20:28:56.256714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.471 [2024-11-20 20:28:56.256739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.471 [2024-11-20 20:28:56.256753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.471 [2024-11-20 20:28:56.256766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.471 [2024-11-20 20:28:56.256794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.471 qpair failed and we were unable to recover it. 00:27:51.471 [2024-11-20 20:28:56.266564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.266681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.266706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.266720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.266732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.266760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.276640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.276738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.276763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.276777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.276791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.276819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.286663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.286815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.286841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.286861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.286875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.286903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.296757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.296862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.296887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.296900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.296913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.296942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.306686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.306802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.306827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.306840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.306853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.306881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.316812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.316931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.316956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.316970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.316982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.317010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.326777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.326888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.326912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.326927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.326939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.326967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.336775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.336870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.336895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.336908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.336921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.336951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.346812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.346911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.346936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.346950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.346963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.346991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.356808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.356901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.356926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.356940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.356954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.356981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.472 qpair failed and we were unable to recover it. 00:27:51.472 [2024-11-20 20:28:56.366929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.472 [2024-11-20 20:28:56.367067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.472 [2024-11-20 20:28:56.367099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.472 [2024-11-20 20:28:56.367113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.472 [2024-11-20 20:28:56.367126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.472 [2024-11-20 20:28:56.367153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.376873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.376967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.376997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.377012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.377025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.377053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.386911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.387033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.387058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.387086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.387101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.387129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.396956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.397056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.397089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.397104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.397116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.397145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.406966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.407076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.407102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.407116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.407128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.407156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.416993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.417098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.417123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.417137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.417150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.417178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.427002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.427103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.427129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.427144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.427158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.427186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.437029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.437137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.437163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.437177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.437190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.437219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.447090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.447202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.447227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.447242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.447254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.447282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.457151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.457263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.457288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.457302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.457314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.457341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.467192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.467327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.467357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.467372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.467384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.467412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.477230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.477364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.473 [2024-11-20 20:28:56.477388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.473 [2024-11-20 20:28:56.477402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.473 [2024-11-20 20:28:56.477415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.473 [2024-11-20 20:28:56.477443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.473 qpair failed and we were unable to recover it. 00:27:51.473 [2024-11-20 20:28:56.487196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.473 [2024-11-20 20:28:56.487297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.474 [2024-11-20 20:28:56.487322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.474 [2024-11-20 20:28:56.487336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.474 [2024-11-20 20:28:56.487349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.474 [2024-11-20 20:28:56.487377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.474 qpair failed and we were unable to recover it. 00:27:51.474 [2024-11-20 20:28:56.497244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.474 [2024-11-20 20:28:56.497368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.474 [2024-11-20 20:28:56.497393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.474 [2024-11-20 20:28:56.497407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.474 [2024-11-20 20:28:56.497420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.474 [2024-11-20 20:28:56.497449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.474 qpair failed and we were unable to recover it. 00:27:51.474 [2024-11-20 20:28:56.507274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.474 [2024-11-20 20:28:56.507398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.474 [2024-11-20 20:28:56.507425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.474 [2024-11-20 20:28:56.507439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.474 [2024-11-20 20:28:56.507452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.474 [2024-11-20 20:28:56.507487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.474 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.517303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.735 [2024-11-20 20:28:56.517408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.735 [2024-11-20 20:28:56.517432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.735 [2024-11-20 20:28:56.517446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.735 [2024-11-20 20:28:56.517459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.735 [2024-11-20 20:28:56.517486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.735 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.527310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.735 [2024-11-20 20:28:56.527410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.735 [2024-11-20 20:28:56.527435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.735 [2024-11-20 20:28:56.527449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.735 [2024-11-20 20:28:56.527462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.735 [2024-11-20 20:28:56.527489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.735 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.537328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.735 [2024-11-20 20:28:56.537428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.735 [2024-11-20 20:28:56.537453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.735 [2024-11-20 20:28:56.537467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.735 [2024-11-20 20:28:56.537479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.735 [2024-11-20 20:28:56.537507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.735 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.547354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.735 [2024-11-20 20:28:56.547451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.735 [2024-11-20 20:28:56.547476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.735 [2024-11-20 20:28:56.547489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.735 [2024-11-20 20:28:56.547502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.735 [2024-11-20 20:28:56.547530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.735 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.557475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.735 [2024-11-20 20:28:56.557571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.735 [2024-11-20 20:28:56.557603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.735 [2024-11-20 20:28:56.557618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.735 [2024-11-20 20:28:56.557630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.735 [2024-11-20 20:28:56.557658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.735 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.567528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.735 [2024-11-20 20:28:56.567653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.735 [2024-11-20 20:28:56.567678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.735 [2024-11-20 20:28:56.567692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.735 [2024-11-20 20:28:56.567705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.735 [2024-11-20 20:28:56.567732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.735 qpair failed and we were unable to recover it. 00:27:51.735 [2024-11-20 20:28:56.577498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.577601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.577625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.577638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.577651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.577679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.587563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.587667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.587692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.587706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.587718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.587745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.597520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.597617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.597642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.597655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.597667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.597701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.607571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.607692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.607716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.607729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.607742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.607770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.617546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.617649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.617674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.617688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.617701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.617728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.627630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.627735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.627760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.627774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.627787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.627815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.637634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.637732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.637757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.637771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.637783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.637812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.647675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.647777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.647806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.647821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.647834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.647861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.657697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.657799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.657824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.657838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.657851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.657879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.667790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.667886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.667912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.667926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.667938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.667968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.677780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.677884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.677909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.677922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.677937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.677965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.687810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.687959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.687987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.688002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.688015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.688049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.697789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.697883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.697909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.697923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.736 [2024-11-20 20:28:56.697935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.736 [2024-11-20 20:28:56.697963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.736 qpair failed and we were unable to recover it. 00:27:51.736 [2024-11-20 20:28:56.707840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.736 [2024-11-20 20:28:56.707977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.736 [2024-11-20 20:28:56.708003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.736 [2024-11-20 20:28:56.708017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.708029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.708057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.737 [2024-11-20 20:28:56.717884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.737 [2024-11-20 20:28:56.717980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.737 [2024-11-20 20:28:56.718005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.737 [2024-11-20 20:28:56.718019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.718031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.718059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.737 [2024-11-20 20:28:56.727899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.737 [2024-11-20 20:28:56.728002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.737 [2024-11-20 20:28:56.728027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.737 [2024-11-20 20:28:56.728041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.728054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.728089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.737 [2024-11-20 20:28:56.737934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.737 [2024-11-20 20:28:56.738041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.737 [2024-11-20 20:28:56.738079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.737 [2024-11-20 20:28:56.738096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.738109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.738137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.737 [2024-11-20 20:28:56.747953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.737 [2024-11-20 20:28:56.748054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.737 [2024-11-20 20:28:56.748087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.737 [2024-11-20 20:28:56.748102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.748115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.748143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.737 [2024-11-20 20:28:56.758008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.737 [2024-11-20 20:28:56.758117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.737 [2024-11-20 20:28:56.758142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.737 [2024-11-20 20:28:56.758155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.758168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.758196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.737 [2024-11-20 20:28:56.768037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.737 [2024-11-20 20:28:56.768155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.737 [2024-11-20 20:28:56.768180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.737 [2024-11-20 20:28:56.768194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.737 [2024-11-20 20:28:56.768207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.737 [2024-11-20 20:28:56.768235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.737 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.778044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.778147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.778172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.778187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.778199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.778233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.788156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.788284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.788309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.788323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.788336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.788364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.798104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.798216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.798240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.798254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.798266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.798294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.808126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.808228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.808252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.808267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.808279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.808306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.818219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.818324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.818349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.818363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.818375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.818404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.828152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.828249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.828283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.828297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.828310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.828338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.838229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.838331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.838357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.838376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.838389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.838418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.848243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.848348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.848374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.848388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.848401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.848428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.858372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.858478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.858502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.858516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.858529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.858556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:51.999 [2024-11-20 20:28:56.868291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.999 [2024-11-20 20:28:56.868393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.999 [2024-11-20 20:28:56.868418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.999 [2024-11-20 20:28:56.868431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.999 [2024-11-20 20:28:56.868450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:51.999 [2024-11-20 20:28:56.868478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.999 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.878335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.878439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.878464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.878477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.878489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.878518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.888340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.888441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.888466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.888480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.888493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.888520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.898437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.898578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.898602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.898616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.898629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.898657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.908402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.908497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.908522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.908535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.908548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.908576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.918477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.918573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.918598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.918612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.918625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.918653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.928447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.928547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.928572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.928586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.928599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.928627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.938543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.938685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.938709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.938723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.938736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.938764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.948545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.948684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.948710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.948723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.948735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.948762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.958560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.958655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.958680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.958694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.958712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.958740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.968680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.968776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.968801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.968815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.968828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.968856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.978596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.978739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.978764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.978778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.978790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.978817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.988698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.988799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.988824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.988838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.988850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.988877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:56.998678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:56.998779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.000 [2024-11-20 20:28:56.998803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.000 [2024-11-20 20:28:56.998818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.000 [2024-11-20 20:28:56.998830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.000 [2024-11-20 20:28:56.998857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.000 qpair failed and we were unable to recover it. 00:27:52.000 [2024-11-20 20:28:57.008736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.000 [2024-11-20 20:28:57.008841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.001 [2024-11-20 20:28:57.008866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.001 [2024-11-20 20:28:57.008879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.001 [2024-11-20 20:28:57.008892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.001 [2024-11-20 20:28:57.008920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.001 qpair failed and we were unable to recover it. 00:27:52.001 [2024-11-20 20:28:57.018736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.001 [2024-11-20 20:28:57.018889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.001 [2024-11-20 20:28:57.018914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.001 [2024-11-20 20:28:57.018928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.001 [2024-11-20 20:28:57.018940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.001 [2024-11-20 20:28:57.018968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.001 qpair failed and we were unable to recover it. 00:27:52.001 [2024-11-20 20:28:57.028758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.001 [2024-11-20 20:28:57.028877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.001 [2024-11-20 20:28:57.028902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.001 [2024-11-20 20:28:57.028915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.001 [2024-11-20 20:28:57.028928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.001 [2024-11-20 20:28:57.028955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.001 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-20 20:28:57.038804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.261 [2024-11-20 20:28:57.038900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.261 [2024-11-20 20:28:57.038925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.261 [2024-11-20 20:28:57.038939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.261 [2024-11-20 20:28:57.038952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.261 [2024-11-20 20:28:57.038980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-20 20:28:57.048817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.261 [2024-11-20 20:28:57.048921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.261 [2024-11-20 20:28:57.048945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.261 [2024-11-20 20:28:57.048959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.261 [2024-11-20 20:28:57.048979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.261 [2024-11-20 20:28:57.049007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-20 20:28:57.058840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.261 [2024-11-20 20:28:57.058939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.261 [2024-11-20 20:28:57.058964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.261 [2024-11-20 20:28:57.058978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.261 [2024-11-20 20:28:57.058991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.261 [2024-11-20 20:28:57.059019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-20 20:28:57.068883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.261 [2024-11-20 20:28:57.068984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.261 [2024-11-20 20:28:57.069008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.261 [2024-11-20 20:28:57.069021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.261 [2024-11-20 20:28:57.069033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.261 [2024-11-20 20:28:57.069060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-20 20:28:57.078915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.079014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.079038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.079053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.079065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.079101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.088972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.089092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.089117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.089131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.089144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.089172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.098942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.099048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.099080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.099097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.099109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.099138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.109007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.109108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.109133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.109147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.109160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.109188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.119011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.119114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.119140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.119154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.119166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.119197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.129063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.129213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.129238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.129254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.129267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.129295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.139066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.139175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.139199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.139213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.139231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.139260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.149115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.149207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.149233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.149247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.149261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.149289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.159119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.159220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.159245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.159259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.159272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.159301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.169164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.169261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.169287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.169301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.169314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.169341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.179175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.262 [2024-11-20 20:28:57.179274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.262 [2024-11-20 20:28:57.179299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.262 [2024-11-20 20:28:57.179312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.262 [2024-11-20 20:28:57.179325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.262 [2024-11-20 20:28:57.179352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-20 20:28:57.189225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.189320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.189345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.189359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.189372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.189399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.199259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.199355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.199380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.199394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.199406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.199434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.209265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.209366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.209390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.209404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.209417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.209445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.219300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.219398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.219424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.219437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.219449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.219478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.229308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.229408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.229433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.229453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.229467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.229495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.239388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.239505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.239530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.239543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.239556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.239584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.249431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.249534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.249559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.249573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.249585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.249613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.259412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.259509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.259535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.259549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.259561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.259589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.269469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.269590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.269615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.269629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.269642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.269669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.279467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.279561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.279585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.279599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.279611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.279639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-20 20:28:57.289544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.263 [2024-11-20 20:28:57.289646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.263 [2024-11-20 20:28:57.289670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.263 [2024-11-20 20:28:57.289684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.263 [2024-11-20 20:28:57.289697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.263 [2024-11-20 20:28:57.289725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.523 [2024-11-20 20:28:57.299579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.523 [2024-11-20 20:28:57.299722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.523 [2024-11-20 20:28:57.299748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.523 [2024-11-20 20:28:57.299762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.523 [2024-11-20 20:28:57.299778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.523 [2024-11-20 20:28:57.299811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.523 qpair failed and we were unable to recover it. 00:27:52.523 [2024-11-20 20:28:57.309604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.523 [2024-11-20 20:28:57.309709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.523 [2024-11-20 20:28:57.309734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.523 [2024-11-20 20:28:57.309748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.523 [2024-11-20 20:28:57.309761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.523 [2024-11-20 20:28:57.309789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.523 qpair failed and we were unable to recover it. 00:27:52.523 [2024-11-20 20:28:57.319641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.523 [2024-11-20 20:28:57.319754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.523 [2024-11-20 20:28:57.319782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.523 [2024-11-20 20:28:57.319804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.523 [2024-11-20 20:28:57.319817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.523 [2024-11-20 20:28:57.319847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.523 qpair failed and we were unable to recover it. 00:27:52.523 [2024-11-20 20:28:57.329727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.523 [2024-11-20 20:28:57.329833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.523 [2024-11-20 20:28:57.329859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.329873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.329885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.329913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.339642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.339740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.339765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.339779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.339792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.339820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.349681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.349780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.349805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.349819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.349832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.349860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.359722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.359820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.359845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.359859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.359871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.359899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.369743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.369845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.369870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.369884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.369897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.369925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.379779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.379877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.379902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.379915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.379928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.379956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.389810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.389912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.389936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.389950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.389963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.389992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.399877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.399979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.400004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.400018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.400030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.400058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.409942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.410045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.410078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.410101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.410115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.410143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.419891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.420023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.420047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.420061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.420081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.420111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.429971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.430115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.430140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.430154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.430166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.430195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.439922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.524 [2024-11-20 20:28:57.440045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.524 [2024-11-20 20:28:57.440076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.524 [2024-11-20 20:28:57.440092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.524 [2024-11-20 20:28:57.440105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.524 [2024-11-20 20:28:57.440133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.524 qpair failed and we were unable to recover it. 00:27:52.524 [2024-11-20 20:28:57.449960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.450064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.450096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.450111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.450124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.450151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.459976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.460083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.460109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.460123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.460136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.460164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.470031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.470135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.470161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.470175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.470187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.470216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.480076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.480173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.480198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.480212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.480225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.480253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.490101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.490202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.490227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.490241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.490253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.490281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.500110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.500257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.500283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.500303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.500317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.500345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.510133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.510236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.510261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.510275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.510288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.510316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.520166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.520264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.520288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.520302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.520315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.520342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.530255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.530390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.530415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.530429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.530442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.530469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.540249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.540356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.540381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.540394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.540407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.540435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.525 [2024-11-20 20:28:57.550258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.525 [2024-11-20 20:28:57.550355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.525 [2024-11-20 20:28:57.550380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.525 [2024-11-20 20:28:57.550394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.525 [2024-11-20 20:28:57.550406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.525 [2024-11-20 20:28:57.550433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.525 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.560294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.560394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.560419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.560433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.560446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.560474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.570356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.570465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.570490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.570504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.570517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.570545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.580405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.580547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.580572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.580586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.580598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.580626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.590367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.590471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.590501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.590516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.590528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.590556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.600387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.600488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.600512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.600526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.600538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.600566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.610445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.610547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.610572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.610586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.610598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.610627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.620434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.620578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.620604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.620618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.620630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.620658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.630456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.630553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.630578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.630592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.630605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.630632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.640538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.640659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.640686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.640700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.640716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.640746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.650570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.650681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.650706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.650720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.650733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.650761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.660565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.660682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.786 [2024-11-20 20:28:57.660707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.786 [2024-11-20 20:28:57.660722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.786 [2024-11-20 20:28:57.660734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.786 [2024-11-20 20:28:57.660762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.786 qpair failed and we were unable to recover it. 00:27:52.786 [2024-11-20 20:28:57.670645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.786 [2024-11-20 20:28:57.670741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.670769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.670789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.670802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.670831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.680697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.680831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.680862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.680877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.680889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.680917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.690678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.690802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.690827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.690841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.690854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.690881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.700691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.700793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.700819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.700832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.700846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.700874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.710726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.710825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.710850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.710864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.710877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.710904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.720735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.720851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.720876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.720890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.720904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.720938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.730785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.730887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.730912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.730926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.730939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.730967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.740779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.740876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.740901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.740915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.740927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.740955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.750906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.751004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.751029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.751043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.751056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.751091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.760855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.760953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.760978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.760991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.761004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.761034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.787 [2024-11-20 20:28:57.770939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.787 [2024-11-20 20:28:57.771043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.787 [2024-11-20 20:28:57.771083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.787 [2024-11-20 20:28:57.771100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.787 [2024-11-20 20:28:57.771113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.787 [2024-11-20 20:28:57.771141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.787 qpair failed and we were unable to recover it. 00:27:52.788 [2024-11-20 20:28:57.780937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.788 [2024-11-20 20:28:57.781075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.788 [2024-11-20 20:28:57.781100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.788 [2024-11-20 20:28:57.781114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.788 [2024-11-20 20:28:57.781128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.788 [2024-11-20 20:28:57.781157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.788 qpair failed and we were unable to recover it. 00:27:52.788 [2024-11-20 20:28:57.790987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.788 [2024-11-20 20:28:57.791096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.788 [2024-11-20 20:28:57.791121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.788 [2024-11-20 20:28:57.791135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.788 [2024-11-20 20:28:57.791148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.788 [2024-11-20 20:28:57.791176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.788 qpair failed and we were unable to recover it. 00:27:52.788 [2024-11-20 20:28:57.800962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.788 [2024-11-20 20:28:57.801060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.788 [2024-11-20 20:28:57.801091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.788 [2024-11-20 20:28:57.801105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.788 [2024-11-20 20:28:57.801117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.788 [2024-11-20 20:28:57.801145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.788 qpair failed and we were unable to recover it. 00:27:52.788 [2024-11-20 20:28:57.811037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.788 [2024-11-20 20:28:57.811156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.788 [2024-11-20 20:28:57.811181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.788 [2024-11-20 20:28:57.811195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.788 [2024-11-20 20:28:57.811207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.788 [2024-11-20 20:28:57.811241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.788 qpair failed and we were unable to recover it. 00:27:52.788 [2024-11-20 20:28:57.821054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.788 [2024-11-20 20:28:57.821167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.788 [2024-11-20 20:28:57.821192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.788 [2024-11-20 20:28:57.821206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.788 [2024-11-20 20:28:57.821219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:52.788 [2024-11-20 20:28:57.821247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:52.788 qpair failed and we were unable to recover it. 00:27:53.049 [2024-11-20 20:28:57.831174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.049 [2024-11-20 20:28:57.831277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.049 [2024-11-20 20:28:57.831302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.049 [2024-11-20 20:28:57.831317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.049 [2024-11-20 20:28:57.831329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.049 [2024-11-20 20:28:57.831357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.049 qpair failed and we were unable to recover it. 00:27:53.049 [2024-11-20 20:28:57.841099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.049 [2024-11-20 20:28:57.841194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.049 [2024-11-20 20:28:57.841219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.049 [2024-11-20 20:28:57.841233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.841245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.841273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.851120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.851235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.851259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.851273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.851286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.851314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.861129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.861225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.861255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.861270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.861283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.861311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.871183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.871285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.871309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.871323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.871336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.871365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.881226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.881324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.881349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.881364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.881376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.881404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.891255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.891385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.891409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.891424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.891436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.891463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.901306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.901420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.901445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.901458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.901471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.901504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.911317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.911426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.911450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.911464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.911476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.911504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.921338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.921435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.921460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.921474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.921486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.921513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.931364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.931486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.931510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.931524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.931536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.931563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.941363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.941463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.941488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.941502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.941514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.941542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.951406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.951503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.951533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.951547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.951559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.951587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.961416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.050 [2024-11-20 20:28:57.961513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.050 [2024-11-20 20:28:57.961538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.050 [2024-11-20 20:28:57.961552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.050 [2024-11-20 20:28:57.961564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.050 [2024-11-20 20:28:57.961592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.050 qpair failed and we were unable to recover it. 00:27:53.050 [2024-11-20 20:28:57.971476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:57.971577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:57.971602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:57.971616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:57.971629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:57.971656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:57.981548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:57.981694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:57.981719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:57.981733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:57.981745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:57.981773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:57.991518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:57.991616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:57.991641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:57.991655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:57.991667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:57.991700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.001605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.001747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.001771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.001785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.001798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.001826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.011614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.011758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.011783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.011797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.011810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.011838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.021597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.021719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.021744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.021757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.021770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.021799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.031642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.031762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.031787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.031801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.031813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.031841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.041644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.041738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.041768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.041783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.041796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.041823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.051739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.051891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.051917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.051930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.051943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.051970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.061704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.061802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.061827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.061841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.061853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.061881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.071748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.071842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.071866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.071880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.071891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.071918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.051 [2024-11-20 20:28:58.081789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.051 [2024-11-20 20:28:58.081891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.051 [2024-11-20 20:28:58.081915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.051 [2024-11-20 20:28:58.081930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.051 [2024-11-20 20:28:58.081948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.051 [2024-11-20 20:28:58.081977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.051 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.091832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.091958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.091983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.091997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.092010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.092038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.101833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.101931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.101956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.101970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.101982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.102010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.111926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.112076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.112102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.112116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.112129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.112159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.121893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.122015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.122039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.122053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.122065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.122101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.131945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.132057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.132090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.132105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.132118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.132146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.141991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.142095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.142120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.142134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.142148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.142178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.151965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.152059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.152091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.152106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.152119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.152146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.162013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.162121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.162145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.312 [2024-11-20 20:28:58.162159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.312 [2024-11-20 20:28:58.162172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.312 [2024-11-20 20:28:58.162199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.312 qpair failed and we were unable to recover it. 00:27:53.312 [2024-11-20 20:28:58.172157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.312 [2024-11-20 20:28:58.172289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.312 [2024-11-20 20:28:58.172314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.313 [2024-11-20 20:28:58.172327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.313 [2024-11-20 20:28:58.172345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ad0cb0 00:27:53.313 [2024-11-20 20:28:58.172374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.313 qpair failed and we were unable to recover it. 00:27:53.313 [2024-11-20 20:28:58.182158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.313 [2024-11-20 20:28:58.182261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.313 [2024-11-20 20:28:58.182297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.313 [2024-11-20 20:28:58.182313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.313 [2024-11-20 20:28:58.182326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fd828000b90 00:27:53.313 [2024-11-20 20:28:58.182358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.313 qpair failed and we were unable to recover it. 00:27:53.313 [2024-11-20 20:28:58.192109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.313 [2024-11-20 20:28:58.192211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.313 [2024-11-20 20:28:58.192238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.313 [2024-11-20 20:28:58.192253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.313 [2024-11-20 20:28:58.192265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fd828000b90 00:27:53.313 [2024-11-20 20:28:58.192298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.313 qpair failed and we were unable to recover it. 00:27:53.313 [2024-11-20 20:28:58.192409] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:53.313 A controller has encountered a failure and is being reset. 00:27:53.313 Controller properly reset. 00:27:53.313 Initializing NVMe Controllers 00:27:53.313 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:53.313 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:53.313 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:53.313 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:53.313 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:53.313 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:53.313 Initialization complete. Launching workers. 00:27:53.313 Starting thread on core 1 00:27:53.313 Starting thread on core 2 00:27:53.313 Starting thread on core 3 00:27:53.313 Starting thread on core 0 00:27:53.313 20:28:58 -- host/target_disconnect.sh@59 -- # sync 00:27:53.313 00:27:53.313 real 0m11.525s 00:27:53.313 user 0m21.640s 00:27:53.313 sys 0m5.431s 00:27:53.313 20:28:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:53.313 20:28:58 -- common/autotest_common.sh@10 -- # set +x 00:27:53.313 ************************************ 00:27:53.313 END TEST nvmf_target_disconnect_tc2 00:27:53.313 ************************************ 00:27:53.313 20:28:58 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:53.313 20:28:58 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:53.313 20:28:58 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:53.313 20:28:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:53.313 20:28:58 -- nvmf/common.sh@116 -- # sync 00:27:53.313 20:28:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:53.313 20:28:58 -- nvmf/common.sh@119 -- # set +e 00:27:53.313 20:28:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:53.313 20:28:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:53.313 rmmod nvme_tcp 00:27:53.313 rmmod nvme_fabrics 00:27:53.313 rmmod nvme_keyring 00:27:53.313 20:28:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:53.573 20:28:58 -- nvmf/common.sh@123 -- # set -e 00:27:53.573 20:28:58 -- nvmf/common.sh@124 -- # return 0 00:27:53.573 20:28:58 -- nvmf/common.sh@477 -- # '[' -n 3281450 ']' 00:27:53.573 20:28:58 -- nvmf/common.sh@478 -- # killprocess 3281450 00:27:53.573 20:28:58 -- common/autotest_common.sh@936 -- # '[' -z 3281450 ']' 00:27:53.573 20:28:58 -- common/autotest_common.sh@940 -- # kill -0 3281450 00:27:53.573 20:28:58 -- common/autotest_common.sh@941 -- # uname 00:27:53.573 20:28:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:53.573 20:28:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3281450 00:27:53.573 20:28:58 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:53.573 20:28:58 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:53.573 20:28:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3281450' 00:27:53.573 killing process with pid 3281450 00:27:53.573 20:28:58 -- common/autotest_common.sh@955 -- # kill 3281450 00:27:53.573 20:28:58 -- common/autotest_common.sh@960 -- # wait 3281450 00:27:53.833 20:28:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:53.833 20:28:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:53.833 20:28:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:53.833 20:28:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:53.833 20:28:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:53.833 20:28:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.833 20:28:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.833 20:28:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:55.737 20:29:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:55.737 00:27:55.737 real 0m16.310s 00:27:55.737 user 0m47.883s 00:27:55.737 sys 0m7.319s 00:27:55.737 20:29:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:55.737 20:29:00 -- common/autotest_common.sh@10 -- # set +x 00:27:55.737 ************************************ 00:27:55.737 END TEST nvmf_target_disconnect 00:27:55.737 ************************************ 00:27:55.737 20:29:00 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:55.737 20:29:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:55.737 20:29:00 -- common/autotest_common.sh@10 -- # set +x 00:27:55.737 20:29:00 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:55.996 00:27:55.996 real 21m22.935s 00:27:55.996 user 61m57.628s 00:27:55.996 sys 5m0.789s 00:27:55.996 20:29:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:55.996 20:29:00 -- common/autotest_common.sh@10 -- # set +x 00:27:55.996 ************************************ 00:27:55.996 END TEST nvmf_tcp 00:27:55.996 ************************************ 00:27:55.996 20:29:00 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:55.996 20:29:00 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:55.996 20:29:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:55.996 20:29:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:55.996 20:29:00 -- common/autotest_common.sh@10 -- # set +x 00:27:55.996 ************************************ 00:27:55.996 START TEST spdkcli_nvmf_tcp 00:27:55.996 ************************************ 00:27:55.996 20:29:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:55.996 * Looking for test storage... 00:27:55.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:55.996 20:29:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:55.996 20:29:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:55.996 20:29:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:55.996 20:29:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:55.996 20:29:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:55.996 20:29:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:55.996 20:29:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:55.996 20:29:00 -- scripts/common.sh@335 -- # IFS=.-: 00:27:55.996 20:29:00 -- scripts/common.sh@335 -- # read -ra ver1 00:27:55.996 20:29:00 -- scripts/common.sh@336 -- # IFS=.-: 00:27:55.996 20:29:00 -- scripts/common.sh@336 -- # read -ra ver2 00:27:55.996 20:29:00 -- scripts/common.sh@337 -- # local 'op=<' 00:27:55.996 20:29:00 -- scripts/common.sh@339 -- # ver1_l=2 00:27:55.996 20:29:00 -- scripts/common.sh@340 -- # ver2_l=1 00:27:55.996 20:29:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:55.996 20:29:00 -- scripts/common.sh@343 -- # case "$op" in 00:27:55.996 20:29:00 -- scripts/common.sh@344 -- # : 1 00:27:55.996 20:29:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:55.996 20:29:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:55.996 20:29:00 -- scripts/common.sh@364 -- # decimal 1 00:27:55.996 20:29:00 -- scripts/common.sh@352 -- # local d=1 00:27:55.996 20:29:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:55.996 20:29:00 -- scripts/common.sh@354 -- # echo 1 00:27:55.996 20:29:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:55.996 20:29:00 -- scripts/common.sh@365 -- # decimal 2 00:27:55.996 20:29:00 -- scripts/common.sh@352 -- # local d=2 00:27:55.996 20:29:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:55.996 20:29:00 -- scripts/common.sh@354 -- # echo 2 00:27:55.996 20:29:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:55.996 20:29:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:55.996 20:29:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:55.996 20:29:00 -- scripts/common.sh@367 -- # return 0 00:27:55.996 20:29:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:55.996 20:29:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:55.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.996 --rc genhtml_branch_coverage=1 00:27:55.996 --rc genhtml_function_coverage=1 00:27:55.996 --rc genhtml_legend=1 00:27:55.996 --rc geninfo_all_blocks=1 00:27:55.996 --rc geninfo_unexecuted_blocks=1 00:27:55.996 00:27:55.996 ' 00:27:55.996 20:29:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:55.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.997 --rc genhtml_branch_coverage=1 00:27:55.997 --rc genhtml_function_coverage=1 00:27:55.997 --rc genhtml_legend=1 00:27:55.997 --rc geninfo_all_blocks=1 00:27:55.997 --rc geninfo_unexecuted_blocks=1 00:27:55.997 00:27:55.997 ' 00:27:55.997 20:29:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:55.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.997 --rc genhtml_branch_coverage=1 00:27:55.997 --rc genhtml_function_coverage=1 00:27:55.997 --rc genhtml_legend=1 00:27:55.997 --rc geninfo_all_blocks=1 00:27:55.997 --rc geninfo_unexecuted_blocks=1 00:27:55.997 00:27:55.997 ' 00:27:55.997 20:29:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:55.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:55.997 --rc genhtml_branch_coverage=1 00:27:55.997 --rc genhtml_function_coverage=1 00:27:55.997 --rc genhtml_legend=1 00:27:55.997 --rc geninfo_all_blocks=1 00:27:55.997 --rc geninfo_unexecuted_blocks=1 00:27:55.997 00:27:55.997 ' 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:55.997 20:29:00 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:55.997 20:29:00 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:55.997 20:29:00 -- nvmf/common.sh@7 -- # uname -s 00:27:55.997 20:29:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:55.997 20:29:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:55.997 20:29:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:55.997 20:29:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:55.997 20:29:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:55.997 20:29:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:55.997 20:29:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:55.997 20:29:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:55.997 20:29:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:55.997 20:29:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:55.997 20:29:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:55.997 20:29:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:55.997 20:29:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:55.997 20:29:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:55.997 20:29:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:55.997 20:29:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:55.997 20:29:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:55.997 20:29:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:55.997 20:29:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:55.997 20:29:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.997 20:29:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.997 20:29:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.997 20:29:00 -- paths/export.sh@5 -- # export PATH 00:27:55.997 20:29:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.997 20:29:00 -- nvmf/common.sh@46 -- # : 0 00:27:55.997 20:29:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:55.997 20:29:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:55.997 20:29:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:55.997 20:29:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:55.997 20:29:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:55.997 20:29:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:55.997 20:29:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:55.997 20:29:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:55.997 20:29:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:55.997 20:29:00 -- common/autotest_common.sh@10 -- # set +x 00:27:55.997 20:29:00 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:55.997 20:29:00 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3282678 00:27:55.997 20:29:00 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:55.997 20:29:00 -- spdkcli/common.sh@34 -- # waitforlisten 3282678 00:27:55.997 20:29:00 -- common/autotest_common.sh@829 -- # '[' -z 3282678 ']' 00:27:55.997 20:29:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:55.997 20:29:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:55.997 20:29:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:55.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:55.997 20:29:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:55.997 20:29:00 -- common/autotest_common.sh@10 -- # set +x 00:27:55.997 [2024-11-20 20:29:01.005908] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:55.997 [2024-11-20 20:29:01.005999] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3282678 ] 00:27:56.256 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.256 [2024-11-20 20:29:01.091098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:56.256 [2024-11-20 20:29:01.203026] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:56.256 [2024-11-20 20:29:01.203240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:56.256 [2024-11-20 20:29:01.203246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:57.194 20:29:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:57.194 20:29:02 -- common/autotest_common.sh@862 -- # return 0 00:27:57.194 20:29:02 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:57.194 20:29:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:57.194 20:29:02 -- common/autotest_common.sh@10 -- # set +x 00:27:57.194 20:29:02 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:57.194 20:29:02 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:57.194 20:29:02 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:57.194 20:29:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.194 20:29:02 -- common/autotest_common.sh@10 -- # set +x 00:27:57.194 20:29:02 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:57.194 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:57.194 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:57.194 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:57.194 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:57.194 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:57.194 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:57.194 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.194 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.194 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:57.195 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:57.195 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:57.195 ' 00:27:57.454 [2024-11-20 20:29:02.452841] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:59.994 [2024-11-20 20:29:04.637022] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:00.930 [2024-11-20 20:29:05.877570] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:03.462 [2024-11-20 20:29:08.164744] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:05.365 [2024-11-20 20:29:10.131438] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:06.741 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:06.741 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:06.741 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:06.742 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:06.742 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:06.742 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:06.742 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:06.742 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.742 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.742 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:06.742 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:06.742 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:06.742 20:29:11 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:06.742 20:29:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:06.742 20:29:11 -- common/autotest_common.sh@10 -- # set +x 00:28:06.742 20:29:11 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:06.742 20:29:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:06.742 20:29:11 -- common/autotest_common.sh@10 -- # set +x 00:28:07.001 20:29:11 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:07.001 20:29:11 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:07.261 20:29:12 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:07.261 20:29:12 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:07.261 20:29:12 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:07.261 20:29:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:07.261 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:28:07.261 20:29:12 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:07.261 20:29:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:07.261 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:28:07.261 20:29:12 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:07.261 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:07.261 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:07.261 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:07.261 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:07.261 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:07.261 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:07.261 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:07.261 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:07.261 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:07.261 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:07.261 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:07.261 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:07.261 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:07.261 ' 00:28:12.536 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:12.536 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:12.536 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:12.536 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:12.536 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:12.536 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:12.536 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:12.536 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:12.536 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:12.536 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:12.536 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:12.536 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:12.536 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:12.536 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:12.797 20:29:17 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:12.797 20:29:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:12.797 20:29:17 -- common/autotest_common.sh@10 -- # set +x 00:28:12.797 20:29:17 -- spdkcli/nvmf.sh@90 -- # killprocess 3282678 00:28:12.797 20:29:17 -- common/autotest_common.sh@936 -- # '[' -z 3282678 ']' 00:28:12.797 20:29:17 -- common/autotest_common.sh@940 -- # kill -0 3282678 00:28:12.797 20:29:17 -- common/autotest_common.sh@941 -- # uname 00:28:12.797 20:29:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:12.797 20:29:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3282678 00:28:12.797 20:29:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:12.797 20:29:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:12.797 20:29:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3282678' 00:28:12.797 killing process with pid 3282678 00:28:12.797 20:29:17 -- common/autotest_common.sh@955 -- # kill 3282678 00:28:12.797 [2024-11-20 20:29:17.682230] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:12.797 20:29:17 -- common/autotest_common.sh@960 -- # wait 3282678 00:28:13.055 20:29:17 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:13.055 20:29:17 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:13.055 20:29:17 -- spdkcli/common.sh@13 -- # '[' -n 3282678 ']' 00:28:13.055 20:29:17 -- spdkcli/common.sh@14 -- # killprocess 3282678 00:28:13.055 20:29:17 -- common/autotest_common.sh@936 -- # '[' -z 3282678 ']' 00:28:13.055 20:29:17 -- common/autotest_common.sh@940 -- # kill -0 3282678 00:28:13.055 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3282678) - No such process 00:28:13.055 20:29:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3282678 is not found' 00:28:13.055 Process with pid 3282678 is not found 00:28:13.055 20:29:17 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:13.055 20:29:17 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:13.055 20:29:17 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:13.055 00:28:13.055 real 0m17.164s 00:28:13.055 user 0m36.546s 00:28:13.055 sys 0m0.819s 00:28:13.055 20:29:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:13.055 20:29:17 -- common/autotest_common.sh@10 -- # set +x 00:28:13.055 ************************************ 00:28:13.055 END TEST spdkcli_nvmf_tcp 00:28:13.055 ************************************ 00:28:13.055 20:29:17 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.055 20:29:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:13.055 20:29:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:13.055 20:29:17 -- common/autotest_common.sh@10 -- # set +x 00:28:13.055 ************************************ 00:28:13.055 START TEST nvmf_identify_passthru 00:28:13.055 ************************************ 00:28:13.055 20:29:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.055 * Looking for test storage... 00:28:13.055 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:13.055 20:29:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:13.055 20:29:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:13.055 20:29:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:13.314 20:29:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:13.314 20:29:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:13.314 20:29:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:13.314 20:29:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:13.314 20:29:18 -- scripts/common.sh@335 -- # IFS=.-: 00:28:13.314 20:29:18 -- scripts/common.sh@335 -- # read -ra ver1 00:28:13.314 20:29:18 -- scripts/common.sh@336 -- # IFS=.-: 00:28:13.314 20:29:18 -- scripts/common.sh@336 -- # read -ra ver2 00:28:13.314 20:29:18 -- scripts/common.sh@337 -- # local 'op=<' 00:28:13.314 20:29:18 -- scripts/common.sh@339 -- # ver1_l=2 00:28:13.314 20:29:18 -- scripts/common.sh@340 -- # ver2_l=1 00:28:13.314 20:29:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:13.314 20:29:18 -- scripts/common.sh@343 -- # case "$op" in 00:28:13.315 20:29:18 -- scripts/common.sh@344 -- # : 1 00:28:13.315 20:29:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:13.315 20:29:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:13.315 20:29:18 -- scripts/common.sh@364 -- # decimal 1 00:28:13.315 20:29:18 -- scripts/common.sh@352 -- # local d=1 00:28:13.315 20:29:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:13.315 20:29:18 -- scripts/common.sh@354 -- # echo 1 00:28:13.315 20:29:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:13.315 20:29:18 -- scripts/common.sh@365 -- # decimal 2 00:28:13.315 20:29:18 -- scripts/common.sh@352 -- # local d=2 00:28:13.315 20:29:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:13.315 20:29:18 -- scripts/common.sh@354 -- # echo 2 00:28:13.315 20:29:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:13.315 20:29:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:13.315 20:29:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:13.315 20:29:18 -- scripts/common.sh@367 -- # return 0 00:28:13.315 20:29:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:13.315 20:29:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:13.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.315 --rc genhtml_branch_coverage=1 00:28:13.315 --rc genhtml_function_coverage=1 00:28:13.315 --rc genhtml_legend=1 00:28:13.315 --rc geninfo_all_blocks=1 00:28:13.315 --rc geninfo_unexecuted_blocks=1 00:28:13.315 00:28:13.315 ' 00:28:13.315 20:29:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:13.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.315 --rc genhtml_branch_coverage=1 00:28:13.315 --rc genhtml_function_coverage=1 00:28:13.315 --rc genhtml_legend=1 00:28:13.315 --rc geninfo_all_blocks=1 00:28:13.315 --rc geninfo_unexecuted_blocks=1 00:28:13.315 00:28:13.315 ' 00:28:13.315 20:29:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:13.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.315 --rc genhtml_branch_coverage=1 00:28:13.315 --rc genhtml_function_coverage=1 00:28:13.315 --rc genhtml_legend=1 00:28:13.315 --rc geninfo_all_blocks=1 00:28:13.315 --rc geninfo_unexecuted_blocks=1 00:28:13.315 00:28:13.315 ' 00:28:13.315 20:29:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:13.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.315 --rc genhtml_branch_coverage=1 00:28:13.315 --rc genhtml_function_coverage=1 00:28:13.315 --rc genhtml_legend=1 00:28:13.315 --rc geninfo_all_blocks=1 00:28:13.315 --rc geninfo_unexecuted_blocks=1 00:28:13.315 00:28:13.315 ' 00:28:13.315 20:29:18 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:13.315 20:29:18 -- nvmf/common.sh@7 -- # uname -s 00:28:13.315 20:29:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:13.315 20:29:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:13.315 20:29:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:13.315 20:29:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:13.315 20:29:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:13.315 20:29:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:13.315 20:29:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:13.315 20:29:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:13.315 20:29:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:13.315 20:29:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:13.315 20:29:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.315 20:29:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.315 20:29:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:13.315 20:29:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:13.315 20:29:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:13.315 20:29:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.315 20:29:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.315 20:29:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.315 20:29:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.315 20:29:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- paths/export.sh@5 -- # export PATH 00:28:13.315 20:29:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- nvmf/common.sh@46 -- # : 0 00:28:13.315 20:29:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:13.315 20:29:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:13.315 20:29:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:13.315 20:29:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:13.315 20:29:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:13.315 20:29:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:13.315 20:29:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:13.315 20:29:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:13.315 20:29:18 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.315 20:29:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.315 20:29:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.315 20:29:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.315 20:29:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- paths/export.sh@5 -- # export PATH 00:28:13.315 20:29:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.315 20:29:18 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:13.315 20:29:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:13.315 20:29:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:13.315 20:29:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:13.315 20:29:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:13.316 20:29:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:13.316 20:29:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:13.316 20:29:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:13.316 20:29:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:13.316 20:29:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:13.316 20:29:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:13.316 20:29:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:13.316 20:29:18 -- common/autotest_common.sh@10 -- # set +x 00:28:15.222 20:29:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:15.222 20:29:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:15.222 20:29:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:15.222 20:29:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:15.222 20:29:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:15.222 20:29:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:15.222 20:29:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:15.222 20:29:20 -- nvmf/common.sh@294 -- # net_devs=() 00:28:15.222 20:29:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:15.222 20:29:20 -- nvmf/common.sh@295 -- # e810=() 00:28:15.222 20:29:20 -- nvmf/common.sh@295 -- # local -ga e810 00:28:15.222 20:29:20 -- nvmf/common.sh@296 -- # x722=() 00:28:15.222 20:29:20 -- nvmf/common.sh@296 -- # local -ga x722 00:28:15.222 20:29:20 -- nvmf/common.sh@297 -- # mlx=() 00:28:15.222 20:29:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:15.222 20:29:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:15.222 20:29:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:15.222 20:29:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:15.222 20:29:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:15.222 20:29:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.222 20:29:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:15.222 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:15.222 20:29:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.222 20:29:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:15.222 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:15.222 20:29:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:15.222 20:29:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.222 20:29:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.222 20:29:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.222 20:29:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.222 20:29:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:15.222 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:15.222 20:29:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.222 20:29:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.222 20:29:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.222 20:29:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.222 20:29:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.222 20:29:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:15.222 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:15.222 20:29:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.222 20:29:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:15.222 20:29:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:15.222 20:29:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:15.222 20:29:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:15.222 20:29:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:15.222 20:29:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:15.222 20:29:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:15.222 20:29:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:15.222 20:29:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:15.222 20:29:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:15.222 20:29:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:15.222 20:29:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:15.222 20:29:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:15.222 20:29:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:15.222 20:29:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:15.222 20:29:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:15.222 20:29:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:15.222 20:29:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:15.222 20:29:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:15.222 20:29:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:15.222 20:29:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:15.222 20:29:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:15.222 20:29:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:15.222 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:15.222 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.170 ms 00:28:15.222 00:28:15.222 --- 10.0.0.2 ping statistics --- 00:28:15.222 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.222 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:28:15.222 20:29:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:15.222 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:15.222 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:28:15.222 00:28:15.222 --- 10.0.0.1 ping statistics --- 00:28:15.222 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.222 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:28:15.222 20:29:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:15.222 20:29:20 -- nvmf/common.sh@410 -- # return 0 00:28:15.222 20:29:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:15.222 20:29:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:15.222 20:29:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:15.222 20:29:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:15.222 20:29:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:15.222 20:29:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:15.480 20:29:20 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:15.480 20:29:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:15.480 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:15.480 20:29:20 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:15.480 20:29:20 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:15.480 20:29:20 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:15.480 20:29:20 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:15.480 20:29:20 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:15.480 20:29:20 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:15.480 20:29:20 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:15.480 20:29:20 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:15.480 20:29:20 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:15.480 20:29:20 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:15.480 20:29:20 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:15.480 20:29:20 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:15.480 20:29:20 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:15.480 20:29:20 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:15.480 20:29:20 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:15.480 20:29:20 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:15.480 20:29:20 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:15.480 20:29:20 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:15.480 EAL: No free 2048 kB hugepages reported on node 1 00:28:19.675 20:29:24 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:19.675 20:29:24 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:19.675 20:29:24 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:19.675 20:29:24 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:19.675 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.865 20:29:28 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:23.865 20:29:28 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:23.865 20:29:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.865 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:23.865 20:29:28 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:23.865 20:29:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:23.865 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:23.865 20:29:28 -- target/identify_passthru.sh@31 -- # nvmfpid=3287421 00:28:23.865 20:29:28 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:23.865 20:29:28 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:23.865 20:29:28 -- target/identify_passthru.sh@35 -- # waitforlisten 3287421 00:28:23.865 20:29:28 -- common/autotest_common.sh@829 -- # '[' -z 3287421 ']' 00:28:23.865 20:29:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:23.865 20:29:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:23.865 20:29:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:23.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:23.865 20:29:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:23.865 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:23.865 [2024-11-20 20:29:28.812596] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:23.865 [2024-11-20 20:29:28.812694] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:23.865 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.865 [2024-11-20 20:29:28.876926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:24.124 [2024-11-20 20:29:28.988284] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:24.124 [2024-11-20 20:29:28.988434] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:24.124 [2024-11-20 20:29:28.988458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:24.124 [2024-11-20 20:29:28.988477] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:24.124 [2024-11-20 20:29:28.988544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:24.124 [2024-11-20 20:29:28.988607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:24.124 [2024-11-20 20:29:28.988672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:24.124 [2024-11-20 20:29:28.988678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:24.124 20:29:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:24.124 20:29:29 -- common/autotest_common.sh@862 -- # return 0 00:28:24.124 20:29:29 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:24.124 20:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.124 20:29:29 -- common/autotest_common.sh@10 -- # set +x 00:28:24.124 INFO: Log level set to 20 00:28:24.124 INFO: Requests: 00:28:24.124 { 00:28:24.124 "jsonrpc": "2.0", 00:28:24.124 "method": "nvmf_set_config", 00:28:24.124 "id": 1, 00:28:24.124 "params": { 00:28:24.124 "admin_cmd_passthru": { 00:28:24.124 "identify_ctrlr": true 00:28:24.124 } 00:28:24.124 } 00:28:24.124 } 00:28:24.124 00:28:24.124 INFO: response: 00:28:24.124 { 00:28:24.124 "jsonrpc": "2.0", 00:28:24.124 "id": 1, 00:28:24.124 "result": true 00:28:24.124 } 00:28:24.124 00:28:24.124 20:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.124 20:29:29 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:24.124 20:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.124 20:29:29 -- common/autotest_common.sh@10 -- # set +x 00:28:24.124 INFO: Setting log level to 20 00:28:24.124 INFO: Setting log level to 20 00:28:24.124 INFO: Log level set to 20 00:28:24.124 INFO: Log level set to 20 00:28:24.124 INFO: Requests: 00:28:24.124 { 00:28:24.124 "jsonrpc": "2.0", 00:28:24.124 "method": "framework_start_init", 00:28:24.124 "id": 1 00:28:24.124 } 00:28:24.124 00:28:24.124 INFO: Requests: 00:28:24.124 { 00:28:24.124 "jsonrpc": "2.0", 00:28:24.124 "method": "framework_start_init", 00:28:24.124 "id": 1 00:28:24.124 } 00:28:24.124 00:28:24.124 [2024-11-20 20:29:29.143293] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:24.124 INFO: response: 00:28:24.124 { 00:28:24.124 "jsonrpc": "2.0", 00:28:24.124 "id": 1, 00:28:24.124 "result": true 00:28:24.124 } 00:28:24.124 00:28:24.124 INFO: response: 00:28:24.124 { 00:28:24.124 "jsonrpc": "2.0", 00:28:24.124 "id": 1, 00:28:24.124 "result": true 00:28:24.124 } 00:28:24.124 00:28:24.124 20:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.124 20:29:29 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:24.124 20:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.124 20:29:29 -- common/autotest_common.sh@10 -- # set +x 00:28:24.124 INFO: Setting log level to 40 00:28:24.124 INFO: Setting log level to 40 00:28:24.124 INFO: Setting log level to 40 00:28:24.124 [2024-11-20 20:29:29.153289] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:24.382 20:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.382 20:29:29 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:24.382 20:29:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:24.382 20:29:29 -- common/autotest_common.sh@10 -- # set +x 00:28:24.382 20:29:29 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:24.382 20:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.382 20:29:29 -- common/autotest_common.sh@10 -- # set +x 00:28:27.670 Nvme0n1 00:28:27.670 20:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.670 20:29:32 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:27.670 20:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.670 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:27.670 20:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.670 20:29:32 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:27.670 20:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.670 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:27.670 20:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.670 20:29:32 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:27.670 20:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.670 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:27.670 [2024-11-20 20:29:32.041756] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:27.670 20:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.670 20:29:32 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:27.670 20:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.670 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:27.670 [2024-11-20 20:29:32.049436] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:27.670 [ 00:28:27.670 { 00:28:27.670 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:27.670 "subtype": "Discovery", 00:28:27.670 "listen_addresses": [], 00:28:27.670 "allow_any_host": true, 00:28:27.670 "hosts": [] 00:28:27.670 }, 00:28:27.670 { 00:28:27.670 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:27.670 "subtype": "NVMe", 00:28:27.670 "listen_addresses": [ 00:28:27.670 { 00:28:27.670 "transport": "TCP", 00:28:27.670 "trtype": "TCP", 00:28:27.670 "adrfam": "IPv4", 00:28:27.670 "traddr": "10.0.0.2", 00:28:27.670 "trsvcid": "4420" 00:28:27.670 } 00:28:27.670 ], 00:28:27.670 "allow_any_host": true, 00:28:27.670 "hosts": [], 00:28:27.670 "serial_number": "SPDK00000000000001", 00:28:27.670 "model_number": "SPDK bdev Controller", 00:28:27.670 "max_namespaces": 1, 00:28:27.670 "min_cntlid": 1, 00:28:27.670 "max_cntlid": 65519, 00:28:27.670 "namespaces": [ 00:28:27.670 { 00:28:27.670 "nsid": 1, 00:28:27.670 "bdev_name": "Nvme0n1", 00:28:27.670 "name": "Nvme0n1", 00:28:27.670 "nguid": "CE3AEBBFBB5B4487A892313FFF81D08A", 00:28:27.670 "uuid": "ce3aebbf-bb5b-4487-a892-313fff81d08a" 00:28:27.670 } 00:28:27.670 ] 00:28:27.670 } 00:28:27.670 ] 00:28:27.670 20:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.670 20:29:32 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:27.670 20:29:32 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:27.670 20:29:32 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:27.670 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.670 20:29:32 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:27.670 20:29:32 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:27.670 20:29:32 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:27.670 20:29:32 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:27.670 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.670 20:29:32 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:27.670 20:29:32 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:27.670 20:29:32 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:27.670 20:29:32 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:27.670 20:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.670 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:27.670 20:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.670 20:29:32 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:27.670 20:29:32 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:27.670 20:29:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:27.670 20:29:32 -- nvmf/common.sh@116 -- # sync 00:28:27.670 20:29:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:27.670 20:29:32 -- nvmf/common.sh@119 -- # set +e 00:28:27.670 20:29:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:27.670 20:29:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:27.670 rmmod nvme_tcp 00:28:27.670 rmmod nvme_fabrics 00:28:27.670 rmmod nvme_keyring 00:28:27.670 20:29:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:27.670 20:29:32 -- nvmf/common.sh@123 -- # set -e 00:28:27.670 20:29:32 -- nvmf/common.sh@124 -- # return 0 00:28:27.671 20:29:32 -- nvmf/common.sh@477 -- # '[' -n 3287421 ']' 00:28:27.671 20:29:32 -- nvmf/common.sh@478 -- # killprocess 3287421 00:28:27.671 20:29:32 -- common/autotest_common.sh@936 -- # '[' -z 3287421 ']' 00:28:27.671 20:29:32 -- common/autotest_common.sh@940 -- # kill -0 3287421 00:28:27.671 20:29:32 -- common/autotest_common.sh@941 -- # uname 00:28:27.671 20:29:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:27.671 20:29:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3287421 00:28:27.671 20:29:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:27.671 20:29:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:27.671 20:29:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3287421' 00:28:27.671 killing process with pid 3287421 00:28:27.671 20:29:32 -- common/autotest_common.sh@955 -- # kill 3287421 00:28:27.671 [2024-11-20 20:29:32.698698] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:27.671 20:29:32 -- common/autotest_common.sh@960 -- # wait 3287421 00:28:29.638 20:29:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:29.638 20:29:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:29.638 20:29:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:29.638 20:29:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:29.638 20:29:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:29.638 20:29:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:29.638 20:29:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:29.638 20:29:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:31.542 20:29:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:31.543 00:28:31.543 real 0m18.356s 00:28:31.543 user 0m27.596s 00:28:31.543 sys 0m2.376s 00:28:31.543 20:29:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:31.543 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:28:31.543 ************************************ 00:28:31.543 END TEST nvmf_identify_passthru 00:28:31.543 ************************************ 00:28:31.543 20:29:36 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:31.543 20:29:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:31.543 20:29:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:31.543 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:28:31.543 ************************************ 00:28:31.543 START TEST nvmf_dif 00:28:31.543 ************************************ 00:28:31.543 20:29:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:31.543 * Looking for test storage... 00:28:31.543 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:31.543 20:29:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:31.543 20:29:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:31.543 20:29:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:31.543 20:29:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:31.543 20:29:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:31.543 20:29:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:31.543 20:29:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:31.543 20:29:36 -- scripts/common.sh@335 -- # IFS=.-: 00:28:31.543 20:29:36 -- scripts/common.sh@335 -- # read -ra ver1 00:28:31.543 20:29:36 -- scripts/common.sh@336 -- # IFS=.-: 00:28:31.543 20:29:36 -- scripts/common.sh@336 -- # read -ra ver2 00:28:31.543 20:29:36 -- scripts/common.sh@337 -- # local 'op=<' 00:28:31.543 20:29:36 -- scripts/common.sh@339 -- # ver1_l=2 00:28:31.543 20:29:36 -- scripts/common.sh@340 -- # ver2_l=1 00:28:31.543 20:29:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:31.543 20:29:36 -- scripts/common.sh@343 -- # case "$op" in 00:28:31.543 20:29:36 -- scripts/common.sh@344 -- # : 1 00:28:31.543 20:29:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:31.543 20:29:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:31.543 20:29:36 -- scripts/common.sh@364 -- # decimal 1 00:28:31.543 20:29:36 -- scripts/common.sh@352 -- # local d=1 00:28:31.543 20:29:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:31.543 20:29:36 -- scripts/common.sh@354 -- # echo 1 00:28:31.543 20:29:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:31.543 20:29:36 -- scripts/common.sh@365 -- # decimal 2 00:28:31.543 20:29:36 -- scripts/common.sh@352 -- # local d=2 00:28:31.543 20:29:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:31.543 20:29:36 -- scripts/common.sh@354 -- # echo 2 00:28:31.543 20:29:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:31.543 20:29:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:31.543 20:29:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:31.543 20:29:36 -- scripts/common.sh@367 -- # return 0 00:28:31.543 20:29:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:31.543 20:29:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:31.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.543 --rc genhtml_branch_coverage=1 00:28:31.543 --rc genhtml_function_coverage=1 00:28:31.543 --rc genhtml_legend=1 00:28:31.543 --rc geninfo_all_blocks=1 00:28:31.543 --rc geninfo_unexecuted_blocks=1 00:28:31.543 00:28:31.543 ' 00:28:31.543 20:29:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:31.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.543 --rc genhtml_branch_coverage=1 00:28:31.543 --rc genhtml_function_coverage=1 00:28:31.543 --rc genhtml_legend=1 00:28:31.543 --rc geninfo_all_blocks=1 00:28:31.543 --rc geninfo_unexecuted_blocks=1 00:28:31.543 00:28:31.543 ' 00:28:31.543 20:29:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:31.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.543 --rc genhtml_branch_coverage=1 00:28:31.543 --rc genhtml_function_coverage=1 00:28:31.543 --rc genhtml_legend=1 00:28:31.543 --rc geninfo_all_blocks=1 00:28:31.543 --rc geninfo_unexecuted_blocks=1 00:28:31.543 00:28:31.543 ' 00:28:31.543 20:29:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:31.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.543 --rc genhtml_branch_coverage=1 00:28:31.543 --rc genhtml_function_coverage=1 00:28:31.543 --rc genhtml_legend=1 00:28:31.543 --rc geninfo_all_blocks=1 00:28:31.543 --rc geninfo_unexecuted_blocks=1 00:28:31.543 00:28:31.543 ' 00:28:31.543 20:29:36 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:31.543 20:29:36 -- nvmf/common.sh@7 -- # uname -s 00:28:31.543 20:29:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:31.543 20:29:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:31.543 20:29:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:31.543 20:29:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:31.543 20:29:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:31.543 20:29:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:31.543 20:29:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:31.543 20:29:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:31.543 20:29:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:31.543 20:29:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:31.543 20:29:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:31.543 20:29:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:31.543 20:29:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:31.543 20:29:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:31.543 20:29:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:31.543 20:29:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:31.543 20:29:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:31.543 20:29:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:31.543 20:29:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:31.543 20:29:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.543 20:29:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.543 20:29:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.543 20:29:36 -- paths/export.sh@5 -- # export PATH 00:28:31.543 20:29:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.543 20:29:36 -- nvmf/common.sh@46 -- # : 0 00:28:31.543 20:29:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:31.543 20:29:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:31.543 20:29:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:31.544 20:29:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:31.544 20:29:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:31.544 20:29:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:31.544 20:29:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:31.544 20:29:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:31.544 20:29:36 -- target/dif.sh@15 -- # NULL_META=16 00:28:31.544 20:29:36 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:31.544 20:29:36 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:31.544 20:29:36 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:31.544 20:29:36 -- target/dif.sh@135 -- # nvmftestinit 00:28:31.544 20:29:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:31.544 20:29:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:31.544 20:29:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:31.544 20:29:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:31.544 20:29:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:31.544 20:29:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:31.544 20:29:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:31.544 20:29:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:31.544 20:29:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:31.544 20:29:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:31.544 20:29:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:31.544 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:28:33.448 20:29:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:33.448 20:29:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:33.448 20:29:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:33.448 20:29:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:33.448 20:29:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:33.448 20:29:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:33.448 20:29:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:33.448 20:29:38 -- nvmf/common.sh@294 -- # net_devs=() 00:28:33.448 20:29:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:33.448 20:29:38 -- nvmf/common.sh@295 -- # e810=() 00:28:33.448 20:29:38 -- nvmf/common.sh@295 -- # local -ga e810 00:28:33.448 20:29:38 -- nvmf/common.sh@296 -- # x722=() 00:28:33.448 20:29:38 -- nvmf/common.sh@296 -- # local -ga x722 00:28:33.448 20:29:38 -- nvmf/common.sh@297 -- # mlx=() 00:28:33.448 20:29:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:33.448 20:29:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:33.448 20:29:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:33.448 20:29:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:33.448 20:29:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:33.448 20:29:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:33.448 20:29:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:33.448 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:33.448 20:29:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:33.448 20:29:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:33.448 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:33.448 20:29:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:33.448 20:29:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:33.448 20:29:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:33.448 20:29:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:33.448 20:29:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:33.448 20:29:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:33.448 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:33.448 20:29:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:33.448 20:29:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:33.448 20:29:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:33.448 20:29:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:33.448 20:29:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:33.448 20:29:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:33.448 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:33.448 20:29:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:33.448 20:29:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:33.448 20:29:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:33.448 20:29:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:33.448 20:29:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:33.448 20:29:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:33.448 20:29:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:33.448 20:29:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:33.448 20:29:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:33.448 20:29:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:33.448 20:29:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:33.448 20:29:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:33.448 20:29:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:33.448 20:29:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:33.448 20:29:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:33.448 20:29:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:33.707 20:29:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:33.707 20:29:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:33.707 20:29:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:33.707 20:29:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:33.707 20:29:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:33.707 20:29:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:33.707 20:29:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:33.707 20:29:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:33.707 20:29:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:33.707 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:33.707 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:28:33.707 00:28:33.707 --- 10.0.0.2 ping statistics --- 00:28:33.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:33.707 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:28:33.707 20:29:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:33.707 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:33.707 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:28:33.707 00:28:33.707 --- 10.0.0.1 ping statistics --- 00:28:33.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:33.707 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:28:33.707 20:29:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:33.707 20:29:38 -- nvmf/common.sh@410 -- # return 0 00:28:33.707 20:29:38 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:33.707 20:29:38 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:34.641 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:34.641 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:34.641 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:34.641 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:34.641 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:34.641 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:34.641 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:34.641 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:34.641 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:34.641 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:34.641 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:34.641 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:34.641 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:34.641 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:34.641 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:34.641 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:34.641 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:34.898 20:29:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:34.898 20:29:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:34.898 20:29:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:34.898 20:29:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:34.898 20:29:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:34.898 20:29:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:34.898 20:29:39 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:34.898 20:29:39 -- target/dif.sh@137 -- # nvmfappstart 00:28:34.898 20:29:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:34.898 20:29:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:34.898 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:28:34.898 20:29:39 -- nvmf/common.sh@469 -- # nvmfpid=3290750 00:28:34.898 20:29:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:34.898 20:29:39 -- nvmf/common.sh@470 -- # waitforlisten 3290750 00:28:34.898 20:29:39 -- common/autotest_common.sh@829 -- # '[' -z 3290750 ']' 00:28:34.898 20:29:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:34.898 20:29:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:34.898 20:29:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:34.898 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:34.898 20:29:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:34.898 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:28:34.898 [2024-11-20 20:29:39.891277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:34.898 [2024-11-20 20:29:39.891374] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:34.898 EAL: No free 2048 kB hugepages reported on node 1 00:28:35.157 [2024-11-20 20:29:39.957541] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:35.157 [2024-11-20 20:29:40.075479] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:35.157 [2024-11-20 20:29:40.075659] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:35.157 [2024-11-20 20:29:40.075689] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:35.157 [2024-11-20 20:29:40.075711] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:35.157 [2024-11-20 20:29:40.075752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:36.092 20:29:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:36.092 20:29:40 -- common/autotest_common.sh@862 -- # return 0 00:28:36.092 20:29:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:36.092 20:29:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 20:29:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:36.092 20:29:40 -- target/dif.sh@139 -- # create_transport 00:28:36.092 20:29:40 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:36.092 20:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 [2024-11-20 20:29:40.921715] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:36.092 20:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.092 20:29:40 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:36.092 20:29:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:36.092 20:29:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 ************************************ 00:28:36.092 START TEST fio_dif_1_default 00:28:36.092 ************************************ 00:28:36.092 20:29:40 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:36.092 20:29:40 -- target/dif.sh@86 -- # create_subsystems 0 00:28:36.092 20:29:40 -- target/dif.sh@28 -- # local sub 00:28:36.092 20:29:40 -- target/dif.sh@30 -- # for sub in "$@" 00:28:36.092 20:29:40 -- target/dif.sh@31 -- # create_subsystem 0 00:28:36.092 20:29:40 -- target/dif.sh@18 -- # local sub_id=0 00:28:36.092 20:29:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:36.092 20:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 bdev_null0 00:28:36.092 20:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.092 20:29:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:36.092 20:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 20:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.092 20:29:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:36.092 20:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 20:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.092 20:29:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:36.092 20:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.092 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:28:36.092 [2024-11-20 20:29:40.958010] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:36.092 20:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.092 20:29:40 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:36.092 20:29:40 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:36.092 20:29:40 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:36.092 20:29:40 -- nvmf/common.sh@520 -- # config=() 00:28:36.092 20:29:40 -- nvmf/common.sh@520 -- # local subsystem config 00:28:36.092 20:29:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:36.092 20:29:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:36.092 { 00:28:36.092 "params": { 00:28:36.093 "name": "Nvme$subsystem", 00:28:36.093 "trtype": "$TEST_TRANSPORT", 00:28:36.093 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:36.093 "adrfam": "ipv4", 00:28:36.093 "trsvcid": "$NVMF_PORT", 00:28:36.093 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:36.093 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:36.093 "hdgst": ${hdgst:-false}, 00:28:36.093 "ddgst": ${ddgst:-false} 00:28:36.093 }, 00:28:36.093 "method": "bdev_nvme_attach_controller" 00:28:36.093 } 00:28:36.093 EOF 00:28:36.093 )") 00:28:36.093 20:29:40 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.093 20:29:40 -- target/dif.sh@82 -- # gen_fio_conf 00:28:36.093 20:29:40 -- target/dif.sh@54 -- # local file 00:28:36.093 20:29:40 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.093 20:29:40 -- target/dif.sh@56 -- # cat 00:28:36.093 20:29:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:36.093 20:29:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:36.093 20:29:40 -- nvmf/common.sh@542 -- # cat 00:28:36.093 20:29:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:36.093 20:29:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:36.093 20:29:40 -- common/autotest_common.sh@1330 -- # shift 00:28:36.093 20:29:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:36.093 20:29:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:36.093 20:29:40 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:36.093 20:29:40 -- target/dif.sh@72 -- # (( file <= files )) 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:36.093 20:29:40 -- nvmf/common.sh@544 -- # jq . 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:36.093 20:29:40 -- nvmf/common.sh@545 -- # IFS=, 00:28:36.093 20:29:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:36.093 "params": { 00:28:36.093 "name": "Nvme0", 00:28:36.093 "trtype": "tcp", 00:28:36.093 "traddr": "10.0.0.2", 00:28:36.093 "adrfam": "ipv4", 00:28:36.093 "trsvcid": "4420", 00:28:36.093 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:36.093 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:36.093 "hdgst": false, 00:28:36.093 "ddgst": false 00:28:36.093 }, 00:28:36.093 "method": "bdev_nvme_attach_controller" 00:28:36.093 }' 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:36.093 20:29:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:36.093 20:29:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:36.093 20:29:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:36.093 20:29:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:36.093 20:29:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:36.093 20:29:41 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:36.093 20:29:41 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.351 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:36.351 fio-3.35 00:28:36.351 Starting 1 thread 00:28:36.351 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.917 [2024-11-20 20:29:41.766276] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:36.917 [2024-11-20 20:29:41.766340] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:46.881 00:28:46.881 filename0: (groupid=0, jobs=1): err= 0: pid=3291110: Wed Nov 20 20:29:51 2024 00:28:46.881 read: IOPS=189, BW=759KiB/s (778kB/s)(7600KiB/10007msec) 00:28:46.881 slat (nsec): min=6531, max=33548, avg=8001.92, stdev=2314.24 00:28:46.881 clat (usec): min=574, max=47576, avg=21041.85, stdev=20353.70 00:28:46.881 lat (usec): min=581, max=47595, avg=21049.85, stdev=20353.45 00:28:46.881 clat percentiles (usec): 00:28:46.881 | 1.00th=[ 611], 5.00th=[ 619], 10.00th=[ 627], 20.00th=[ 635], 00:28:46.881 | 30.00th=[ 652], 40.00th=[ 676], 50.00th=[41157], 60.00th=[41157], 00:28:46.881 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:46.881 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47449], 99.95th=[47449], 00:28:46.881 | 99.99th=[47449] 00:28:46.881 bw ( KiB/s): min= 704, max= 768, per=99.81%, avg=758.40, stdev=23.45, samples=20 00:28:46.881 iops : min= 176, max= 192, avg=189.60, stdev= 5.86, samples=20 00:28:46.881 lat (usec) : 750=48.89%, 1000=1.00% 00:28:46.881 lat (msec) : 50=50.11% 00:28:46.881 cpu : usr=91.97%, sys=7.75%, ctx=19, majf=0, minf=264 00:28:46.881 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:46.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:46.881 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:46.881 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:46.881 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:46.881 00:28:46.881 Run status group 0 (all jobs): 00:28:46.881 READ: bw=759KiB/s (778kB/s), 759KiB/s-759KiB/s (778kB/s-778kB/s), io=7600KiB (7782kB), run=10007-10007msec 00:28:47.448 20:29:52 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:47.448 20:29:52 -- target/dif.sh@43 -- # local sub 00:28:47.448 20:29:52 -- target/dif.sh@45 -- # for sub in "$@" 00:28:47.448 20:29:52 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:47.448 20:29:52 -- target/dif.sh@36 -- # local sub_id=0 00:28:47.448 20:29:52 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 00:28:47.448 real 0m11.299s 00:28:47.448 user 0m10.458s 00:28:47.448 sys 0m1.056s 00:28:47.448 20:29:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 ************************************ 00:28:47.448 END TEST fio_dif_1_default 00:28:47.448 ************************************ 00:28:47.448 20:29:52 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:47.448 20:29:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:47.448 20:29:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 ************************************ 00:28:47.448 START TEST fio_dif_1_multi_subsystems 00:28:47.448 ************************************ 00:28:47.448 20:29:52 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:47.448 20:29:52 -- target/dif.sh@92 -- # local files=1 00:28:47.448 20:29:52 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:47.448 20:29:52 -- target/dif.sh@28 -- # local sub 00:28:47.448 20:29:52 -- target/dif.sh@30 -- # for sub in "$@" 00:28:47.448 20:29:52 -- target/dif.sh@31 -- # create_subsystem 0 00:28:47.448 20:29:52 -- target/dif.sh@18 -- # local sub_id=0 00:28:47.448 20:29:52 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 bdev_null0 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 [2024-11-20 20:29:52.289209] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@30 -- # for sub in "$@" 00:28:47.448 20:29:52 -- target/dif.sh@31 -- # create_subsystem 1 00:28:47.448 20:29:52 -- target/dif.sh@18 -- # local sub_id=1 00:28:47.448 20:29:52 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 bdev_null1 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.448 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.448 20:29:52 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:47.448 20:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.448 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.449 20:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.449 20:29:52 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:47.449 20:29:52 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.449 20:29:52 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.449 20:29:52 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:47.449 20:29:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:47.449 20:29:52 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:47.449 20:29:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:47.449 20:29:52 -- target/dif.sh@82 -- # gen_fio_conf 00:28:47.449 20:29:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:47.449 20:29:52 -- nvmf/common.sh@520 -- # config=() 00:28:47.449 20:29:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.449 20:29:52 -- nvmf/common.sh@520 -- # local subsystem config 00:28:47.449 20:29:52 -- common/autotest_common.sh@1330 -- # shift 00:28:47.449 20:29:52 -- target/dif.sh@54 -- # local file 00:28:47.449 20:29:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:47.449 20:29:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:47.449 20:29:52 -- target/dif.sh@56 -- # cat 00:28:47.449 20:29:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:47.449 20:29:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:47.449 { 00:28:47.449 "params": { 00:28:47.449 "name": "Nvme$subsystem", 00:28:47.449 "trtype": "$TEST_TRANSPORT", 00:28:47.449 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:47.449 "adrfam": "ipv4", 00:28:47.449 "trsvcid": "$NVMF_PORT", 00:28:47.449 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:47.449 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:47.449 "hdgst": ${hdgst:-false}, 00:28:47.449 "ddgst": ${ddgst:-false} 00:28:47.449 }, 00:28:47.449 "method": "bdev_nvme_attach_controller" 00:28:47.449 } 00:28:47.449 EOF 00:28:47.449 )") 00:28:47.449 20:29:52 -- nvmf/common.sh@542 -- # cat 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:47.449 20:29:52 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:47.449 20:29:52 -- target/dif.sh@72 -- # (( file <= files )) 00:28:47.449 20:29:52 -- target/dif.sh@73 -- # cat 00:28:47.449 20:29:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:47.449 20:29:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:47.449 { 00:28:47.449 "params": { 00:28:47.449 "name": "Nvme$subsystem", 00:28:47.449 "trtype": "$TEST_TRANSPORT", 00:28:47.449 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:47.449 "adrfam": "ipv4", 00:28:47.449 "trsvcid": "$NVMF_PORT", 00:28:47.449 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:47.449 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:47.449 "hdgst": ${hdgst:-false}, 00:28:47.449 "ddgst": ${ddgst:-false} 00:28:47.449 }, 00:28:47.449 "method": "bdev_nvme_attach_controller" 00:28:47.449 } 00:28:47.449 EOF 00:28:47.449 )") 00:28:47.449 20:29:52 -- target/dif.sh@72 -- # (( file++ )) 00:28:47.449 20:29:52 -- target/dif.sh@72 -- # (( file <= files )) 00:28:47.449 20:29:52 -- nvmf/common.sh@542 -- # cat 00:28:47.449 20:29:52 -- nvmf/common.sh@544 -- # jq . 00:28:47.449 20:29:52 -- nvmf/common.sh@545 -- # IFS=, 00:28:47.449 20:29:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:47.449 "params": { 00:28:47.449 "name": "Nvme0", 00:28:47.449 "trtype": "tcp", 00:28:47.449 "traddr": "10.0.0.2", 00:28:47.449 "adrfam": "ipv4", 00:28:47.449 "trsvcid": "4420", 00:28:47.449 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:47.449 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:47.449 "hdgst": false, 00:28:47.449 "ddgst": false 00:28:47.449 }, 00:28:47.449 "method": "bdev_nvme_attach_controller" 00:28:47.449 },{ 00:28:47.449 "params": { 00:28:47.449 "name": "Nvme1", 00:28:47.449 "trtype": "tcp", 00:28:47.449 "traddr": "10.0.0.2", 00:28:47.449 "adrfam": "ipv4", 00:28:47.449 "trsvcid": "4420", 00:28:47.449 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:47.449 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:47.449 "hdgst": false, 00:28:47.449 "ddgst": false 00:28:47.449 }, 00:28:47.449 "method": "bdev_nvme_attach_controller" 00:28:47.449 }' 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:47.449 20:29:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:47.449 20:29:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:47.449 20:29:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:47.449 20:29:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:47.449 20:29:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:47.449 20:29:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.707 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:47.707 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:47.707 fio-3.35 00:28:47.707 Starting 2 threads 00:28:47.707 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.640 [2024-11-20 20:29:53.419889] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:48.640 [2024-11-20 20:29:53.419948] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:58.603 00:28:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3292557: Wed Nov 20 20:30:03 2024 00:28:58.603 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10041msec) 00:28:58.603 slat (nsec): min=5106, max=44123, avg=8777.04, stdev=2833.12 00:28:58.603 clat (usec): min=558, max=42503, avg=21022.14, stdev=20282.18 00:28:58.603 lat (usec): min=565, max=42520, avg=21030.92, stdev=20281.90 00:28:58.603 clat percentiles (usec): 00:28:58.603 | 1.00th=[ 603], 5.00th=[ 619], 10.00th=[ 627], 20.00th=[ 644], 00:28:58.603 | 30.00th=[ 668], 40.00th=[ 725], 50.00th=[40633], 60.00th=[41157], 00:28:58.603 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:58.603 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:28:58.603 | 99.99th=[42730] 00:28:58.603 bw ( KiB/s): min= 704, max= 768, per=66.24%, avg=761.60, stdev=19.70, samples=20 00:28:58.603 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:28:58.603 lat (usec) : 750=40.25%, 1000=8.86% 00:28:58.603 lat (msec) : 2=0.79%, 50=50.10% 00:28:58.603 cpu : usr=95.49%, sys=4.21%, ctx=16, majf=0, minf=191 00:28:58.603 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.603 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:58.603 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:58.603 filename1: (groupid=0, jobs=1): err= 0: pid=3292558: Wed Nov 20 20:30:03 2024 00:28:58.603 read: IOPS=97, BW=389KiB/s (398kB/s)(3904KiB/10041msec) 00:28:58.603 slat (nsec): min=5070, max=27650, avg=9111.08, stdev=2824.73 00:28:58.603 clat (usec): min=672, max=43766, avg=41120.68, stdev=2645.51 00:28:58.603 lat (usec): min=679, max=43789, avg=41129.79, stdev=2645.58 00:28:58.603 clat percentiles (usec): 00:28:58.603 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:58.603 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:58.603 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:28:58.603 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43779], 99.95th=[43779], 00:28:58.603 | 99.99th=[43779] 00:28:58.603 bw ( KiB/s): min= 352, max= 416, per=33.77%, avg=388.80, stdev=15.66, samples=20 00:28:58.603 iops : min= 88, max= 104, avg=97.20, stdev= 3.91, samples=20 00:28:58.603 lat (usec) : 750=0.41% 00:28:58.603 lat (msec) : 50=99.59% 00:28:58.603 cpu : usr=95.32%, sys=4.37%, ctx=17, majf=0, minf=122 00:28:58.603 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.603 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:58.603 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:58.603 00:28:58.603 Run status group 0 (all jobs): 00:28:58.603 READ: bw=1149KiB/s (1176kB/s), 389KiB/s-760KiB/s (398kB/s-778kB/s), io=11.3MiB (11.8MB), run=10041-10041msec 00:28:58.861 20:30:03 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:58.861 20:30:03 -- target/dif.sh@43 -- # local sub 00:28:58.861 20:30:03 -- target/dif.sh@45 -- # for sub in "$@" 00:28:58.861 20:30:03 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:58.861 20:30:03 -- target/dif.sh@36 -- # local sub_id=0 00:28:58.861 20:30:03 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:58.861 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.861 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:58.861 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.861 20:30:03 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:58.861 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.861 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:58.861 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.861 20:30:03 -- target/dif.sh@45 -- # for sub in "$@" 00:28:58.861 20:30:03 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:58.861 20:30:03 -- target/dif.sh@36 -- # local sub_id=1 00:28:58.861 20:30:03 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:58.861 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.861 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:58.861 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.861 20:30:03 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:58.861 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.861 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.120 00:28:59.120 real 0m11.642s 00:28:59.120 user 0m20.729s 00:28:59.120 sys 0m1.181s 00:28:59.120 20:30:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:59.120 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 ************************************ 00:28:59.120 END TEST fio_dif_1_multi_subsystems 00:28:59.120 ************************************ 00:28:59.120 20:30:03 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:59.120 20:30:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:59.120 20:30:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:59.120 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 ************************************ 00:28:59.120 START TEST fio_dif_rand_params 00:28:59.120 ************************************ 00:28:59.120 20:30:03 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:59.120 20:30:03 -- target/dif.sh@100 -- # local NULL_DIF 00:28:59.120 20:30:03 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:59.120 20:30:03 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:59.120 20:30:03 -- target/dif.sh@103 -- # bs=128k 00:28:59.120 20:30:03 -- target/dif.sh@103 -- # numjobs=3 00:28:59.120 20:30:03 -- target/dif.sh@103 -- # iodepth=3 00:28:59.120 20:30:03 -- target/dif.sh@103 -- # runtime=5 00:28:59.120 20:30:03 -- target/dif.sh@105 -- # create_subsystems 0 00:28:59.120 20:30:03 -- target/dif.sh@28 -- # local sub 00:28:59.120 20:30:03 -- target/dif.sh@30 -- # for sub in "$@" 00:28:59.120 20:30:03 -- target/dif.sh@31 -- # create_subsystem 0 00:28:59.120 20:30:03 -- target/dif.sh@18 -- # local sub_id=0 00:28:59.120 20:30:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:59.120 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.120 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 bdev_null0 00:28:59.120 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.120 20:30:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:59.120 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.120 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.120 20:30:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:59.120 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.120 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.120 20:30:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:59.120 20:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.120 20:30:03 -- common/autotest_common.sh@10 -- # set +x 00:28:59.120 [2024-11-20 20:30:03.958612] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:59.120 20:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.120 20:30:03 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:59.120 20:30:03 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:59.120 20:30:03 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:59.120 20:30:03 -- nvmf/common.sh@520 -- # config=() 00:28:59.120 20:30:03 -- nvmf/common.sh@520 -- # local subsystem config 00:28:59.120 20:30:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:59.120 20:30:03 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.120 20:30:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:59.120 { 00:28:59.120 "params": { 00:28:59.120 "name": "Nvme$subsystem", 00:28:59.120 "trtype": "$TEST_TRANSPORT", 00:28:59.120 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:59.120 "adrfam": "ipv4", 00:28:59.120 "trsvcid": "$NVMF_PORT", 00:28:59.120 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:59.120 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:59.120 "hdgst": ${hdgst:-false}, 00:28:59.120 "ddgst": ${ddgst:-false} 00:28:59.120 }, 00:28:59.120 "method": "bdev_nvme_attach_controller" 00:28:59.120 } 00:28:59.120 EOF 00:28:59.120 )") 00:28:59.121 20:30:03 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.121 20:30:03 -- target/dif.sh@82 -- # gen_fio_conf 00:28:59.121 20:30:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:59.121 20:30:03 -- target/dif.sh@54 -- # local file 00:28:59.121 20:30:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:59.121 20:30:03 -- target/dif.sh@56 -- # cat 00:28:59.121 20:30:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:59.121 20:30:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.121 20:30:03 -- common/autotest_common.sh@1330 -- # shift 00:28:59.121 20:30:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:59.121 20:30:03 -- nvmf/common.sh@542 -- # cat 00:28:59.121 20:30:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.121 20:30:03 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:59.121 20:30:03 -- target/dif.sh@72 -- # (( file <= files )) 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.121 20:30:03 -- nvmf/common.sh@544 -- # jq . 00:28:59.121 20:30:03 -- nvmf/common.sh@545 -- # IFS=, 00:28:59.121 20:30:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:59.121 "params": { 00:28:59.121 "name": "Nvme0", 00:28:59.121 "trtype": "tcp", 00:28:59.121 "traddr": "10.0.0.2", 00:28:59.121 "adrfam": "ipv4", 00:28:59.121 "trsvcid": "4420", 00:28:59.121 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:59.121 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:59.121 "hdgst": false, 00:28:59.121 "ddgst": false 00:28:59.121 }, 00:28:59.121 "method": "bdev_nvme_attach_controller" 00:28:59.121 }' 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.121 20:30:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.121 20:30:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.121 20:30:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:59.121 20:30:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.121 20:30:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.121 20:30:04 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:59.121 20:30:04 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.380 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:59.380 ... 00:28:59.380 fio-3.35 00:28:59.380 Starting 3 threads 00:28:59.380 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.946 [2024-11-20 20:30:04.765657] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:59.946 [2024-11-20 20:30:04.765762] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:05.206 00:29:05.206 filename0: (groupid=0, jobs=1): err= 0: pid=3294107: Wed Nov 20 20:30:09 2024 00:29:05.206 read: IOPS=222, BW=27.8MiB/s (29.1MB/s)(140MiB/5034msec) 00:29:05.206 slat (nsec): min=7141, max=64312, avg=12273.61, stdev=2898.22 00:29:05.207 clat (usec): min=4510, max=57800, avg=13477.37, stdev=10330.13 00:29:05.207 lat (usec): min=4521, max=57818, avg=13489.64, stdev=10330.24 00:29:05.207 clat percentiles (usec): 00:29:05.207 | 1.00th=[ 4752], 5.00th=[ 5669], 10.00th=[ 7177], 20.00th=[ 8455], 00:29:05.207 | 30.00th=[ 9634], 40.00th=[10683], 50.00th=[11469], 60.00th=[11994], 00:29:05.207 | 70.00th=[12649], 80.00th=[13435], 90.00th=[15008], 95.00th=[47973], 00:29:05.207 | 99.00th=[53216], 99.50th=[54789], 99.90th=[56886], 99.95th=[57934], 00:29:05.207 | 99.99th=[57934] 00:29:05.207 bw ( KiB/s): min=23040, max=33536, per=35.02%, avg=28871.11, stdev=4022.90, samples=9 00:29:05.207 iops : min= 180, max= 262, avg=225.56, stdev=31.43, samples=9 00:29:05.207 lat (msec) : 10=32.62%, 20=60.41%, 50=3.57%, 100=3.40% 00:29:05.207 cpu : usr=92.33%, sys=7.19%, ctx=18, majf=0, minf=183 00:29:05.207 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.207 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.207 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.207 issued rwts: total=1119,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.207 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:05.207 filename0: (groupid=0, jobs=1): err= 0: pid=3294108: Wed Nov 20 20:30:09 2024 00:29:05.207 read: IOPS=202, BW=25.3MiB/s (26.6MB/s)(127MiB/5003msec) 00:29:05.207 slat (nsec): min=6881, max=36071, avg=11990.95, stdev=2570.23 00:29:05.207 clat (usec): min=4044, max=56744, avg=14781.92, stdev=11032.51 00:29:05.207 lat (usec): min=4054, max=56757, avg=14793.91, stdev=11032.46 00:29:05.207 clat percentiles (usec): 00:29:05.207 | 1.00th=[ 5276], 5.00th=[ 6128], 10.00th=[ 7767], 20.00th=[ 9372], 00:29:05.207 | 30.00th=[10814], 40.00th=[11469], 50.00th=[11994], 60.00th=[12780], 00:29:05.207 | 70.00th=[13566], 80.00th=[14484], 90.00th=[16712], 95.00th=[49021], 00:29:05.207 | 99.00th=[52691], 99.50th=[53740], 99.90th=[55313], 99.95th=[56886], 00:29:05.207 | 99.99th=[56886] 00:29:05.207 bw ( KiB/s): min=19968, max=31232, per=32.81%, avg=27050.67, stdev=4087.99, samples=9 00:29:05.207 iops : min= 156, max= 244, avg=211.33, stdev=31.94, samples=9 00:29:05.207 lat (msec) : 10=23.47%, 20=67.95%, 50=4.54%, 100=4.04% 00:29:05.207 cpu : usr=92.82%, sys=6.70%, ctx=12, majf=0, minf=107 00:29:05.207 IO depths : 1=1.9%, 2=98.1%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.207 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.207 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.207 issued rwts: total=1014,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.207 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:05.207 filename0: (groupid=0, jobs=1): err= 0: pid=3294109: Wed Nov 20 20:30:09 2024 00:29:05.207 read: IOPS=221, BW=27.7MiB/s (29.0MB/s)(140MiB/5044msec) 00:29:05.207 slat (nsec): min=7158, max=35856, avg=12454.47, stdev=2724.54 00:29:05.207 clat (usec): min=4577, max=89293, avg=13504.02, stdev=9922.49 00:29:05.207 lat (usec): min=4590, max=89306, avg=13516.47, stdev=9922.42 00:29:05.207 clat percentiles (usec): 00:29:05.207 | 1.00th=[ 5014], 5.00th=[ 5538], 10.00th=[ 6718], 20.00th=[ 8455], 00:29:05.207 | 30.00th=[ 9372], 40.00th=[10814], 50.00th=[11600], 60.00th=[12518], 00:29:05.207 | 70.00th=[13435], 80.00th=[14353], 90.00th=[16188], 95.00th=[46924], 00:29:05.207 | 99.00th=[52691], 99.50th=[54264], 99.90th=[55313], 99.95th=[89654], 00:29:05.207 | 99.99th=[89654] 00:29:05.207 bw ( KiB/s): min=13824, max=33280, per=34.59%, avg=28523.90, stdev=5859.74, samples=10 00:29:05.207 iops : min= 108, max= 260, avg=222.80, stdev=45.78, samples=10 00:29:05.207 lat (msec) : 10=34.32%, 20=59.41%, 50=3.58%, 100=2.69% 00:29:05.207 cpu : usr=92.43%, sys=7.10%, ctx=10, majf=0, minf=98 00:29:05.207 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.207 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.207 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.207 issued rwts: total=1116,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.207 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:05.207 00:29:05.207 Run status group 0 (all jobs): 00:29:05.207 READ: bw=80.5MiB/s (84.4MB/s), 25.3MiB/s-27.8MiB/s (26.6MB/s-29.1MB/s), io=406MiB (426MB), run=5003-5044msec 00:29:05.207 20:30:10 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:05.207 20:30:10 -- target/dif.sh@43 -- # local sub 00:29:05.207 20:30:10 -- target/dif.sh@45 -- # for sub in "$@" 00:29:05.207 20:30:10 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:05.207 20:30:10 -- target/dif.sh@36 -- # local sub_id=0 00:29:05.207 20:30:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:05.207 20:30:10 -- target/dif.sh@109 -- # bs=4k 00:29:05.207 20:30:10 -- target/dif.sh@109 -- # numjobs=8 00:29:05.207 20:30:10 -- target/dif.sh@109 -- # iodepth=16 00:29:05.207 20:30:10 -- target/dif.sh@109 -- # runtime= 00:29:05.207 20:30:10 -- target/dif.sh@109 -- # files=2 00:29:05.207 20:30:10 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:05.207 20:30:10 -- target/dif.sh@28 -- # local sub 00:29:05.207 20:30:10 -- target/dif.sh@30 -- # for sub in "$@" 00:29:05.207 20:30:10 -- target/dif.sh@31 -- # create_subsystem 0 00:29:05.207 20:30:10 -- target/dif.sh@18 -- # local sub_id=0 00:29:05.207 20:30:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 bdev_null0 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 [2024-11-20 20:30:10.197087] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@30 -- # for sub in "$@" 00:29:05.207 20:30:10 -- target/dif.sh@31 -- # create_subsystem 1 00:29:05.207 20:30:10 -- target/dif.sh@18 -- # local sub_id=1 00:29:05.207 20:30:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 bdev_null1 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@30 -- # for sub in "$@" 00:29:05.207 20:30:10 -- target/dif.sh@31 -- # create_subsystem 2 00:29:05.207 20:30:10 -- target/dif.sh@18 -- # local sub_id=2 00:29:05.207 20:30:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.207 bdev_null2 00:29:05.207 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.207 20:30:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:05.207 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.207 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.468 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.468 20:30:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:05.468 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.468 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.468 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.468 20:30:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:05.468 20:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.468 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:05.468 20:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.468 20:30:10 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:05.468 20:30:10 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:05.468 20:30:10 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:05.468 20:30:10 -- nvmf/common.sh@520 -- # config=() 00:29:05.468 20:30:10 -- nvmf/common.sh@520 -- # local subsystem config 00:29:05.468 20:30:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:05.468 20:30:10 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.468 20:30:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:05.468 { 00:29:05.468 "params": { 00:29:05.468 "name": "Nvme$subsystem", 00:29:05.468 "trtype": "$TEST_TRANSPORT", 00:29:05.468 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:05.468 "adrfam": "ipv4", 00:29:05.468 "trsvcid": "$NVMF_PORT", 00:29:05.468 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:05.468 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:05.468 "hdgst": ${hdgst:-false}, 00:29:05.468 "ddgst": ${ddgst:-false} 00:29:05.468 }, 00:29:05.468 "method": "bdev_nvme_attach_controller" 00:29:05.468 } 00:29:05.468 EOF 00:29:05.468 )") 00:29:05.468 20:30:10 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.468 20:30:10 -- target/dif.sh@82 -- # gen_fio_conf 00:29:05.468 20:30:10 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:05.468 20:30:10 -- target/dif.sh@54 -- # local file 00:29:05.468 20:30:10 -- target/dif.sh@56 -- # cat 00:29:05.468 20:30:10 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:05.468 20:30:10 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:05.468 20:30:10 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.468 20:30:10 -- common/autotest_common.sh@1330 -- # shift 00:29:05.468 20:30:10 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:05.468 20:30:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.468 20:30:10 -- nvmf/common.sh@542 -- # cat 00:29:05.468 20:30:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.468 20:30:10 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:05.468 20:30:10 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:05.468 20:30:10 -- target/dif.sh@72 -- # (( file <= files )) 00:29:05.468 20:30:10 -- target/dif.sh@73 -- # cat 00:29:05.468 20:30:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.468 20:30:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:05.468 20:30:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:05.468 { 00:29:05.468 "params": { 00:29:05.468 "name": "Nvme$subsystem", 00:29:05.469 "trtype": "$TEST_TRANSPORT", 00:29:05.469 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:05.469 "adrfam": "ipv4", 00:29:05.469 "trsvcid": "$NVMF_PORT", 00:29:05.469 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:05.469 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:05.469 "hdgst": ${hdgst:-false}, 00:29:05.469 "ddgst": ${ddgst:-false} 00:29:05.469 }, 00:29:05.469 "method": "bdev_nvme_attach_controller" 00:29:05.469 } 00:29:05.469 EOF 00:29:05.469 )") 00:29:05.469 20:30:10 -- nvmf/common.sh@542 -- # cat 00:29:05.469 20:30:10 -- target/dif.sh@72 -- # (( file++ )) 00:29:05.469 20:30:10 -- target/dif.sh@72 -- # (( file <= files )) 00:29:05.469 20:30:10 -- target/dif.sh@73 -- # cat 00:29:05.469 20:30:10 -- target/dif.sh@72 -- # (( file++ )) 00:29:05.469 20:30:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:05.469 20:30:10 -- target/dif.sh@72 -- # (( file <= files )) 00:29:05.469 20:30:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:05.469 { 00:29:05.469 "params": { 00:29:05.469 "name": "Nvme$subsystem", 00:29:05.469 "trtype": "$TEST_TRANSPORT", 00:29:05.469 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:05.469 "adrfam": "ipv4", 00:29:05.469 "trsvcid": "$NVMF_PORT", 00:29:05.469 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:05.469 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:05.469 "hdgst": ${hdgst:-false}, 00:29:05.469 "ddgst": ${ddgst:-false} 00:29:05.469 }, 00:29:05.469 "method": "bdev_nvme_attach_controller" 00:29:05.469 } 00:29:05.469 EOF 00:29:05.469 )") 00:29:05.469 20:30:10 -- nvmf/common.sh@542 -- # cat 00:29:05.469 20:30:10 -- nvmf/common.sh@544 -- # jq . 00:29:05.469 20:30:10 -- nvmf/common.sh@545 -- # IFS=, 00:29:05.469 20:30:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:05.469 "params": { 00:29:05.469 "name": "Nvme0", 00:29:05.469 "trtype": "tcp", 00:29:05.469 "traddr": "10.0.0.2", 00:29:05.469 "adrfam": "ipv4", 00:29:05.469 "trsvcid": "4420", 00:29:05.469 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:05.469 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:05.469 "hdgst": false, 00:29:05.469 "ddgst": false 00:29:05.469 }, 00:29:05.469 "method": "bdev_nvme_attach_controller" 00:29:05.469 },{ 00:29:05.469 "params": { 00:29:05.469 "name": "Nvme1", 00:29:05.469 "trtype": "tcp", 00:29:05.469 "traddr": "10.0.0.2", 00:29:05.469 "adrfam": "ipv4", 00:29:05.469 "trsvcid": "4420", 00:29:05.469 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:05.469 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:05.469 "hdgst": false, 00:29:05.469 "ddgst": false 00:29:05.469 }, 00:29:05.469 "method": "bdev_nvme_attach_controller" 00:29:05.469 },{ 00:29:05.469 "params": { 00:29:05.469 "name": "Nvme2", 00:29:05.469 "trtype": "tcp", 00:29:05.469 "traddr": "10.0.0.2", 00:29:05.469 "adrfam": "ipv4", 00:29:05.469 "trsvcid": "4420", 00:29:05.469 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:05.469 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:05.469 "hdgst": false, 00:29:05.469 "ddgst": false 00:29:05.469 }, 00:29:05.469 "method": "bdev_nvme_attach_controller" 00:29:05.469 }' 00:29:05.469 20:30:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.469 20:30:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.469 20:30:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.469 20:30:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.469 20:30:10 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:05.469 20:30:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.469 20:30:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.469 20:30:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.469 20:30:10 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:05.469 20:30:10 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.727 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.727 ... 00:29:05.727 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.727 ... 00:29:05.727 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.727 ... 00:29:05.727 fio-3.35 00:29:05.727 Starting 24 threads 00:29:05.727 EAL: No free 2048 kB hugepages reported on node 1 00:29:06.663 [2024-11-20 20:30:11.452174] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:06.663 [2024-11-20 20:30:11.452231] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:18.868 00:29:18.868 filename0: (groupid=0, jobs=1): err= 0: pid=3295507: Wed Nov 20 20:30:21 2024 00:29:18.868 read: IOPS=61, BW=245KiB/s (251kB/s)(2496KiB/10196msec) 00:29:18.868 slat (nsec): min=3730, max=38304, avg=11319.59, stdev=5326.38 00:29:18.868 clat (msec): min=3, max=345, avg=261.33, stdev=81.89 00:29:18.868 lat (msec): min=3, max=345, avg=261.34, stdev=81.89 00:29:18.868 clat percentiles (msec): 00:29:18.868 | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 197], 20.00th=[ 234], 00:29:18.868 | 30.00th=[ 262], 40.00th=[ 266], 50.00th=[ 279], 60.00th=[ 296], 00:29:18.868 | 70.00th=[ 300], 80.00th=[ 317], 90.00th=[ 330], 95.00th=[ 334], 00:29:18.868 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], 00:29:18.868 | 99.99th=[ 347] 00:29:18.868 bw ( KiB/s): min= 128, max= 640, per=5.35%, avg=243.20, stdev=109.09, samples=20 00:29:18.868 iops : min= 32, max= 160, avg=60.80, stdev=27.27, samples=20 00:29:18.868 lat (msec) : 4=1.12%, 10=4.01%, 20=2.56%, 250=12.82%, 500=79.49% 00:29:18.868 cpu : usr=98.58%, sys=1.01%, ctx=18, majf=0, minf=38 00:29:18.868 IO depths : 1=5.9%, 2=12.0%, 4=24.4%, 8=51.0%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:18.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.868 complete : 0=0.0%, 4=94.0%, 8=0.3%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.868 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.868 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.868 filename0: (groupid=0, jobs=1): err= 0: pid=3295508: Wed Nov 20 20:30:21 2024 00:29:18.868 read: IOPS=45, BW=182KiB/s (187kB/s)(1856KiB/10180msec) 00:29:18.868 slat (usec): min=8, max=140, avg=46.91, stdev=45.25 00:29:18.868 clat (msec): min=217, max=605, avg=349.66, stdev=83.59 00:29:18.868 lat (msec): min=217, max=606, avg=349.70, stdev=83.63 00:29:18.868 clat percentiles (msec): 00:29:18.868 | 1.00th=[ 218], 5.00th=[ 255], 10.00th=[ 266], 20.00th=[ 279], 00:29:18.868 | 30.00th=[ 288], 40.00th=[ 300], 50.00th=[ 305], 60.00th=[ 372], 00:29:18.868 | 70.00th=[ 414], 80.00th=[ 443], 90.00th=[ 472], 95.00th=[ 485], 00:29:18.868 | 99.00th=[ 575], 99.50th=[ 584], 99.90th=[ 609], 99.95th=[ 609], 00:29:18.868 | 99.99th=[ 609] 00:29:18.868 bw ( KiB/s): min= 112, max= 256, per=3.94%, avg=179.20, stdev=58.18, samples=20 00:29:18.868 iops : min= 28, max= 64, avg=44.80, stdev=14.54, samples=20 00:29:18.868 lat (msec) : 250=3.45%, 500=94.83%, 750=1.72% 00:29:18.868 cpu : usr=98.81%, sys=0.71%, ctx=23, majf=0, minf=29 00:29:18.868 IO depths : 1=1.7%, 2=6.0%, 4=19.2%, 8=62.3%, 16=10.8%, 32=0.0%, >=64=0.0% 00:29:18.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.868 complete : 0=0.0%, 4=92.4%, 8=1.9%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.868 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.868 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.868 filename0: (groupid=0, jobs=1): err= 0: pid=3295509: Wed Nov 20 20:30:21 2024 00:29:18.868 read: IOPS=57, BW=232KiB/s (237kB/s)(2360KiB/10190msec) 00:29:18.868 slat (nsec): min=8107, max=74516, avg=12867.73, stdev=7485.23 00:29:18.868 clat (msec): min=13, max=345, avg=275.85, stdev=56.51 00:29:18.868 lat (msec): min=13, max=345, avg=275.86, stdev=56.51 00:29:18.868 clat percentiles (msec): 00:29:18.868 | 1.00th=[ 14], 5.00th=[ 197], 10.00th=[ 222], 20.00th=[ 257], 00:29:18.868 | 30.00th=[ 264], 40.00th=[ 275], 50.00th=[ 284], 60.00th=[ 296], 00:29:18.868 | 70.00th=[ 300], 80.00th=[ 317], 90.00th=[ 321], 95.00th=[ 334], 00:29:18.868 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], 00:29:18.868 | 99.99th=[ 347] 00:29:18.868 bw ( KiB/s): min= 144, max= 384, per=5.04%, avg=229.60, stdev=59.25, samples=20 00:29:18.868 iops : min= 36, max= 96, avg=57.40, stdev=14.81, samples=20 00:29:18.868 lat (msec) : 20=2.71%, 250=13.22%, 500=84.07% 00:29:18.868 cpu : usr=98.96%, sys=0.53%, ctx=48, majf=0, minf=57 00:29:18.868 IO depths : 1=0.3%, 2=6.6%, 4=25.1%, 8=55.9%, 16=12.0%, 32=0.0%, >=64=0.0% 00:29:18.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.868 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.868 issued rwts: total=590,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.868 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.868 filename0: (groupid=0, jobs=1): err= 0: pid=3295510: Wed Nov 20 20:30:21 2024 00:29:18.868 read: IOPS=51, BW=208KiB/s (213kB/s)(2112KiB/10173msec) 00:29:18.868 slat (usec): min=6, max=122, avg=12.80, stdev= 9.26 00:29:18.868 clat (msec): min=217, max=546, avg=307.26, stdev=58.62 00:29:18.868 lat (msec): min=217, max=546, avg=307.28, stdev=58.62 00:29:18.868 clat percentiles (msec): 00:29:18.868 | 1.00th=[ 218], 5.00th=[ 257], 10.00th=[ 262], 20.00th=[ 266], 00:29:18.868 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 305], 00:29:18.868 | 70.00th=[ 317], 80.00th=[ 321], 90.00th=[ 347], 95.00th=[ 443], 00:29:18.869 | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], 00:29:18.869 | 99.99th=[ 550] 00:29:18.869 bw ( KiB/s): min= 128, max= 256, per=4.73%, avg=215.58, stdev=56.03, samples=19 00:29:18.869 iops : min= 32, max= 64, avg=53.89, stdev=14.01, samples=19 00:29:18.869 lat (msec) : 250=3.41%, 500=93.56%, 750=3.03% 00:29:18.869 cpu : usr=98.62%, sys=0.78%, ctx=20, majf=0, minf=26 00:29:18.869 IO depths : 1=3.0%, 2=9.3%, 4=25.0%, 8=53.2%, 16=9.5%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename0: (groupid=0, jobs=1): err= 0: pid=3295511: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=36, BW=145KiB/s (148kB/s)(1472KiB/10163msec) 00:29:18.869 slat (usec): min=8, max=110, avg=23.17, stdev=18.93 00:29:18.869 clat (msec): min=301, max=610, avg=441.67, stdev=55.51 00:29:18.869 lat (msec): min=301, max=610, avg=441.69, stdev=55.51 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 305], 5.00th=[ 330], 10.00th=[ 380], 20.00th=[ 426], 00:29:18.869 | 30.00th=[ 430], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 443], 00:29:18.869 | 70.00th=[ 447], 80.00th=[ 456], 90.00th=[ 498], 95.00th=[ 584], 00:29:18.869 | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], 00:29:18.869 | 99.99th=[ 609] 00:29:18.869 bw ( KiB/s): min= 112, max= 256, per=3.26%, avg=148.21, stdev=46.45, samples=19 00:29:18.869 iops : min= 28, max= 64, avg=37.05, stdev=11.61, samples=19 00:29:18.869 lat (msec) : 500=93.48%, 750=6.52% 00:29:18.869 cpu : usr=98.34%, sys=0.94%, ctx=32, majf=0, minf=31 00:29:18.869 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename0: (groupid=0, jobs=1): err= 0: pid=3295512: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=51, BW=204KiB/s (209kB/s)(2080KiB/10180msec) 00:29:18.869 slat (usec): min=7, max=143, avg=22.72, stdev=31.50 00:29:18.869 clat (msec): min=209, max=445, avg=311.31, stdev=45.22 00:29:18.869 lat (msec): min=209, max=445, avg=311.33, stdev=45.24 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 209], 5.00th=[ 268], 10.00th=[ 275], 20.00th=[ 279], 00:29:18.869 | 30.00th=[ 284], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 309], 00:29:18.869 | 70.00th=[ 317], 80.00th=[ 338], 90.00th=[ 380], 95.00th=[ 418], 00:29:18.869 | 99.00th=[ 430], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], 00:29:18.869 | 99.99th=[ 447] 00:29:18.869 bw ( KiB/s): min= 128, max= 256, per=4.42%, avg=201.60, stdev=47.41, samples=20 00:29:18.869 iops : min= 32, max= 64, avg=50.40, stdev=11.85, samples=20 00:29:18.869 lat (msec) : 250=1.15%, 500=98.85% 00:29:18.869 cpu : usr=98.85%, sys=0.67%, ctx=15, majf=0, minf=30 00:29:18.869 IO depths : 1=1.2%, 2=3.1%, 4=11.7%, 8=72.5%, 16=11.5%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=90.2%, 8=4.5%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename0: (groupid=0, jobs=1): err= 0: pid=3295513: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=36, BW=145KiB/s (148kB/s)(1472KiB/10163msec) 00:29:18.869 slat (usec): min=5, max=119, avg=30.73, stdev=37.28 00:29:18.869 clat (msec): min=262, max=754, avg=441.60, stdev=62.36 00:29:18.869 lat (msec): min=262, max=754, avg=441.63, stdev=62.36 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 279], 5.00th=[ 330], 10.00th=[ 380], 20.00th=[ 426], 00:29:18.869 | 30.00th=[ 430], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 443], 00:29:18.869 | 70.00th=[ 447], 80.00th=[ 456], 90.00th=[ 498], 95.00th=[ 584], 00:29:18.869 | 99.00th=[ 609], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], 00:29:18.869 | 99.99th=[ 751] 00:29:18.869 bw ( KiB/s): min= 112, max= 256, per=3.26%, avg=148.21, stdev=48.54, samples=19 00:29:18.869 iops : min= 28, max= 64, avg=37.05, stdev=12.14, samples=19 00:29:18.869 lat (msec) : 500=92.93%, 750=6.52%, 1000=0.54% 00:29:18.869 cpu : usr=98.38%, sys=0.97%, ctx=44, majf=0, minf=29 00:29:18.869 IO depths : 1=4.6%, 2=10.9%, 4=25.0%, 8=51.6%, 16=7.9%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename0: (groupid=0, jobs=1): err= 0: pid=3295514: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=55, BW=220KiB/s (225kB/s)(2240KiB/10179msec) 00:29:18.869 slat (nsec): min=7832, max=58511, avg=10661.98, stdev=4878.62 00:29:18.869 clat (msec): min=199, max=352, avg=289.88, stdev=33.14 00:29:18.869 lat (msec): min=199, max=352, avg=289.89, stdev=33.14 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 201], 5.00th=[ 218], 10.00th=[ 262], 20.00th=[ 264], 00:29:18.869 | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 296], 60.00th=[ 300], 00:29:18.869 | 70.00th=[ 309], 80.00th=[ 317], 90.00th=[ 334], 95.00th=[ 338], 00:29:18.869 | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 355], 99.95th=[ 355], 00:29:18.869 | 99.99th=[ 355] 00:29:18.869 bw ( KiB/s): min= 128, max= 256, per=4.77%, avg=217.60, stdev=53.55, samples=20 00:29:18.869 iops : min= 32, max= 64, avg=54.40, stdev=13.39, samples=20 00:29:18.869 lat (msec) : 250=8.21%, 500=91.79% 00:29:18.869 cpu : usr=98.05%, sys=1.23%, ctx=65, majf=0, minf=33 00:29:18.869 IO depths : 1=0.7%, 2=7.0%, 4=25.0%, 8=55.5%, 16=11.8%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename1: (groupid=0, jobs=1): err= 0: pid=3295515: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=37, BW=151KiB/s (155kB/s)(1536KiB/10176msec) 00:29:18.869 slat (nsec): min=5859, max=85644, avg=12410.55, stdev=7222.46 00:29:18.869 clat (msec): min=209, max=619, avg=423.77, stdev=69.93 00:29:18.869 lat (msec): min=209, max=619, avg=423.79, stdev=69.93 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 209], 5.00th=[ 234], 10.00th=[ 372], 20.00th=[ 414], 00:29:18.869 | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 439], 60.00th=[ 443], 00:29:18.869 | 70.00th=[ 451], 80.00th=[ 460], 90.00th=[ 468], 95.00th=[ 485], 00:29:18.869 | 99.00th=[ 550], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], 00:29:18.869 | 99.99th=[ 617] 00:29:18.869 bw ( KiB/s): min= 128, max= 256, per=3.39%, avg=154.95, stdev=53.61, samples=19 00:29:18.869 iops : min= 32, max= 64, avg=38.74, stdev=13.40, samples=19 00:29:18.869 lat (msec) : 250=7.81%, 500=88.02%, 750=4.17% 00:29:18.869 cpu : usr=98.73%, sys=0.79%, ctx=28, majf=0, minf=41 00:29:18.869 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename1: (groupid=0, jobs=1): err= 0: pid=3295516: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=53, BW=214KiB/s (220kB/s)(2176KiB/10146msec) 00:29:18.869 slat (nsec): min=7995, max=33760, avg=11500.85, stdev=4933.17 00:29:18.869 clat (msec): min=233, max=438, avg=298.29, stdev=39.22 00:29:18.869 lat (msec): min=233, max=438, avg=298.30, stdev=39.22 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 234], 5.00th=[ 255], 10.00th=[ 257], 20.00th=[ 262], 00:29:18.869 | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 296], 60.00th=[ 300], 00:29:18.869 | 70.00th=[ 317], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 372], 00:29:18.869 | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], 00:29:18.869 | 99.99th=[ 439] 00:29:18.869 bw ( KiB/s): min= 128, max= 256, per=4.64%, avg=211.20, stdev=62.64, samples=20 00:29:18.869 iops : min= 32, max= 64, avg=52.80, stdev=15.66, samples=20 00:29:18.869 lat (msec) : 250=2.94%, 500=97.06% 00:29:18.869 cpu : usr=98.99%, sys=0.61%, ctx=17, majf=0, minf=21 00:29:18.869 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename1: (groupid=0, jobs=1): err= 0: pid=3295517: Wed Nov 20 20:30:21 2024 00:29:18.869 read: IOPS=58, BW=232KiB/s (238kB/s)(2368KiB/10190msec) 00:29:18.869 slat (nsec): min=7991, max=42399, avg=12582.62, stdev=6160.44 00:29:18.869 clat (msec): min=12, max=345, avg=275.27, stdev=57.28 00:29:18.869 lat (msec): min=12, max=345, avg=275.28, stdev=57.28 00:29:18.869 clat percentiles (msec): 00:29:18.869 | 1.00th=[ 13], 5.00th=[ 197], 10.00th=[ 211], 20.00th=[ 257], 00:29:18.869 | 30.00th=[ 262], 40.00th=[ 271], 50.00th=[ 284], 60.00th=[ 296], 00:29:18.869 | 70.00th=[ 300], 80.00th=[ 317], 90.00th=[ 330], 95.00th=[ 334], 00:29:18.869 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], 00:29:18.869 | 99.99th=[ 347] 00:29:18.869 bw ( KiB/s): min= 128, max= 384, per=5.06%, avg=230.40, stdev=66.96, samples=20 00:29:18.869 iops : min= 32, max= 96, avg=57.60, stdev=16.74, samples=20 00:29:18.869 lat (msec) : 20=2.70%, 250=13.51%, 500=83.78% 00:29:18.869 cpu : usr=99.05%, sys=0.56%, ctx=28, majf=0, minf=46 00:29:18.869 IO depths : 1=6.1%, 2=12.2%, 4=24.3%, 8=51.0%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:18.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.869 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.869 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.869 filename1: (groupid=0, jobs=1): err= 0: pid=3295518: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=54, BW=220KiB/s (225kB/s)(2240KiB/10188msec) 00:29:18.870 slat (usec): min=3, max=138, avg=12.84, stdev=11.34 00:29:18.870 clat (msec): min=208, max=352, avg=290.12, stdev=32.50 00:29:18.870 lat (msec): min=208, max=352, avg=290.13, stdev=32.50 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 209], 5.00th=[ 218], 10.00th=[ 262], 20.00th=[ 264], 00:29:18.870 | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 296], 60.00th=[ 300], 00:29:18.870 | 70.00th=[ 313], 80.00th=[ 317], 90.00th=[ 334], 95.00th=[ 338], 00:29:18.870 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:29:18.870 | 99.99th=[ 355] 00:29:18.870 bw ( KiB/s): min= 128, max= 256, per=4.77%, avg=217.60, stdev=51.75, samples=20 00:29:18.870 iops : min= 32, max= 64, avg=54.40, stdev=12.94, samples=20 00:29:18.870 lat (msec) : 250=8.21%, 500=91.79% 00:29:18.870 cpu : usr=99.06%, sys=0.55%, ctx=16, majf=0, minf=34 00:29:18.870 IO depths : 1=1.1%, 2=7.3%, 4=25.0%, 8=55.2%, 16=11.4%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename1: (groupid=0, jobs=1): err= 0: pid=3295519: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=55, BW=221KiB/s (226kB/s)(2240KiB/10146msec) 00:29:18.870 slat (nsec): min=7815, max=36276, avg=11395.36, stdev=4685.75 00:29:18.870 clat (msec): min=200, max=352, avg=289.75, stdev=33.73 00:29:18.870 lat (msec): min=200, max=352, avg=289.76, stdev=33.73 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 201], 5.00th=[ 218], 10.00th=[ 262], 20.00th=[ 264], 00:29:18.870 | 30.00th=[ 268], 40.00th=[ 275], 50.00th=[ 296], 60.00th=[ 300], 00:29:18.870 | 70.00th=[ 313], 80.00th=[ 317], 90.00th=[ 334], 95.00th=[ 338], 00:29:18.870 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:29:18.870 | 99.99th=[ 355] 00:29:18.870 bw ( KiB/s): min= 128, max= 256, per=4.77%, avg=217.60, stdev=60.18, samples=20 00:29:18.870 iops : min= 32, max= 64, avg=54.40, stdev=15.05, samples=20 00:29:18.870 lat (msec) : 250=8.57%, 500=91.43% 00:29:18.870 cpu : usr=98.99%, sys=0.61%, ctx=16, majf=0, minf=35 00:29:18.870 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename1: (groupid=0, jobs=1): err= 0: pid=3295520: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=49, BW=200KiB/s (204kB/s)(2032KiB/10177msec) 00:29:18.870 slat (usec): min=6, max=124, avg=23.69, stdev=30.56 00:29:18.870 clat (msec): min=229, max=579, avg=319.31, stdev=55.61 00:29:18.870 lat (msec): min=229, max=579, avg=319.34, stdev=55.63 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 230], 5.00th=[ 268], 10.00th=[ 275], 20.00th=[ 279], 00:29:18.870 | 30.00th=[ 288], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 309], 00:29:18.870 | 70.00th=[ 334], 80.00th=[ 372], 90.00th=[ 397], 95.00th=[ 422], 00:29:18.870 | 99.00th=[ 489], 99.50th=[ 567], 99.90th=[ 584], 99.95th=[ 584], 00:29:18.870 | 99.99th=[ 584] 00:29:18.870 bw ( KiB/s): min= 128, max= 256, per=4.31%, avg=196.80, stdev=51.94, samples=20 00:29:18.870 iops : min= 32, max= 64, avg=49.20, stdev=12.98, samples=20 00:29:18.870 lat (msec) : 250=3.54%, 500=95.67%, 750=0.79% 00:29:18.870 cpu : usr=98.44%, sys=0.93%, ctx=31, majf=0, minf=24 00:29:18.870 IO depths : 1=1.0%, 2=3.3%, 4=13.2%, 8=70.9%, 16=11.6%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=90.7%, 8=3.9%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename1: (groupid=0, jobs=1): err= 0: pid=3295521: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=58, BW=233KiB/s (239kB/s)(2376KiB/10196msec) 00:29:18.870 slat (usec): min=4, max=138, avg=22.42, stdev=29.16 00:29:18.870 clat (msec): min=3, max=449, avg=272.81, stdev=88.22 00:29:18.870 lat (msec): min=3, max=449, avg=272.83, stdev=88.22 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 197], 20.00th=[ 259], 00:29:18.870 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 296], 00:29:18.870 | 70.00th=[ 300], 80.00th=[ 321], 90.00th=[ 347], 95.00th=[ 368], 00:29:18.870 | 99.00th=[ 435], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], 00:29:18.870 | 99.99th=[ 451] 00:29:18.870 bw ( KiB/s): min= 144, max= 513, per=5.08%, avg=231.25, stdev=77.10, samples=20 00:29:18.870 iops : min= 36, max= 128, avg=57.80, stdev=19.23, samples=20 00:29:18.870 lat (msec) : 4=1.18%, 10=4.55%, 20=2.36%, 250=8.42%, 500=83.50% 00:29:18.870 cpu : usr=98.98%, sys=0.60%, ctx=20, majf=0, minf=29 00:29:18.870 IO depths : 1=0.8%, 2=3.4%, 4=13.5%, 8=70.5%, 16=11.8%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=90.8%, 8=3.8%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=594,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename1: (groupid=0, jobs=1): err= 0: pid=3295522: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=37, BW=151KiB/s (155kB/s)(1536KiB/10177msec) 00:29:18.870 slat (nsec): min=3931, max=42045, avg=13643.03, stdev=7235.65 00:29:18.870 clat (msec): min=212, max=598, avg=423.88, stdev=76.99 00:29:18.870 lat (msec): min=212, max=598, avg=423.89, stdev=76.99 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 213], 5.00th=[ 264], 10.00th=[ 300], 20.00th=[ 376], 00:29:18.870 | 30.00th=[ 422], 40.00th=[ 430], 50.00th=[ 435], 60.00th=[ 439], 00:29:18.870 | 70.00th=[ 460], 80.00th=[ 472], 90.00th=[ 485], 95.00th=[ 550], 00:29:18.870 | 99.00th=[ 592], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], 00:29:18.870 | 99.99th=[ 600] 00:29:18.870 bw ( KiB/s): min= 112, max= 256, per=3.39%, avg=154.95, stdev=54.14, samples=19 00:29:18.870 iops : min= 28, max= 64, avg=38.74, stdev=13.54, samples=19 00:29:18.870 lat (msec) : 250=4.17%, 500=87.50%, 750=8.33% 00:29:18.870 cpu : usr=98.85%, sys=0.70%, ctx=21, majf=0, minf=25 00:29:18.870 IO depths : 1=3.6%, 2=9.9%, 4=25.0%, 8=52.6%, 16=8.9%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename2: (groupid=0, jobs=1): err= 0: pid=3295523: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=36, BW=145KiB/s (148kB/s)(1472KiB/10175msec) 00:29:18.870 slat (nsec): min=15982, max=49528, avg=28268.43, stdev=7137.62 00:29:18.870 clat (msec): min=262, max=763, avg=442.04, stdev=70.56 00:29:18.870 lat (msec): min=262, max=763, avg=442.07, stdev=70.56 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 271], 5.00th=[ 321], 10.00th=[ 334], 20.00th=[ 409], 00:29:18.870 | 30.00th=[ 430], 40.00th=[ 435], 50.00th=[ 439], 60.00th=[ 443], 00:29:18.870 | 70.00th=[ 447], 80.00th=[ 472], 90.00th=[ 498], 95.00th=[ 609], 00:29:18.870 | 99.00th=[ 617], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], 00:29:18.870 | 99.99th=[ 760] 00:29:18.870 bw ( KiB/s): min= 112, max= 256, per=3.26%, avg=148.21, stdev=44.25, samples=19 00:29:18.870 iops : min= 28, max= 64, avg=37.05, stdev=11.06, samples=19 00:29:18.870 lat (msec) : 500=90.22%, 750=9.24%, 1000=0.54% 00:29:18.870 cpu : usr=98.55%, sys=0.86%, ctx=9, majf=0, minf=25 00:29:18.870 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename2: (groupid=0, jobs=1): err= 0: pid=3295524: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=36, BW=145KiB/s (148kB/s)(1472KiB/10164msec) 00:29:18.870 slat (usec): min=4, max=1386, avg=25.78, stdev=71.57 00:29:18.870 clat (msec): min=209, max=610, avg=441.66, stdev=59.63 00:29:18.870 lat (msec): min=209, max=610, avg=441.69, stdev=59.64 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 257], 5.00th=[ 330], 10.00th=[ 380], 20.00th=[ 426], 00:29:18.870 | 30.00th=[ 430], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 443], 00:29:18.870 | 70.00th=[ 447], 80.00th=[ 468], 90.00th=[ 498], 95.00th=[ 592], 00:29:18.870 | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], 00:29:18.870 | 99.99th=[ 609] 00:29:18.870 bw ( KiB/s): min= 128, max= 256, per=3.26%, avg=148.21, stdev=47.95, samples=19 00:29:18.870 iops : min= 32, max= 64, avg=37.05, stdev=11.99, samples=19 00:29:18.870 lat (msec) : 250=0.54%, 500=91.85%, 750=7.61% 00:29:18.870 cpu : usr=99.02%, sys=0.59%, ctx=20, majf=0, minf=28 00:29:18.870 IO depths : 1=4.6%, 2=10.9%, 4=25.0%, 8=51.6%, 16=7.9%, 32=0.0%, >=64=0.0% 00:29:18.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.870 issued rwts: total=368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.870 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.870 filename2: (groupid=0, jobs=1): err= 0: pid=3295525: Wed Nov 20 20:30:21 2024 00:29:18.870 read: IOPS=36, BW=145KiB/s (148kB/s)(1472KiB/10166msec) 00:29:18.870 slat (usec): min=8, max=124, avg=52.06, stdev=35.09 00:29:18.870 clat (msec): min=317, max=613, avg=441.52, stdev=52.65 00:29:18.870 lat (msec): min=317, max=613, avg=441.57, stdev=52.65 00:29:18.870 clat percentiles (msec): 00:29:18.870 | 1.00th=[ 321], 5.00th=[ 330], 10.00th=[ 401], 20.00th=[ 426], 00:29:18.870 | 30.00th=[ 430], 40.00th=[ 435], 50.00th=[ 439], 60.00th=[ 443], 00:29:18.870 | 70.00th=[ 447], 80.00th=[ 456], 90.00th=[ 472], 95.00th=[ 584], 00:29:18.870 | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], 00:29:18.870 | 99.99th=[ 617] 00:29:18.870 bw ( KiB/s): min= 112, max= 256, per=3.26%, avg=148.21, stdev=48.25, samples=19 00:29:18.870 iops : min= 28, max= 64, avg=37.05, stdev=12.06, samples=19 00:29:18.870 lat (msec) : 500=94.57%, 750=5.43% 00:29:18.870 cpu : usr=98.31%, sys=1.00%, ctx=48, majf=0, minf=26 00:29:18.871 IO depths : 1=5.4%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.1%, 32=0.0%, >=64=0.0% 00:29:18.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 issued rwts: total=368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.871 filename2: (groupid=0, jobs=1): err= 0: pid=3295526: Wed Nov 20 20:30:21 2024 00:29:18.871 read: IOPS=49, BW=200KiB/s (204kB/s)(2032KiB/10180msec) 00:29:18.871 slat (usec): min=7, max=136, avg=29.91, stdev=38.31 00:29:18.871 clat (msec): min=201, max=549, avg=319.41, stdev=63.26 00:29:18.871 lat (msec): min=201, max=549, avg=319.44, stdev=63.29 00:29:18.871 clat percentiles (msec): 00:29:18.871 | 1.00th=[ 203], 5.00th=[ 228], 10.00th=[ 271], 20.00th=[ 279], 00:29:18.871 | 30.00th=[ 284], 40.00th=[ 288], 50.00th=[ 305], 60.00th=[ 321], 00:29:18.871 | 70.00th=[ 334], 80.00th=[ 372], 90.00th=[ 426], 95.00th=[ 443], 00:29:18.871 | 99.00th=[ 489], 99.50th=[ 531], 99.90th=[ 550], 99.95th=[ 550], 00:29:18.871 | 99.99th=[ 550] 00:29:18.871 bw ( KiB/s): min= 128, max= 256, per=4.31%, avg=196.80, stdev=54.22, samples=20 00:29:18.871 iops : min= 32, max= 64, avg=49.20, stdev=13.56, samples=20 00:29:18.871 lat (msec) : 250=7.48%, 500=91.73%, 750=0.79% 00:29:18.871 cpu : usr=98.36%, sys=1.00%, ctx=44, majf=0, minf=27 00:29:18.871 IO depths : 1=1.0%, 2=4.3%, 4=16.1%, 8=66.9%, 16=11.6%, 32=0.0%, >=64=0.0% 00:29:18.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 complete : 0=0.0%, 4=91.5%, 8=3.0%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 issued rwts: total=508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.871 filename2: (groupid=0, jobs=1): err= 0: pid=3295527: Wed Nov 20 20:30:21 2024 00:29:18.871 read: IOPS=37, BW=151KiB/s (155kB/s)(1536KiB/10170msec) 00:29:18.871 slat (usec): min=5, max=143, avg=31.73, stdev=31.99 00:29:18.871 clat (msec): min=212, max=618, avg=423.42, stdev=77.96 00:29:18.871 lat (msec): min=212, max=618, avg=423.46, stdev=77.95 00:29:18.871 clat percentiles (msec): 00:29:18.871 | 1.00th=[ 213], 5.00th=[ 262], 10.00th=[ 279], 20.00th=[ 376], 00:29:18.871 | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 435], 60.00th=[ 443], 00:29:18.871 | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 489], 95.00th=[ 542], 00:29:18.871 | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], 00:29:18.871 | 99.99th=[ 617] 00:29:18.871 bw ( KiB/s): min= 112, max= 256, per=3.39%, avg=154.95, stdev=52.27, samples=19 00:29:18.871 iops : min= 28, max= 64, avg=38.74, stdev=13.07, samples=19 00:29:18.871 lat (msec) : 250=4.17%, 500=86.98%, 750=8.85% 00:29:18.871 cpu : usr=98.72%, sys=0.75%, ctx=31, majf=0, minf=25 00:29:18.871 IO depths : 1=3.4%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.1%, 32=0.0%, >=64=0.0% 00:29:18.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.871 filename2: (groupid=0, jobs=1): err= 0: pid=3295528: Wed Nov 20 20:30:21 2024 00:29:18.871 read: IOPS=42, BW=170KiB/s (174kB/s)(1728KiB/10146msec) 00:29:18.871 slat (usec): min=8, max=141, avg=56.79, stdev=47.14 00:29:18.871 clat (msec): min=254, max=600, avg=375.30, stdev=81.76 00:29:18.871 lat (msec): min=254, max=600, avg=375.35, stdev=81.80 00:29:18.871 clat percentiles (msec): 00:29:18.871 | 1.00th=[ 255], 5.00th=[ 257], 10.00th=[ 262], 20.00th=[ 292], 00:29:18.871 | 30.00th=[ 300], 40.00th=[ 330], 50.00th=[ 401], 60.00th=[ 426], 00:29:18.871 | 70.00th=[ 439], 80.00th=[ 447], 90.00th=[ 468], 95.00th=[ 493], 00:29:18.871 | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 600], 99.95th=[ 600], 00:29:18.871 | 99.99th=[ 600] 00:29:18.871 bw ( KiB/s): min= 112, max= 256, per=3.65%, avg=166.40, stdev=58.82, samples=20 00:29:18.871 iops : min= 28, max= 64, avg=41.60, stdev=14.71, samples=20 00:29:18.871 lat (msec) : 500=98.15%, 750=1.85% 00:29:18.871 cpu : usr=98.72%, sys=0.80%, ctx=32, majf=0, minf=22 00:29:18.871 IO depths : 1=3.5%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.0%, 32=0.0%, >=64=0.0% 00:29:18.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.871 filename2: (groupid=0, jobs=1): err= 0: pid=3295529: Wed Nov 20 20:30:21 2024 00:29:18.871 read: IOPS=45, BW=182KiB/s (187kB/s)(1856KiB/10172msec) 00:29:18.871 slat (usec): min=7, max=131, avg=35.13, stdev=38.60 00:29:18.871 clat (msec): min=223, max=546, avg=349.43, stdev=80.74 00:29:18.871 lat (msec): min=223, max=546, avg=349.46, stdev=80.77 00:29:18.871 clat percentiles (msec): 00:29:18.871 | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 264], 20.00th=[ 279], 00:29:18.871 | 30.00th=[ 296], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 334], 00:29:18.871 | 70.00th=[ 414], 80.00th=[ 443], 90.00th=[ 468], 95.00th=[ 485], 00:29:18.871 | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], 00:29:18.871 | 99.99th=[ 550] 00:29:18.871 bw ( KiB/s): min= 128, max= 256, per=4.14%, avg=188.63, stdev=62.56, samples=19 00:29:18.871 iops : min= 32, max= 64, avg=47.16, stdev=15.64, samples=19 00:29:18.871 lat (msec) : 250=0.43%, 500=96.12%, 750=3.45% 00:29:18.871 cpu : usr=98.73%, sys=0.85%, ctx=13, majf=0, minf=25 00:29:18.871 IO depths : 1=3.0%, 2=9.3%, 4=25.0%, 8=53.2%, 16=9.5%, 32=0.0%, >=64=0.0% 00:29:18.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.871 filename2: (groupid=0, jobs=1): err= 0: pid=3295530: Wed Nov 20 20:30:21 2024 00:29:18.871 read: IOPS=53, BW=214KiB/s (219kB/s)(2176KiB/10180msec) 00:29:18.871 slat (usec): min=7, max=130, avg=20.80, stdev=28.21 00:29:18.871 clat (msec): min=201, max=413, avg=299.20, stdev=43.46 00:29:18.871 lat (msec): min=201, max=414, avg=299.22, stdev=43.48 00:29:18.871 clat percentiles (msec): 00:29:18.871 | 1.00th=[ 201], 5.00th=[ 211], 10.00th=[ 259], 20.00th=[ 264], 00:29:18.871 | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 300], 60.00th=[ 313], 00:29:18.871 | 70.00th=[ 317], 80.00th=[ 334], 90.00th=[ 351], 95.00th=[ 372], 00:29:18.871 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:18.871 | 99.99th=[ 414] 00:29:18.871 bw ( KiB/s): min= 128, max= 256, per=4.64%, avg=211.20, stdev=62.64, samples=20 00:29:18.871 iops : min= 32, max= 64, avg=52.80, stdev=15.66, samples=20 00:29:18.871 lat (msec) : 250=5.88%, 500=94.12% 00:29:18.871 cpu : usr=98.51%, sys=0.91%, ctx=35, majf=0, minf=32 00:29:18.871 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:18.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.871 issued rwts: total=544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.871 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.871 00:29:18.871 Run status group 0 (all jobs): 00:29:18.871 READ: bw=4545KiB/s (4654kB/s), 145KiB/s-245KiB/s (148kB/s-251kB/s), io=45.2MiB (47.4MB), run=10146-10196msec 00:29:18.871 20:30:22 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:18.871 20:30:22 -- target/dif.sh@43 -- # local sub 00:29:18.871 20:30:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.871 20:30:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:18.871 20:30:22 -- target/dif.sh@36 -- # local sub_id=0 00:29:18.871 20:30:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:18.871 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.871 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.871 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.871 20:30:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:18.871 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.871 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.871 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.871 20:30:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.871 20:30:22 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:18.871 20:30:22 -- target/dif.sh@36 -- # local sub_id=1 00:29:18.871 20:30:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:18.871 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.871 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.871 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.871 20:30:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:18.871 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.871 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.871 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.871 20:30:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.871 20:30:22 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:18.871 20:30:22 -- target/dif.sh@36 -- # local sub_id=2 00:29:18.871 20:30:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:18.871 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.871 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.871 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.871 20:30:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:18.871 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.871 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.871 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.871 20:30:22 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:18.871 20:30:22 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:18.871 20:30:22 -- target/dif.sh@115 -- # numjobs=2 00:29:18.871 20:30:22 -- target/dif.sh@115 -- # iodepth=8 00:29:18.871 20:30:22 -- target/dif.sh@115 -- # runtime=5 00:29:18.871 20:30:22 -- target/dif.sh@115 -- # files=1 00:29:18.871 20:30:22 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:18.871 20:30:22 -- target/dif.sh@28 -- # local sub 00:29:18.871 20:30:22 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.871 20:30:22 -- target/dif.sh@31 -- # create_subsystem 0 00:29:18.871 20:30:22 -- target/dif.sh@18 -- # local sub_id=0 00:29:18.872 20:30:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 bdev_null0 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 [2024-11-20 20:30:22.089325] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.872 20:30:22 -- target/dif.sh@31 -- # create_subsystem 1 00:29:18.872 20:30:22 -- target/dif.sh@18 -- # local sub_id=1 00:29:18.872 20:30:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 bdev_null1 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:18.872 20:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.872 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:29:18.872 20:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.872 20:30:22 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:18.872 20:30:22 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:18.872 20:30:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:18.872 20:30:22 -- nvmf/common.sh@520 -- # config=() 00:29:18.872 20:30:22 -- nvmf/common.sh@520 -- # local subsystem config 00:29:18.872 20:30:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.872 20:30:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.872 20:30:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.872 { 00:29:18.872 "params": { 00:29:18.872 "name": "Nvme$subsystem", 00:29:18.872 "trtype": "$TEST_TRANSPORT", 00:29:18.872 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.872 "adrfam": "ipv4", 00:29:18.872 "trsvcid": "$NVMF_PORT", 00:29:18.872 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.872 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.872 "hdgst": ${hdgst:-false}, 00:29:18.872 "ddgst": ${ddgst:-false} 00:29:18.872 }, 00:29:18.872 "method": "bdev_nvme_attach_controller" 00:29:18.872 } 00:29:18.872 EOF 00:29:18.872 )") 00:29:18.872 20:30:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.872 20:30:22 -- target/dif.sh@82 -- # gen_fio_conf 00:29:18.872 20:30:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:18.872 20:30:22 -- target/dif.sh@54 -- # local file 00:29:18.872 20:30:22 -- target/dif.sh@56 -- # cat 00:29:18.872 20:30:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:18.872 20:30:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:18.872 20:30:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.872 20:30:22 -- common/autotest_common.sh@1330 -- # shift 00:29:18.872 20:30:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:18.872 20:30:22 -- nvmf/common.sh@542 -- # cat 00:29:18.872 20:30:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:18.872 20:30:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.872 20:30:22 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.872 20:30:22 -- target/dif.sh@73 -- # cat 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:18.872 20:30:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.872 20:30:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.872 { 00:29:18.872 "params": { 00:29:18.872 "name": "Nvme$subsystem", 00:29:18.872 "trtype": "$TEST_TRANSPORT", 00:29:18.872 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.872 "adrfam": "ipv4", 00:29:18.872 "trsvcid": "$NVMF_PORT", 00:29:18.872 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.872 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.872 "hdgst": ${hdgst:-false}, 00:29:18.872 "ddgst": ${ddgst:-false} 00:29:18.872 }, 00:29:18.872 "method": "bdev_nvme_attach_controller" 00:29:18.872 } 00:29:18.872 EOF 00:29:18.872 )") 00:29:18.872 20:30:22 -- target/dif.sh@72 -- # (( file++ )) 00:29:18.872 20:30:22 -- nvmf/common.sh@542 -- # cat 00:29:18.872 20:30:22 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.872 20:30:22 -- nvmf/common.sh@544 -- # jq . 00:29:18.872 20:30:22 -- nvmf/common.sh@545 -- # IFS=, 00:29:18.872 20:30:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:18.872 "params": { 00:29:18.872 "name": "Nvme0", 00:29:18.872 "trtype": "tcp", 00:29:18.872 "traddr": "10.0.0.2", 00:29:18.872 "adrfam": "ipv4", 00:29:18.872 "trsvcid": "4420", 00:29:18.872 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:18.872 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:18.872 "hdgst": false, 00:29:18.872 "ddgst": false 00:29:18.872 }, 00:29:18.872 "method": "bdev_nvme_attach_controller" 00:29:18.872 },{ 00:29:18.872 "params": { 00:29:18.872 "name": "Nvme1", 00:29:18.872 "trtype": "tcp", 00:29:18.872 "traddr": "10.0.0.2", 00:29:18.872 "adrfam": "ipv4", 00:29:18.872 "trsvcid": "4420", 00:29:18.872 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:18.872 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:18.872 "hdgst": false, 00:29:18.872 "ddgst": false 00:29:18.872 }, 00:29:18.872 "method": "bdev_nvme_attach_controller" 00:29:18.872 }' 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:18.872 20:30:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:18.872 20:30:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:18.872 20:30:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:18.872 20:30:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:18.872 20:30:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:18.872 20:30:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.872 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:18.872 ... 00:29:18.872 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:18.872 ... 00:29:18.872 fio-3.35 00:29:18.872 Starting 4 threads 00:29:18.872 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.872 [2024-11-20 20:30:22.972336] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:18.872 [2024-11-20 20:30:22.972434] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:24.137 00:29:24.137 filename0: (groupid=0, jobs=1): err= 0: pid=3296944: Wed Nov 20 20:30:28 2024 00:29:24.137 read: IOPS=1922, BW=15.0MiB/s (15.8MB/s)(75.1MiB/5002msec) 00:29:24.137 slat (nsec): min=3938, max=62332, avg=17624.03, stdev=9821.88 00:29:24.137 clat (usec): min=648, max=7812, avg=4098.29, stdev=604.65 00:29:24.137 lat (usec): min=659, max=7825, avg=4115.91, stdev=604.56 00:29:24.137 clat percentiles (usec): 00:29:24.137 | 1.00th=[ 2540], 5.00th=[ 3425], 10.00th=[ 3687], 20.00th=[ 3851], 00:29:24.137 | 30.00th=[ 3949], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:29:24.137 | 70.00th=[ 4178], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 5145], 00:29:24.137 | 99.00th=[ 6521], 99.50th=[ 6915], 99.90th=[ 7373], 99.95th=[ 7504], 00:29:24.137 | 99.99th=[ 7832] 00:29:24.137 bw ( KiB/s): min=14912, max=15680, per=24.75%, avg=15402.67, stdev=218.65, samples=9 00:29:24.137 iops : min= 1864, max= 1960, avg=1925.33, stdev=27.33, samples=9 00:29:24.137 lat (usec) : 750=0.05%, 1000=0.20% 00:29:24.137 lat (msec) : 2=0.45%, 4=40.51%, 10=58.79% 00:29:24.137 cpu : usr=95.10%, sys=4.28%, ctx=13, majf=0, minf=0 00:29:24.138 IO depths : 1=0.1%, 2=12.1%, 4=61.1%, 8=26.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 complete : 0=0.0%, 4=91.7%, 8=8.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 issued rwts: total=9617,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.138 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.138 filename0: (groupid=0, jobs=1): err= 0: pid=3296945: Wed Nov 20 20:30:28 2024 00:29:24.138 read: IOPS=1949, BW=15.2MiB/s (16.0MB/s)(76.2MiB/5001msec) 00:29:24.138 slat (nsec): min=4402, max=65741, avg=17386.39, stdev=9626.57 00:29:24.138 clat (usec): min=685, max=7482, avg=4043.21, stdev=511.32 00:29:24.138 lat (usec): min=696, max=7490, avg=4060.59, stdev=511.46 00:29:24.138 clat percentiles (usec): 00:29:24.138 | 1.00th=[ 2769], 5.00th=[ 3326], 10.00th=[ 3621], 20.00th=[ 3818], 00:29:24.138 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4080], 00:29:24.138 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4359], 95.00th=[ 4621], 00:29:24.138 | 99.00th=[ 6128], 99.50th=[ 6390], 99.90th=[ 7177], 99.95th=[ 7242], 00:29:24.138 | 99.99th=[ 7504] 00:29:24.138 bw ( KiB/s): min=15232, max=16080, per=24.99%, avg=15553.78, stdev=241.79, samples=9 00:29:24.138 iops : min= 1904, max= 2010, avg=1944.22, stdev=30.22, samples=9 00:29:24.138 lat (usec) : 750=0.02%, 1000=0.07% 00:29:24.138 lat (msec) : 2=0.31%, 4=42.46%, 10=57.14% 00:29:24.138 cpu : usr=95.06%, sys=4.36%, ctx=9, majf=0, minf=0 00:29:24.138 IO depths : 1=0.1%, 2=12.1%, 4=60.6%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 issued rwts: total=9750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.138 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.138 filename1: (groupid=0, jobs=1): err= 0: pid=3296946: Wed Nov 20 20:30:28 2024 00:29:24.138 read: IOPS=1961, BW=15.3MiB/s (16.1MB/s)(76.7MiB/5003msec) 00:29:24.138 slat (nsec): min=4090, max=53049, avg=19275.30, stdev=7830.71 00:29:24.138 clat (usec): min=698, max=8193, avg=4015.54, stdev=469.22 00:29:24.138 lat (usec): min=718, max=8209, avg=4034.82, stdev=469.80 00:29:24.138 clat percentiles (usec): 00:29:24.138 | 1.00th=[ 2671], 5.00th=[ 3261], 10.00th=[ 3589], 20.00th=[ 3818], 00:29:24.138 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4080], 00:29:24.138 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4359], 95.00th=[ 4490], 00:29:24.138 | 99.00th=[ 5669], 99.50th=[ 6259], 99.90th=[ 7242], 99.95th=[ 8029], 00:29:24.138 | 99.99th=[ 8225] 00:29:24.138 bw ( KiB/s): min=15232, max=16368, per=25.21%, avg=15689.60, stdev=390.41, samples=10 00:29:24.138 iops : min= 1904, max= 2046, avg=1961.20, stdev=48.80, samples=10 00:29:24.138 lat (usec) : 750=0.02%, 1000=0.04% 00:29:24.138 lat (msec) : 2=0.15%, 4=43.98%, 10=55.81% 00:29:24.138 cpu : usr=95.26%, sys=4.12%, ctx=10, majf=0, minf=0 00:29:24.138 IO depths : 1=0.1%, 2=10.1%, 4=61.3%, 8=28.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 complete : 0=0.0%, 4=93.1%, 8=6.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 issued rwts: total=9814,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.138 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.138 filename1: (groupid=0, jobs=1): err= 0: pid=3296947: Wed Nov 20 20:30:28 2024 00:29:24.138 read: IOPS=1946, BW=15.2MiB/s (15.9MB/s)(76.1MiB/5003msec) 00:29:24.138 slat (nsec): min=4326, max=68616, avg=17003.72, stdev=9226.82 00:29:24.138 clat (usec): min=837, max=7437, avg=4049.77, stdev=510.11 00:29:24.138 lat (usec): min=849, max=7458, avg=4066.77, stdev=510.35 00:29:24.138 clat percentiles (usec): 00:29:24.138 | 1.00th=[ 2769], 5.00th=[ 3294], 10.00th=[ 3621], 20.00th=[ 3851], 00:29:24.138 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:29:24.138 | 70.00th=[ 4178], 80.00th=[ 4228], 90.00th=[ 4359], 95.00th=[ 4752], 00:29:24.138 | 99.00th=[ 6128], 99.50th=[ 6390], 99.90th=[ 6915], 99.95th=[ 7046], 00:29:24.138 | 99.99th=[ 7439] 00:29:24.138 bw ( KiB/s): min=15248, max=16144, per=25.02%, avg=15574.20, stdev=273.06, samples=10 00:29:24.138 iops : min= 1906, max= 2018, avg=1946.70, stdev=34.23, samples=10 00:29:24.138 lat (usec) : 1000=0.06% 00:29:24.138 lat (msec) : 2=0.31%, 4=41.78%, 10=57.85% 00:29:24.138 cpu : usr=95.60%, sys=3.84%, ctx=13, majf=0, minf=0 00:29:24.138 IO depths : 1=0.1%, 2=12.1%, 4=61.0%, 8=26.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.138 issued rwts: total=9739,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.138 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.138 00:29:24.138 Run status group 0 (all jobs): 00:29:24.138 READ: bw=60.8MiB/s (63.7MB/s), 15.0MiB/s-15.3MiB/s (15.8MB/s-16.1MB/s), io=304MiB (319MB), run=5001-5003msec 00:29:24.138 20:30:28 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:24.138 20:30:28 -- target/dif.sh@43 -- # local sub 00:29:24.138 20:30:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:24.138 20:30:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:24.138 20:30:28 -- target/dif.sh@36 -- # local sub_id=0 00:29:24.138 20:30:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:24.138 20:30:28 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:24.138 20:30:28 -- target/dif.sh@36 -- # local sub_id=1 00:29:24.138 20:30:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 00:29:24.138 real 0m24.424s 00:29:24.138 user 4m38.781s 00:29:24.138 sys 0m4.759s 00:29:24.138 20:30:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 ************************************ 00:29:24.138 END TEST fio_dif_rand_params 00:29:24.138 ************************************ 00:29:24.138 20:30:28 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:24.138 20:30:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:24.138 20:30:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 ************************************ 00:29:24.138 START TEST fio_dif_digest 00:29:24.138 ************************************ 00:29:24.138 20:30:28 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:24.138 20:30:28 -- target/dif.sh@123 -- # local NULL_DIF 00:29:24.138 20:30:28 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:24.138 20:30:28 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:24.138 20:30:28 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:24.138 20:30:28 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:24.138 20:30:28 -- target/dif.sh@127 -- # numjobs=3 00:29:24.138 20:30:28 -- target/dif.sh@127 -- # iodepth=3 00:29:24.138 20:30:28 -- target/dif.sh@127 -- # runtime=10 00:29:24.138 20:30:28 -- target/dif.sh@128 -- # hdgst=true 00:29:24.138 20:30:28 -- target/dif.sh@128 -- # ddgst=true 00:29:24.138 20:30:28 -- target/dif.sh@130 -- # create_subsystems 0 00:29:24.138 20:30:28 -- target/dif.sh@28 -- # local sub 00:29:24.138 20:30:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:24.138 20:30:28 -- target/dif.sh@31 -- # create_subsystem 0 00:29:24.138 20:30:28 -- target/dif.sh@18 -- # local sub_id=0 00:29:24.138 20:30:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 bdev_null0 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:24.138 20:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.138 20:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:24.138 [2024-11-20 20:30:28.407964] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:24.138 20:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.138 20:30:28 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:24.138 20:30:28 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:24.138 20:30:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:24.138 20:30:28 -- nvmf/common.sh@520 -- # config=() 00:29:24.138 20:30:28 -- nvmf/common.sh@520 -- # local subsystem config 00:29:24.138 20:30:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:24.138 20:30:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:24.138 20:30:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:24.138 { 00:29:24.138 "params": { 00:29:24.138 "name": "Nvme$subsystem", 00:29:24.138 "trtype": "$TEST_TRANSPORT", 00:29:24.138 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:24.139 "adrfam": "ipv4", 00:29:24.139 "trsvcid": "$NVMF_PORT", 00:29:24.139 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:24.139 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:24.139 "hdgst": ${hdgst:-false}, 00:29:24.139 "ddgst": ${ddgst:-false} 00:29:24.139 }, 00:29:24.139 "method": "bdev_nvme_attach_controller" 00:29:24.139 } 00:29:24.139 EOF 00:29:24.139 )") 00:29:24.139 20:30:28 -- target/dif.sh@82 -- # gen_fio_conf 00:29:24.139 20:30:28 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:24.139 20:30:28 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:24.139 20:30:28 -- target/dif.sh@54 -- # local file 00:29:24.139 20:30:28 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:24.139 20:30:28 -- target/dif.sh@56 -- # cat 00:29:24.139 20:30:28 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:24.139 20:30:28 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:24.139 20:30:28 -- common/autotest_common.sh@1330 -- # shift 00:29:24.139 20:30:28 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:24.139 20:30:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:24.139 20:30:28 -- nvmf/common.sh@542 -- # cat 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:24.139 20:30:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:24.139 20:30:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:24.139 20:30:28 -- nvmf/common.sh@544 -- # jq . 00:29:24.139 20:30:28 -- nvmf/common.sh@545 -- # IFS=, 00:29:24.139 20:30:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:24.139 "params": { 00:29:24.139 "name": "Nvme0", 00:29:24.139 "trtype": "tcp", 00:29:24.139 "traddr": "10.0.0.2", 00:29:24.139 "adrfam": "ipv4", 00:29:24.139 "trsvcid": "4420", 00:29:24.139 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:24.139 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:24.139 "hdgst": true, 00:29:24.139 "ddgst": true 00:29:24.139 }, 00:29:24.139 "method": "bdev_nvme_attach_controller" 00:29:24.139 }' 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:24.139 20:30:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:24.139 20:30:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:24.139 20:30:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:24.139 20:30:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:24.139 20:30:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:24.139 20:30:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:24.139 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:24.139 ... 00:29:24.139 fio-3.35 00:29:24.139 Starting 3 threads 00:29:24.139 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.139 [2024-11-20 20:30:29.051557] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:24.139 [2024-11-20 20:30:29.051616] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:36.413 00:29:36.413 filename0: (groupid=0, jobs=1): err= 0: pid=3297726: Wed Nov 20 20:30:39 2024 00:29:36.413 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10047msec) 00:29:36.413 slat (nsec): min=7279, max=71815, avg=12701.93, stdev=2785.00 00:29:36.413 clat (usec): min=8650, max=57312, avg=14587.63, stdev=2307.53 00:29:36.413 lat (usec): min=8682, max=57325, avg=14600.34, stdev=2307.36 00:29:36.413 clat percentiles (usec): 00:29:36.413 | 1.00th=[11469], 5.00th=[12649], 10.00th=[13173], 20.00th=[13566], 00:29:36.413 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:29:36.413 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:29:36.413 | 99.00th=[17433], 99.50th=[17695], 99.90th=[54264], 99.95th=[56886], 00:29:36.413 | 99.99th=[57410] 00:29:36.413 bw ( KiB/s): min=24064, max=27904, per=33.41%, avg=26342.40, stdev=939.32, samples=20 00:29:36.413 iops : min= 188, max= 218, avg=205.80, stdev= 7.34, samples=20 00:29:36.413 lat (msec) : 10=0.53%, 20=99.22%, 100=0.24% 00:29:36.413 cpu : usr=92.84%, sys=6.66%, ctx=29, majf=0, minf=240 00:29:36.413 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:36.413 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:36.413 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:36.413 issued rwts: total=2061,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:36.413 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:36.413 filename0: (groupid=0, jobs=1): err= 0: pid=3297727: Wed Nov 20 20:30:39 2024 00:29:36.413 read: IOPS=201, BW=25.1MiB/s (26.4MB/s)(253MiB/10047msec) 00:29:36.413 slat (nsec): min=7366, max=85259, avg=12884.54, stdev=2747.22 00:29:36.413 clat (usec): min=9716, max=56898, avg=14884.27, stdev=2235.55 00:29:36.413 lat (usec): min=9748, max=56909, avg=14897.15, stdev=2235.33 00:29:36.413 clat percentiles (usec): 00:29:36.413 | 1.00th=[11338], 5.00th=[12911], 10.00th=[13435], 20.00th=[13960], 00:29:36.413 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15139], 00:29:36.413 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16712], 00:29:36.413 | 99.00th=[17695], 99.50th=[17957], 99.90th=[55837], 99.95th=[56361], 00:29:36.413 | 99.99th=[56886] 00:29:36.413 bw ( KiB/s): min=23552, max=27190, per=32.75%, avg=25820.30, stdev=888.30, samples=20 00:29:36.413 iops : min= 184, max= 212, avg=201.70, stdev= 6.91, samples=20 00:29:36.413 lat (msec) : 10=0.25%, 20=99.50%, 50=0.10%, 100=0.15% 00:29:36.413 cpu : usr=92.44%, sys=7.07%, ctx=28, majf=0, minf=151 00:29:36.413 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:36.413 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:36.413 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:36.413 issued rwts: total=2020,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:36.413 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:36.413 filename0: (groupid=0, jobs=1): err= 0: pid=3297728: Wed Nov 20 20:30:39 2024 00:29:36.413 read: IOPS=210, BW=26.3MiB/s (27.6MB/s)(263MiB/10008msec) 00:29:36.413 slat (nsec): min=7384, max=58226, avg=12761.58, stdev=2285.89 00:29:36.413 clat (usec): min=7600, max=57059, avg=14230.63, stdev=1984.74 00:29:36.413 lat (usec): min=7613, max=57118, avg=14243.39, stdev=1985.19 00:29:36.413 clat percentiles (usec): 00:29:36.413 | 1.00th=[10945], 5.00th=[12256], 10.00th=[12649], 20.00th=[13173], 00:29:36.413 | 30.00th=[13566], 40.00th=[13960], 50.00th=[14222], 60.00th=[14484], 00:29:36.413 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15664], 95.00th=[16188], 00:29:36.413 | 99.00th=[17171], 99.50th=[17433], 99.90th=[55313], 99.95th=[55313], 00:29:36.413 | 99.99th=[56886] 00:29:36.414 bw ( KiB/s): min=25344, max=28672, per=34.18%, avg=26944.00, stdev=1060.00, samples=20 00:29:36.414 iops : min= 198, max= 224, avg=210.50, stdev= 8.28, samples=20 00:29:36.414 lat (msec) : 10=0.47%, 20=99.38%, 100=0.14% 00:29:36.414 cpu : usr=92.09%, sys=7.40%, ctx=30, majf=0, minf=104 00:29:36.414 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:36.414 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:36.414 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:36.414 issued rwts: total=2107,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:36.414 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:36.414 00:29:36.414 Run status group 0 (all jobs): 00:29:36.414 READ: bw=77.0MiB/s (80.7MB/s), 25.1MiB/s-26.3MiB/s (26.4MB/s-27.6MB/s), io=774MiB (811MB), run=10008-10047msec 00:29:36.414 20:30:39 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:36.414 20:30:39 -- target/dif.sh@43 -- # local sub 00:29:36.414 20:30:39 -- target/dif.sh@45 -- # for sub in "$@" 00:29:36.414 20:30:39 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:36.414 20:30:39 -- target/dif.sh@36 -- # local sub_id=0 00:29:36.414 20:30:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:36.414 20:30:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.414 20:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:36.414 20:30:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.414 20:30:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:36.414 20:30:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.414 20:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:36.414 20:30:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.414 00:29:36.414 real 0m11.062s 00:29:36.414 user 0m29.023s 00:29:36.414 sys 0m2.381s 00:29:36.414 20:30:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:36.414 20:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:36.414 ************************************ 00:29:36.414 END TEST fio_dif_digest 00:29:36.414 ************************************ 00:29:36.414 20:30:39 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:36.414 20:30:39 -- target/dif.sh@147 -- # nvmftestfini 00:29:36.414 20:30:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:36.414 20:30:39 -- nvmf/common.sh@116 -- # sync 00:29:36.414 20:30:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:36.414 20:30:39 -- nvmf/common.sh@119 -- # set +e 00:29:36.414 20:30:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:36.414 20:30:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:36.414 rmmod nvme_tcp 00:29:36.414 rmmod nvme_fabrics 00:29:36.414 rmmod nvme_keyring 00:29:36.414 20:30:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:36.414 20:30:39 -- nvmf/common.sh@123 -- # set -e 00:29:36.414 20:30:39 -- nvmf/common.sh@124 -- # return 0 00:29:36.414 20:30:39 -- nvmf/common.sh@477 -- # '[' -n 3290750 ']' 00:29:36.414 20:30:39 -- nvmf/common.sh@478 -- # killprocess 3290750 00:29:36.414 20:30:39 -- common/autotest_common.sh@936 -- # '[' -z 3290750 ']' 00:29:36.414 20:30:39 -- common/autotest_common.sh@940 -- # kill -0 3290750 00:29:36.414 20:30:39 -- common/autotest_common.sh@941 -- # uname 00:29:36.414 20:30:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:36.414 20:30:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3290750 00:29:36.414 20:30:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:36.414 20:30:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:36.414 20:30:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3290750' 00:29:36.414 killing process with pid 3290750 00:29:36.414 20:30:39 -- common/autotest_common.sh@955 -- # kill 3290750 00:29:36.414 20:30:39 -- common/autotest_common.sh@960 -- # wait 3290750 00:29:36.414 20:30:39 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:36.414 20:30:39 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:36.414 Waiting for block devices as requested 00:29:36.414 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:36.414 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:36.414 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:36.414 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:36.414 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:36.414 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:36.676 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:36.676 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:36.676 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:36.676 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:36.936 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:36.936 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:36.936 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:36.936 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:37.195 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:37.195 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:37.195 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:37.454 20:30:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:37.454 20:30:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:37.454 20:30:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:37.455 20:30:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:37.455 20:30:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:37.455 20:30:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:37.455 20:30:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.356 20:30:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:39.356 00:29:39.356 real 1m7.946s 00:29:39.356 user 6m37.763s 00:29:39.356 sys 0m15.687s 00:29:39.356 20:30:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:39.356 20:30:44 -- common/autotest_common.sh@10 -- # set +x 00:29:39.356 ************************************ 00:29:39.356 END TEST nvmf_dif 00:29:39.356 ************************************ 00:29:39.356 20:30:44 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:39.356 20:30:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:39.356 20:30:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:39.356 20:30:44 -- common/autotest_common.sh@10 -- # set +x 00:29:39.356 ************************************ 00:29:39.356 START TEST nvmf_abort_qd_sizes 00:29:39.356 ************************************ 00:29:39.356 20:30:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:39.356 * Looking for test storage... 00:29:39.615 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:39.615 20:30:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:39.615 20:30:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:39.615 20:30:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:39.615 20:30:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:39.615 20:30:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:39.615 20:30:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:39.615 20:30:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:39.615 20:30:44 -- scripts/common.sh@335 -- # IFS=.-: 00:29:39.615 20:30:44 -- scripts/common.sh@335 -- # read -ra ver1 00:29:39.615 20:30:44 -- scripts/common.sh@336 -- # IFS=.-: 00:29:39.615 20:30:44 -- scripts/common.sh@336 -- # read -ra ver2 00:29:39.615 20:30:44 -- scripts/common.sh@337 -- # local 'op=<' 00:29:39.615 20:30:44 -- scripts/common.sh@339 -- # ver1_l=2 00:29:39.615 20:30:44 -- scripts/common.sh@340 -- # ver2_l=1 00:29:39.615 20:30:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:39.615 20:30:44 -- scripts/common.sh@343 -- # case "$op" in 00:29:39.615 20:30:44 -- scripts/common.sh@344 -- # : 1 00:29:39.615 20:30:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:39.615 20:30:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:39.615 20:30:44 -- scripts/common.sh@364 -- # decimal 1 00:29:39.615 20:30:44 -- scripts/common.sh@352 -- # local d=1 00:29:39.615 20:30:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:39.615 20:30:44 -- scripts/common.sh@354 -- # echo 1 00:29:39.615 20:30:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:39.615 20:30:44 -- scripts/common.sh@365 -- # decimal 2 00:29:39.615 20:30:44 -- scripts/common.sh@352 -- # local d=2 00:29:39.615 20:30:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:39.615 20:30:44 -- scripts/common.sh@354 -- # echo 2 00:29:39.615 20:30:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:39.616 20:30:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:39.616 20:30:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:39.616 20:30:44 -- scripts/common.sh@367 -- # return 0 00:29:39.616 20:30:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:39.616 20:30:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:39.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.616 --rc genhtml_branch_coverage=1 00:29:39.616 --rc genhtml_function_coverage=1 00:29:39.616 --rc genhtml_legend=1 00:29:39.616 --rc geninfo_all_blocks=1 00:29:39.616 --rc geninfo_unexecuted_blocks=1 00:29:39.616 00:29:39.616 ' 00:29:39.616 20:30:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:39.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.616 --rc genhtml_branch_coverage=1 00:29:39.616 --rc genhtml_function_coverage=1 00:29:39.616 --rc genhtml_legend=1 00:29:39.616 --rc geninfo_all_blocks=1 00:29:39.616 --rc geninfo_unexecuted_blocks=1 00:29:39.616 00:29:39.616 ' 00:29:39.616 20:30:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:39.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.616 --rc genhtml_branch_coverage=1 00:29:39.616 --rc genhtml_function_coverage=1 00:29:39.616 --rc genhtml_legend=1 00:29:39.616 --rc geninfo_all_blocks=1 00:29:39.616 --rc geninfo_unexecuted_blocks=1 00:29:39.616 00:29:39.616 ' 00:29:39.616 20:30:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:39.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.616 --rc genhtml_branch_coverage=1 00:29:39.616 --rc genhtml_function_coverage=1 00:29:39.616 --rc genhtml_legend=1 00:29:39.616 --rc geninfo_all_blocks=1 00:29:39.616 --rc geninfo_unexecuted_blocks=1 00:29:39.616 00:29:39.616 ' 00:29:39.616 20:30:44 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:39.616 20:30:44 -- nvmf/common.sh@7 -- # uname -s 00:29:39.616 20:30:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:39.616 20:30:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:39.616 20:30:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:39.616 20:30:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:39.616 20:30:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:39.616 20:30:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:39.616 20:30:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:39.616 20:30:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:39.616 20:30:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:39.616 20:30:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:39.616 20:30:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:39.616 20:30:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:39.616 20:30:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:39.616 20:30:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:39.616 20:30:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:39.616 20:30:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:39.616 20:30:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:39.616 20:30:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:39.616 20:30:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:39.616 20:30:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.616 20:30:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.616 20:30:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.616 20:30:44 -- paths/export.sh@5 -- # export PATH 00:29:39.616 20:30:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.616 20:30:44 -- nvmf/common.sh@46 -- # : 0 00:29:39.616 20:30:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:39.616 20:30:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:39.616 20:30:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:39.616 20:30:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:39.616 20:30:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:39.616 20:30:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:39.616 20:30:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:39.616 20:30:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:39.616 20:30:44 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:39.616 20:30:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:39.616 20:30:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:39.616 20:30:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:39.616 20:30:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:39.616 20:30:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:39.616 20:30:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:39.616 20:30:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:39.616 20:30:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.616 20:30:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:39.616 20:30:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:39.616 20:30:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:39.616 20:30:44 -- common/autotest_common.sh@10 -- # set +x 00:29:41.519 20:30:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:41.519 20:30:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:41.519 20:30:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:41.519 20:30:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:41.519 20:30:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:41.519 20:30:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:41.519 20:30:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:41.519 20:30:46 -- nvmf/common.sh@294 -- # net_devs=() 00:29:41.519 20:30:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:41.519 20:30:46 -- nvmf/common.sh@295 -- # e810=() 00:29:41.519 20:30:46 -- nvmf/common.sh@295 -- # local -ga e810 00:29:41.519 20:30:46 -- nvmf/common.sh@296 -- # x722=() 00:29:41.519 20:30:46 -- nvmf/common.sh@296 -- # local -ga x722 00:29:41.519 20:30:46 -- nvmf/common.sh@297 -- # mlx=() 00:29:41.519 20:30:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:41.519 20:30:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:41.519 20:30:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:41.519 20:30:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:41.519 20:30:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:41.519 20:30:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.519 20:30:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:41.519 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:41.519 20:30:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.519 20:30:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.780 20:30:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:41.780 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:41.780 20:30:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:41.780 20:30:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.780 20:30:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.780 20:30:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.780 20:30:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.780 20:30:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:41.780 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:41.780 20:30:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.780 20:30:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.780 20:30:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.780 20:30:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.780 20:30:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.780 20:30:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:41.780 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:41.780 20:30:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.780 20:30:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:41.780 20:30:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:41.780 20:30:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:41.780 20:30:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:41.780 20:30:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:41.780 20:30:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:41.780 20:30:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:41.780 20:30:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:41.780 20:30:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:41.780 20:30:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:41.780 20:30:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:41.780 20:30:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:41.780 20:30:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:41.780 20:30:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:41.780 20:30:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:41.780 20:30:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:41.780 20:30:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:41.780 20:30:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:41.780 20:30:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:41.780 20:30:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:41.780 20:30:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:41.780 20:30:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:41.780 20:30:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:41.780 20:30:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:41.780 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:41.780 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:29:41.780 00:29:41.780 --- 10.0.0.2 ping statistics --- 00:29:41.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.780 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:29:41.780 20:30:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:41.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:41.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:29:41.780 00:29:41.780 --- 10.0.0.1 ping statistics --- 00:29:41.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.780 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:29:41.780 20:30:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:41.780 20:30:46 -- nvmf/common.sh@410 -- # return 0 00:29:41.780 20:30:46 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:41.780 20:30:46 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:43.156 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:43.156 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:43.156 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:44.091 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:44.091 20:30:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:44.091 20:30:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:44.091 20:30:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:44.091 20:30:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:44.091 20:30:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:44.091 20:30:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:44.091 20:30:49 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:44.091 20:30:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:44.091 20:30:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:44.091 20:30:49 -- common/autotest_common.sh@10 -- # set +x 00:29:44.091 20:30:49 -- nvmf/common.sh@469 -- # nvmfpid=3302750 00:29:44.091 20:30:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:44.091 20:30:49 -- nvmf/common.sh@470 -- # waitforlisten 3302750 00:29:44.091 20:30:49 -- common/autotest_common.sh@829 -- # '[' -z 3302750 ']' 00:29:44.092 20:30:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:44.092 20:30:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:44.092 20:30:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:44.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:44.092 20:30:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:44.092 20:30:49 -- common/autotest_common.sh@10 -- # set +x 00:29:44.092 [2024-11-20 20:30:49.115934] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:44.092 [2024-11-20 20:30:49.116017] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:44.357 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.357 [2024-11-20 20:30:49.178181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:44.357 [2024-11-20 20:30:49.283815] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:44.357 [2024-11-20 20:30:49.283948] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:44.357 [2024-11-20 20:30:49.283964] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:44.357 [2024-11-20 20:30:49.283975] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:44.357 [2024-11-20 20:30:49.284025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:44.357 [2024-11-20 20:30:49.284091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:44.357 [2024-11-20 20:30:49.284149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:44.357 [2024-11-20 20:30:49.284152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:45.289 20:30:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:45.289 20:30:50 -- common/autotest_common.sh@862 -- # return 0 00:29:45.289 20:30:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:45.289 20:30:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:45.289 20:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:45.289 20:30:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:45.289 20:30:50 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:45.289 20:30:50 -- scripts/common.sh@312 -- # local nvmes 00:29:45.289 20:30:50 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:45.289 20:30:50 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:45.289 20:30:50 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:45.289 20:30:50 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:45.289 20:30:50 -- scripts/common.sh@322 -- # uname -s 00:29:45.289 20:30:50 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:45.289 20:30:50 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:45.289 20:30:50 -- scripts/common.sh@327 -- # (( 1 )) 00:29:45.289 20:30:50 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:45.289 20:30:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:45.289 20:30:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:45.289 20:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:45.289 ************************************ 00:29:45.289 START TEST spdk_target_abort 00:29:45.289 ************************************ 00:29:45.289 20:30:50 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:45.289 20:30:50 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:45.289 20:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.289 20:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:48.567 spdk_targetn1 00:29:48.567 20:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:48.567 20:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:48.567 20:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:48.567 [2024-11-20 20:30:52.948240] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:48.567 20:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:48.567 20:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:48.567 20:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:48.567 20:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:48.567 20:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:48.567 20:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:48.567 20:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:48.567 20:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:48.567 20:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:48.567 [2024-11-20 20:30:52.980551] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:48.567 20:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:48.567 20:30:52 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:48.567 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.847 Initializing NVMe Controllers 00:29:51.847 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:51.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:51.847 Initialization complete. Launching workers. 00:29:51.847 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12597, failed: 0 00:29:51.847 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1218, failed to submit 11379 00:29:51.847 success 726, unsuccess 492, failed 0 00:29:51.847 20:30:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:51.847 20:30:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:51.847 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.123 Initializing NVMe Controllers 00:29:55.123 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:55.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:55.123 Initialization complete. Launching workers. 00:29:55.123 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8640, failed: 0 00:29:55.123 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1214, failed to submit 7426 00:29:55.123 success 350, unsuccess 864, failed 0 00:29:55.123 20:30:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:55.123 20:30:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:55.123 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.649 Initializing NVMe Controllers 00:29:57.649 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:57.649 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:57.649 Initialization complete. Launching workers. 00:29:57.649 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32286, failed: 0 00:29:57.649 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2699, failed to submit 29587 00:29:57.649 success 535, unsuccess 2164, failed 0 00:29:57.649 20:31:02 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:57.649 20:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.649 20:31:02 -- common/autotest_common.sh@10 -- # set +x 00:29:57.649 20:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.649 20:31:02 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:57.649 20:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.649 20:31:02 -- common/autotest_common.sh@10 -- # set +x 00:29:59.022 20:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:59.022 20:31:03 -- target/abort_qd_sizes.sh@62 -- # killprocess 3302750 00:29:59.022 20:31:03 -- common/autotest_common.sh@936 -- # '[' -z 3302750 ']' 00:29:59.022 20:31:03 -- common/autotest_common.sh@940 -- # kill -0 3302750 00:29:59.022 20:31:03 -- common/autotest_common.sh@941 -- # uname 00:29:59.022 20:31:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:59.022 20:31:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3302750 00:29:59.022 20:31:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:59.022 20:31:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:59.022 20:31:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3302750' 00:29:59.022 killing process with pid 3302750 00:29:59.022 20:31:03 -- common/autotest_common.sh@955 -- # kill 3302750 00:29:59.022 20:31:03 -- common/autotest_common.sh@960 -- # wait 3302750 00:29:59.280 00:29:59.280 real 0m14.098s 00:29:59.280 user 0m55.886s 00:29:59.280 sys 0m2.479s 00:29:59.280 20:31:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:59.280 20:31:04 -- common/autotest_common.sh@10 -- # set +x 00:29:59.280 ************************************ 00:29:59.280 END TEST spdk_target_abort 00:29:59.280 ************************************ 00:29:59.280 20:31:04 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:59.280 20:31:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:59.280 20:31:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:59.280 20:31:04 -- common/autotest_common.sh@10 -- # set +x 00:29:59.280 ************************************ 00:29:59.280 START TEST kernel_target_abort 00:29:59.280 ************************************ 00:29:59.280 20:31:04 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:59.280 20:31:04 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:59.280 20:31:04 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:59.280 20:31:04 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:59.280 20:31:04 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:59.280 20:31:04 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:59.280 20:31:04 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:59.280 20:31:04 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:59.280 20:31:04 -- nvmf/common.sh@627 -- # local block nvme 00:29:59.280 20:31:04 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:59.280 20:31:04 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:59.280 20:31:04 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:59.280 20:31:04 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:00.657 Waiting for block devices as requested 00:30:00.657 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:00.657 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:00.657 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:00.916 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:00.916 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:00.916 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:00.916 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:00.916 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:01.174 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:01.174 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:01.174 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:01.174 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:01.433 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:01.433 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:01.433 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:01.433 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:01.691 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:01.692 20:31:06 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:01.692 20:31:06 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:01.692 20:31:06 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:01.692 20:31:06 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:01.692 20:31:06 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:01.692 No valid GPT data, bailing 00:30:01.692 20:31:06 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:01.692 20:31:06 -- scripts/common.sh@393 -- # pt= 00:30:01.692 20:31:06 -- scripts/common.sh@394 -- # return 1 00:30:01.692 20:31:06 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:01.692 20:31:06 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:01.692 20:31:06 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:01.692 20:31:06 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:01.692 20:31:06 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:01.692 20:31:06 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:01.692 20:31:06 -- nvmf/common.sh@654 -- # echo 1 00:30:01.692 20:31:06 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:01.692 20:31:06 -- nvmf/common.sh@656 -- # echo 1 00:30:01.692 20:31:06 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:01.692 20:31:06 -- nvmf/common.sh@663 -- # echo tcp 00:30:01.692 20:31:06 -- nvmf/common.sh@664 -- # echo 4420 00:30:01.692 20:31:06 -- nvmf/common.sh@665 -- # echo ipv4 00:30:01.692 20:31:06 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:01.692 20:31:06 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:01.950 00:30:01.950 Discovery Log Number of Records 2, Generation counter 2 00:30:01.950 =====Discovery Log Entry 0====== 00:30:01.950 trtype: tcp 00:30:01.950 adrfam: ipv4 00:30:01.950 subtype: current discovery subsystem 00:30:01.950 treq: not specified, sq flow control disable supported 00:30:01.950 portid: 1 00:30:01.950 trsvcid: 4420 00:30:01.950 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:01.950 traddr: 10.0.0.1 00:30:01.950 eflags: none 00:30:01.950 sectype: none 00:30:01.950 =====Discovery Log Entry 1====== 00:30:01.950 trtype: tcp 00:30:01.950 adrfam: ipv4 00:30:01.950 subtype: nvme subsystem 00:30:01.950 treq: not specified, sq flow control disable supported 00:30:01.950 portid: 1 00:30:01.950 trsvcid: 4420 00:30:01.950 subnqn: kernel_target 00:30:01.950 traddr: 10.0.0.1 00:30:01.950 eflags: none 00:30:01.950 sectype: none 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:01.950 20:31:06 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:01.950 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.229 Initializing NVMe Controllers 00:30:05.229 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:05.229 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:05.229 Initialization complete. Launching workers. 00:30:05.229 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 40658, failed: 0 00:30:05.229 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 40658, failed to submit 0 00:30:05.229 success 0, unsuccess 40658, failed 0 00:30:05.229 20:31:09 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:05.229 20:31:09 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:05.229 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.509 Initializing NVMe Controllers 00:30:08.509 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:08.509 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:08.509 Initialization complete. Launching workers. 00:30:08.509 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 76702, failed: 0 00:30:08.509 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19342, failed to submit 57360 00:30:08.509 success 0, unsuccess 19342, failed 0 00:30:08.509 20:31:12 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:08.509 20:31:12 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:08.509 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.790 Initializing NVMe Controllers 00:30:11.790 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:11.790 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:11.790 Initialization complete. Launching workers. 00:30:11.790 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73893, failed: 0 00:30:11.790 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18450, failed to submit 55443 00:30:11.790 success 0, unsuccess 18450, failed 0 00:30:11.790 20:31:16 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:11.790 20:31:16 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:11.790 20:31:16 -- nvmf/common.sh@677 -- # echo 0 00:30:11.790 20:31:16 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:11.790 20:31:16 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:11.790 20:31:16 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:11.790 20:31:16 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:11.790 20:31:16 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:11.790 20:31:16 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:11.790 00:30:11.790 real 0m11.937s 00:30:11.790 user 0m5.553s 00:30:11.790 sys 0m2.419s 00:30:11.790 20:31:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.790 20:31:16 -- common/autotest_common.sh@10 -- # set +x 00:30:11.790 ************************************ 00:30:11.790 END TEST kernel_target_abort 00:30:11.790 ************************************ 00:30:11.790 20:31:16 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:11.790 20:31:16 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:11.790 20:31:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:11.790 20:31:16 -- nvmf/common.sh@116 -- # sync 00:30:11.790 20:31:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:11.790 20:31:16 -- nvmf/common.sh@119 -- # set +e 00:30:11.790 20:31:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:11.790 20:31:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:11.790 rmmod nvme_tcp 00:30:11.790 rmmod nvme_fabrics 00:30:11.790 rmmod nvme_keyring 00:30:11.790 20:31:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:11.790 20:31:16 -- nvmf/common.sh@123 -- # set -e 00:30:11.790 20:31:16 -- nvmf/common.sh@124 -- # return 0 00:30:11.790 20:31:16 -- nvmf/common.sh@477 -- # '[' -n 3302750 ']' 00:30:11.790 20:31:16 -- nvmf/common.sh@478 -- # killprocess 3302750 00:30:11.790 20:31:16 -- common/autotest_common.sh@936 -- # '[' -z 3302750 ']' 00:30:11.790 20:31:16 -- common/autotest_common.sh@940 -- # kill -0 3302750 00:30:11.790 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3302750) - No such process 00:30:11.790 20:31:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3302750 is not found' 00:30:11.790 Process with pid 3302750 is not found 00:30:11.790 20:31:16 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:11.790 20:31:16 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:12.356 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:12.356 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:12.356 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:12.356 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:12.356 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:12.356 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:12.356 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:12.615 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:12.615 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:12.615 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:12.616 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:12.616 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:12.616 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:12.616 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:12.616 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:12.616 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:12.616 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:12.616 20:31:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:12.616 20:31:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:12.616 20:31:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:12.616 20:31:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:12.616 20:31:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:12.616 20:31:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:12.616 20:31:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:15.149 20:31:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:15.149 00:30:15.149 real 0m35.283s 00:30:15.149 user 1m3.827s 00:30:15.149 sys 0m8.372s 00:30:15.149 20:31:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:15.149 20:31:19 -- common/autotest_common.sh@10 -- # set +x 00:30:15.149 ************************************ 00:30:15.149 END TEST nvmf_abort_qd_sizes 00:30:15.149 ************************************ 00:30:15.149 20:31:19 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:15.149 20:31:19 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:15.149 20:31:19 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:15.149 20:31:19 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:15.149 20:31:19 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:15.149 20:31:19 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:15.149 20:31:19 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:15.149 20:31:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:15.149 20:31:19 -- common/autotest_common.sh@10 -- # set +x 00:30:15.149 20:31:19 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:15.149 20:31:19 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:15.149 20:31:19 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:15.149 20:31:19 -- common/autotest_common.sh@10 -- # set +x 00:30:16.524 INFO: APP EXITING 00:30:16.524 INFO: killing all VMs 00:30:16.524 INFO: killing vhost app 00:30:16.524 INFO: EXIT DONE 00:30:17.470 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:17.470 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:17.470 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:17.470 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:17.813 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:17.813 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:17.813 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:17.813 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:17.813 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:17.813 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:17.813 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:17.813 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:17.813 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:17.813 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:17.813 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:17.813 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:17.813 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:19.214 Cleaning 00:30:19.214 Removing: /var/run/dpdk/spdk0/config 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:19.214 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:19.214 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:19.214 Removing: /var/run/dpdk/spdk1/config 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:19.214 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:19.214 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:19.214 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:19.214 Removing: /var/run/dpdk/spdk2/config 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:19.214 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:19.214 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:19.214 Removing: /var/run/dpdk/spdk3/config 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:19.214 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:19.214 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:19.214 Removing: /var/run/dpdk/spdk4/config 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:19.214 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:19.214 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:19.214 Removing: /dev/shm/bdev_svc_trace.1 00:30:19.214 Removing: /dev/shm/nvmf_trace.0 00:30:19.214 Removing: /dev/shm/spdk_tgt_trace.pid3033768 00:30:19.214 Removing: /var/run/dpdk/spdk0 00:30:19.214 Removing: /var/run/dpdk/spdk1 00:30:19.214 Removing: /var/run/dpdk/spdk2 00:30:19.214 Removing: /var/run/dpdk/spdk3 00:30:19.214 Removing: /var/run/dpdk/spdk4 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3032052 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3032826 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3033768 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3034359 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3035616 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3036566 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3036886 00:30:19.214 Removing: /var/run/dpdk/spdk_pid3037100 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3037444 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3037770 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3037934 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3038092 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3038288 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3038740 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3041642 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3042137 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3042381 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3042521 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3042953 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3042977 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3043416 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3043556 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3043847 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3043896 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3044157 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3044247 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3044686 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3044841 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3045070 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3045351 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3045377 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3045554 00:30:19.215 Removing: /var/run/dpdk/spdk_pid3045705 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3045858 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3046120 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3046286 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3046426 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3046704 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3046853 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3047013 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3047214 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3047439 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3047581 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3047757 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3048000 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3048168 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3048308 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3048586 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3048736 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3048895 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3049154 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3049316 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3049468 00:30:19.473 Removing: /var/run/dpdk/spdk_pid3049740 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3049888 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3050050 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3050281 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3050468 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3050619 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3050804 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3051043 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3051201 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3051351 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3051624 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3051778 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3051982 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3052207 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3052368 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3052533 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3052790 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3052941 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3053154 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3053300 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3053511 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3055864 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3112796 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3115460 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3122598 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3125977 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3128464 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3128884 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3134715 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3134981 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3137661 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3141464 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3143707 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3150463 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3155876 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3157127 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3157918 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3168618 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3171416 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3174396 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3175611 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3177041 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3177262 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3177410 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3177697 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3178292 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3179669 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3180684 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3181141 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3184764 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3188351 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3191994 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3216299 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3219143 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3222985 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3224080 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3225222 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3227815 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3230444 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3235469 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3235477 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3238423 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3238559 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3238697 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3238977 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3238982 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3240095 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3241425 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3242643 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3243884 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3245101 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3246315 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3250213 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3250669 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3251993 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3252750 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3256666 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3258714 00:30:19.474 Removing: /var/run/dpdk/spdk_pid3262950 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3266714 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3270388 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3270807 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3271351 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3271775 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3272364 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3272926 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3273350 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3273900 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3276595 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3276847 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3280727 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3280904 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3282678 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3287848 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3287859 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3290933 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3292371 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3293987 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3295317 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3296765 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3297665 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3303194 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3303589 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3303995 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3305472 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3305883 00:30:19.734 Removing: /var/run/dpdk/spdk_pid3306294 00:30:19.734 Clean 00:30:19.734 killing process with pid 3004231 00:30:27.852 killing process with pid 3004228 00:30:27.852 killing process with pid 3004230 00:30:27.852 killing process with pid 3004229 00:30:27.852 20:31:32 -- common/autotest_common.sh@1446 -- # return 0 00:30:27.852 20:31:32 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:27.852 20:31:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.852 20:31:32 -- common/autotest_common.sh@10 -- # set +x 00:30:27.852 20:31:32 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:27.852 20:31:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.852 20:31:32 -- common/autotest_common.sh@10 -- # set +x 00:30:27.852 20:31:32 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:27.852 20:31:32 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:27.852 20:31:32 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:27.852 20:31:32 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:27.852 20:31:32 -- spdk/autotest.sh@383 -- # hostname 00:30:27.852 20:31:32 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:28.110 geninfo: WARNING: invalid characters removed from testname! 00:30:54.665 20:31:58 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:57.946 20:32:02 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:00.475 20:32:05 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:03.004 20:32:07 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:05.531 20:32:10 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:08.811 20:32:13 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:10.712 20:32:15 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:10.972 20:32:15 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:10.972 20:32:15 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:10.972 20:32:15 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:10.972 20:32:15 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:10.972 20:32:15 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:10.972 20:32:15 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:10.972 20:32:15 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:10.972 20:32:15 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:10.972 20:32:15 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:10.972 20:32:15 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:10.972 20:32:15 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:10.972 20:32:15 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:10.972 20:32:15 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:10.972 20:32:15 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:10.972 20:32:15 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:10.972 20:32:15 -- scripts/common.sh@343 -- $ case "$op" in 00:31:10.972 20:32:15 -- scripts/common.sh@344 -- $ : 1 00:31:10.972 20:32:15 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:10.972 20:32:15 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:10.972 20:32:15 -- scripts/common.sh@364 -- $ decimal 1 00:31:10.972 20:32:15 -- scripts/common.sh@352 -- $ local d=1 00:31:10.972 20:32:15 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:10.972 20:32:15 -- scripts/common.sh@354 -- $ echo 1 00:31:10.972 20:32:15 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:10.972 20:32:15 -- scripts/common.sh@365 -- $ decimal 2 00:31:10.972 20:32:15 -- scripts/common.sh@352 -- $ local d=2 00:31:10.972 20:32:15 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:10.972 20:32:15 -- scripts/common.sh@354 -- $ echo 2 00:31:10.972 20:32:15 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:10.972 20:32:15 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:10.972 20:32:15 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:10.972 20:32:15 -- scripts/common.sh@367 -- $ return 0 00:31:10.972 20:32:15 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:10.972 20:32:15 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:10.972 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.972 --rc genhtml_branch_coverage=1 00:31:10.972 --rc genhtml_function_coverage=1 00:31:10.972 --rc genhtml_legend=1 00:31:10.972 --rc geninfo_all_blocks=1 00:31:10.972 --rc geninfo_unexecuted_blocks=1 00:31:10.972 00:31:10.972 ' 00:31:10.972 20:32:15 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:10.972 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.972 --rc genhtml_branch_coverage=1 00:31:10.972 --rc genhtml_function_coverage=1 00:31:10.972 --rc genhtml_legend=1 00:31:10.972 --rc geninfo_all_blocks=1 00:31:10.972 --rc geninfo_unexecuted_blocks=1 00:31:10.972 00:31:10.972 ' 00:31:10.972 20:32:15 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:10.972 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.972 --rc genhtml_branch_coverage=1 00:31:10.972 --rc genhtml_function_coverage=1 00:31:10.972 --rc genhtml_legend=1 00:31:10.972 --rc geninfo_all_blocks=1 00:31:10.972 --rc geninfo_unexecuted_blocks=1 00:31:10.972 00:31:10.972 ' 00:31:10.973 20:32:15 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:10.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.973 --rc genhtml_branch_coverage=1 00:31:10.973 --rc genhtml_function_coverage=1 00:31:10.973 --rc genhtml_legend=1 00:31:10.973 --rc geninfo_all_blocks=1 00:31:10.973 --rc geninfo_unexecuted_blocks=1 00:31:10.973 00:31:10.973 ' 00:31:10.973 20:32:15 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:10.973 20:32:15 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:10.973 20:32:15 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:10.973 20:32:15 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:10.973 20:32:15 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.973 20:32:15 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.973 20:32:15 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.973 20:32:15 -- paths/export.sh@5 -- $ export PATH 00:31:10.973 20:32:15 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.973 20:32:15 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:10.973 20:32:15 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:10.973 20:32:15 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732131135.XXXXXX 00:31:10.973 20:32:15 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732131135.AkTKs8 00:31:10.973 20:32:15 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:10.973 20:32:15 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:10.973 20:32:15 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:10.973 20:32:15 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:10.973 20:32:15 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:10.973 20:32:15 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:10.973 20:32:15 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:10.973 20:32:15 -- common/autotest_common.sh@10 -- $ set +x 00:31:10.973 20:32:15 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:10.973 20:32:15 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:10.973 20:32:15 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:10.973 20:32:15 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:10.973 20:32:15 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:10.973 20:32:15 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:10.973 20:32:15 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:10.973 20:32:15 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:10.973 20:32:15 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:10.973 20:32:15 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:10.973 20:32:15 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:10.973 + [[ -n 2961304 ]] 00:31:10.973 + sudo kill 2961304 00:31:10.983 [Pipeline] } 00:31:11.001 [Pipeline] // stage 00:31:11.007 [Pipeline] } 00:31:11.023 [Pipeline] // timeout 00:31:11.028 [Pipeline] } 00:31:11.042 [Pipeline] // catchError 00:31:11.048 [Pipeline] } 00:31:11.063 [Pipeline] // wrap 00:31:11.069 [Pipeline] } 00:31:11.082 [Pipeline] // catchError 00:31:11.092 [Pipeline] stage 00:31:11.094 [Pipeline] { (Epilogue) 00:31:11.107 [Pipeline] catchError 00:31:11.109 [Pipeline] { 00:31:11.124 [Pipeline] echo 00:31:11.126 Cleanup processes 00:31:11.132 [Pipeline] sh 00:31:11.419 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.419 3318236 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.435 [Pipeline] sh 00:31:11.721 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.721 ++ awk '{print $1}' 00:31:11.721 ++ grep -v 'sudo pgrep' 00:31:11.721 + sudo kill -9 00:31:11.721 + true 00:31:11.733 [Pipeline] sh 00:31:12.018 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:21.998 [Pipeline] sh 00:31:22.358 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:22.358 Artifacts sizes are good 00:31:22.374 [Pipeline] archiveArtifacts 00:31:22.382 Archiving artifacts 00:31:22.550 [Pipeline] sh 00:31:22.834 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:22.850 [Pipeline] cleanWs 00:31:22.860 [WS-CLEANUP] Deleting project workspace... 00:31:22.860 [WS-CLEANUP] Deferred wipeout is used... 00:31:22.868 [WS-CLEANUP] done 00:31:22.869 [Pipeline] } 00:31:22.887 [Pipeline] // catchError 00:31:22.900 [Pipeline] sh 00:31:23.183 + logger -p user.info -t JENKINS-CI 00:31:23.191 [Pipeline] } 00:31:23.203 [Pipeline] // stage 00:31:23.209 [Pipeline] } 00:31:23.222 [Pipeline] // node 00:31:23.227 [Pipeline] End of Pipeline 00:31:23.267 Finished: SUCCESS